00000100:00100000:0.0F:1782759354.285134:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211889664:0@lo:400:kworker.0 00000100:00100000:3.0F:1782759354.285159:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211890048:0@lo:400:kworker.0 00000100:00100000:1.0F:1782759354.285244:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211889920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759354.285402:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759354.285429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759354.285460:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759354.285463:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211890176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285470:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211889792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759354.285505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759354.285526:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211889920 00000100:00100000:1.0:1782759354.285534:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211889920 00000100:00100000:0.0:1782759354.285547:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890176 00000100:00100000:0.0:1782759354.285552:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890176 00000100:00080000:2.0F:1782759354.285571:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759354.285604:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1782759354.285612:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1782759354.285617:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211890176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285624:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211889920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285675:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211889920:12345-0@lo:400:kworker.0 Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759354.285682:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211890176:12345-0@lo:400:kworker.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759354.285687:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1782759354.285695:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1782759354.285719:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211889664 00000100:00100000:1.0:1782759354.285724:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211889664 00000100:00100000:1.0:1782759354.285758:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:0.0:1782759354.285762:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211890176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285769:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211889664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285809:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211889664:12345-0@lo:400:kworker.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759354.285815:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1782759354.285873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759354.285889:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211890304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759354.285935:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211889920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759354.285959:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211889792 00000100:00100000:1.0:1782759354.285973:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211889792 00000100:00100000:1.0:1782759354.285998:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:1.0:1782759354.286004:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759354.286056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759354.286058:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211889792:12345-0@lo:400:kworker.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759354.286073:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:3.0:1782759354.286110:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890304 00000100:00100000:1.0:1782759354.286110:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211889792:0@lo:400:kworker.0 00000100:00100000:3.0:1782759354.286116:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890304 00000100:00100000:0.0:1782759354.286127:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211889664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759354.286160:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890048 00000100:00100000:3.0:1782759354.286164:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890048 00000100:00100000:0.0:1782759354.286174:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1782759354.286185:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211890304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759354.286197:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:3.0:1782759354.286208:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211890048:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759354.286217:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759354.286221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759354.286243:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211890304:12345-0@lo:400:kworker.0 Request processed in 60us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759354.286250:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:1.0:1782759354.286266:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211890304:0@lo:400:kworker.0 00000100:00100000:3.0:1782759354.286273:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211890048:12345-0@lo:400:kworker.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759354.286282:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:3.0:1782759354.286376:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211890048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759354.796118:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759354.796142:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211890432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759354.796229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759354.796315:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890432 00000100:00100000:0.0:1782759354.796325:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890432 00000100:00100000:0.0:1782759354.796402:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1782759354.796415:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211890432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759354.796458:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759354.796521:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211890432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759354.796530:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1782759354.796590:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211890432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759354.988068:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759356.012951:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782759356.347079:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000001:00100000:1.0:1782759356.347094:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bb82512-d11e-4f65-a12c-289c04338aa2 00000020:00000080:1.0:1782759356.347098:0:6622:0:(genops.c:906:class_export_put()) final put ffff9170836ce000/5bb82512-d11e-4f65-a12c-289c04338aa2 00000020:00000080:3.0:1782759356.347148:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836ce000/5bb82512-d11e-4f65-a12c-289c04338aa2 for lustre-OST0000 00000020:00000080:3.0:1782759356.347203:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836c9000 for lustre-OST0000 00000001:00100000:3.0:1782759356.865307:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000001:00100000:3.0:1782759356.865323:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bb82512-d11e-4f65-a12c-289c04338aa2 00000001:00080000:3.0:1782759356.865333:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967978 is committed 00000020:00000080:3.0:1782759356.865337:0:5824:0:(genops.c:906:class_export_put()) final put ffff9170836cc800/5bb82512-d11e-4f65-a12c-289c04338aa2 00000001:00100000:0.0:1782759356.865354:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000020:00000080:2.0:1782759356.865362:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836cc800/5bb82512-d11e-4f65-a12c-289c04338aa2 for lustre-MDT0000 00000001:00100000:0.0:1782759356.865369:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bb82512-d11e-4f65-a12c-289c04338aa2 00000020:00000080:0.0:1782759356.865373:0:7507:0:(genops.c:906:class_export_put()) final put ffff917082d3e000/5bb82512-d11e-4f65-a12c-289c04338aa2 00000020:00000080:2.0:1782759356.865426:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836c8000 for lustre-MDT0000 00000020:00000080:2.0:1782759356.865431:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3e000/5bb82512-d11e-4f65-a12c-289c04338aa2 for lustre-OST0001 00000020:00000080:2.0:1782759356.865453:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d3d000 for lustre-OST0001 00010000:00010000:3.0:1782759357.035916:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759357.356025:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759357.356047:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211890560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759357.356106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759357.356304:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890560 00000100:00100000:2.0:1782759357.356312:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890560 00000100:00080000:1.0:1782759357.356348:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759357.356392:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1782759357.356399:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211890560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759357.356427:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759357.356464:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211890560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759357.356469:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1782759357.356497:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211890560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759357.620247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759357.620293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759357.620327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759357.620355:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759357.620381:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197172864 00000100:00100000:0.0:1782759357.620390:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197172864 00000100:00100000:0.0:1782759357.620450:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2453 00000100:00100000:0.0:1782759357.620461:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+7:2364:x1869355197172864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759357.620532:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+7:2364:x1869355197172864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759357.620540:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2453 00000100:00100000:0.0:1782759357.620561:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197172992 00000100:00100000:0.0:1782759357.620564:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197172992 00000100:00100000:0.0:1782759357.620589:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197173120 00000100:00100000:0.0:1782759357.620592:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197173120 00000100:00100000:0.0:1782759357.620617:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1910 00000100:00100000:0.0:1782759357.620624:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+5:2364:x1869355197172992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759357.620650:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+5:2364:x1869355197172992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759357.620657:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1910 00000100:00100000:0.0:1782759357.620670:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1911 00000100:00100000:0.0:1782759357.620676:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+5:2364:x1869355197173120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759357.620710:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+5:2364:x1869355197173120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759357.620717:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1911 00000100:00080000:0.0:1782759357.620733:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759357.620737:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759357.620740:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759357.620953:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197172736 00000100:00100000:1.0:1782759357.620958:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197172736 00000100:00100000:1.0:1782759357.620999:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2489 00000100:00100000:1.0:1782759357.621007:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64639963-9ce8-4d96-947c-ead0c5123d19+10:2364:x1869355197172736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759357.621044:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64639963-9ce8-4d96-947c-ead0c5123d19+10:2364:x1869355197172736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759357.621056:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2489 00010000:00010000:1.0:1782759358.060857:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782759358.259517:0:133185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 61: Nodemap enforces read-only mount == 14:55:56 (1782759356) 00010000:00010000:1.0:1782759359.084000:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759359.404108:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211890688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404157:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211891072:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759359.404220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759359.404292:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211891200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404292:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211890816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759359.404350:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890688 00000100:00100000:3.0:1782759359.404358:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890688 00000100:00100000:2.0:1782759359.404383:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211891328:0@lo:400:kworker.0 00000100:00100000:3.0:1782759359.404405:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:3.0:1782759359.404417:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211890688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759359.404459:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759359.404467:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211890944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759359.404475:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211890688:12345-0@lo:400:kworker.0 Request processed in 60us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759359.404484:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1782759359.404497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759359.404542:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891072 00000100:00100000:2.0:1782759359.404556:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891072 00000100:00100000:3.0:1782759359.404572:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890816 00000100:00100000:3.0:1782759359.404577:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890816 00000100:00100000:2.0:1782759359.404597:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891328 00000100:00100000:2.0:1782759359.404602:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891328 00000100:00100000:3.0:1782759359.404609:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211890944 00000100:00100000:3.0:1782759359.404613:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211890944 00000100:00100000:2.0:1782759359.404642:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1782759359.404643:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:3.0:1782759359.404650:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211890816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404667:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211891072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759359.404688:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211890816:12345-0@lo:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759359.404694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:3.0:1782759359.404707:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1782759359.404714:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211890944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404724:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211891072:12345-0@lo:400:kworker.0 Request processed in 60us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759359.404732:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1782759359.404746:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211890944:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759359.404751:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1782759359.404756:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1782759359.404763:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211891328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759359.404784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759359.404814:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211891328:12345-0@lo:400:kworker.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759359.404842:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1782759359.404853:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211890688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404879:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211891072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759359.404882:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891200 00000100:00080000:0.0:1782759359.404882:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759359.404886:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891200 00000100:00080000:0.0:1782759359.404887:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759359.404889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759359.404905:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759359.404920:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1782759359.404927:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211891200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404931:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211890944:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404947:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211890816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759359.404962:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211891328:0@lo:400:kworker.0 00000100:00100000:3.0:1782759359.404988:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211891200:12345-0@lo:400:kworker.0 Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759359.404995:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:0.0:1782759359.405170:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211891200:0@lo:400:kworker.0 00000001:02000400:1.0:1782759359.841583:0:133426:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0000.recovery_status 1475 00000100:00100000:2.0:1782759359.917794:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211891456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759359.918012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759359.918066:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891456 00000100:00100000:1.0:1782759359.918074:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891456 00000100:00100000:1.0:1782759359.918262:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1782759359.918273:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211891456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759359.918310:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759359.918362:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211891456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759359.918369:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1782759359.918431:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211891456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759360.107971:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759360.228277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759360.228328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759360.228363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759360.228389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759360.228426:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197173248 00000100:00100000:0.0:1782759360.228426:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197173632 00000100:00100000:3.0:1782759360.228436:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197173248 00000100:00100000:0.0:1782759360.228436:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197173632 00000100:00100000:3.0:1782759360.228490:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197173376 00000100:00100000:3.0:1782759360.228494:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197173376 00000100:00100000:0.0:1782759360.228504:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 913 00000100:00100000:3.0:1782759360.228515:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197173504 00000100:00100000:0.0:1782759360.228517:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+5:2360:x1869355197173632:12345-192.168.204.31@tcp:9:umount.0 00000100:00100000:3.0:1782759360.228520:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197173504 00000100:00100000:3.0:1782759360.228543:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 162 00000020:00000080:0.0:1782759360.228548:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de77e 00000100:00100000:1.0:1782759360.228553:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 163 00000100:00100000:3.0:1782759360.228554:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64639963-9ce8-4d96-947c-ead0c5123d19+12:2364:x1869355197173248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1782759360.228558:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082b47000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782759360.228568:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64639963-9ce8-4d96-947c-ead0c5123d19+12:2364:x1869355197173376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759360.228570:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759360.228581:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759360.228589:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99600/0xdd99f5c4777de75b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf668ac expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759360.228595:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98400/0xdd99f5c4777de769 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf668dd expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1782759360.228603:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967385 00010000:00010000:3.0:1782759360.228605:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759360.228610:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759360.228651:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64639963-9ce8-4d96-947c-ead0c5123d19+10:2364:x1869355197173248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759360.228656:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 162 00000100:00100000:3.0:1782759360.228670:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 164 00000100:00100000:3.0:1782759360.228675:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64639963-9ce8-4d96-947c-ead0c5123d19+9:2361:x1869355197173504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759360.228681:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759360.228687:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99c00/0xdd99f5c4777de762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf668d6 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759360.228707:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1782759360.228709:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759360.229716:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64639963-9ce8-4d96-947c-ead0c5123d19+8:2364:x1869355197173376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1143us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759360.229729:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 163 00010000:00010000:1.0:1782759360.229770:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759360.229937:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64639963-9ce8-4d96-947c-ead0c5123d19+7:2361:x1869355197173504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1257us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759360.229947:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 164 00000100:00100000:0.0:1782759360.230024:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+2:2360:x1869355197173632:12345-192.168.204.31@tcp:9:umount.0 Request processed in 1510us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759360.230033:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 913 00000100:00100000:1.0:1782759360.232892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759360.233012:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197173760 00000100:00100000:2.0:1782759360.233024:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197173760 00000100:00100000:2.0:1782759360.233164:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 914 00000100:00100000:2.0:1782759360.233173:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+5:2360:x1869355197173760:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1782759360.233201:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de777 00000100:00080000:2.0:1782759360.233209:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917082d3f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759360.233248:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967393 00010000:00010000:1.0:1782759360.233251:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759360.233536:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+2:2360:x1869355197173760:12345-192.168.204.31@tcp:9:umount.0 Request processed in 363us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759360.233544:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 914 00000100:00080000:0.0:1782759360.233621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759360.237711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759360.237781:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174016 00000100:00100000:3.0:1782759360.237789:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174016 00000100:00080000:0.0:1782759360.237888:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759360.237908:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1784 00000100:00100000:3.0:1782759360.237922:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+7:2360:x1869355197174016:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1782759360.237966:0:5802:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de770 00000020:00010000:3.0:1782759360.237975:0:5802:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9170836cd800: total 0 00000100:00080000:3.0:1782759360.237979:0:5802:0:(import.c:65:import_set_state_nolock()) ffff9170836cb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759360.238001:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967978 00000020:00010000:0.0:1782759360.238013:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9170836cd800: total 0 00010000:00010000:0.0:1782759360.238018:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759360.238065:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9170836cd800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782759360.238099:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000416:0x1:0x0].0x0 (ffff9171c08f6e00) 00010000:00010000:0.0:1782759360.238103:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759360.238122:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de79a lrc: 0/0,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6690e expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759360.238145:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000416:0x1:0x0].0x0 (ffff9171c08f6e00) 00010000:00010000:0.0:1782759360.238148:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759360.238152:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777de78c lrc: 0/0,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66907 expref: 5 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759360.238169:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9170836cd800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1782759360.238179:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759360.238182:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759360.238184:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759360.238420:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd371628-a5bd-41ce-acb3-f5927fa4d9d9+3:2360:x1869355197174016:12345-192.168.204.31@tcp:39:umount.0 Request processed in 501us (716us total) trans 4294967979 rc 0/0 00000100:00100000:3.0:1782759360.238429:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1784 00000100:00100000:1.0:1782759360.245570:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759360.245672:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174272 00000100:00100000:0.0:1782759360.245681:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174272 00000100:00100000:0.0:1782759360.245729:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2491 00000100:00100000:0.0:1782759360.245746:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64639963-9ce8-4d96-947c-ead0c5123d19+7:2360:x1869355197174272:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1782759360.245783:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de74d 00000020:00010000:0.0:1782759360.245789:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917183833000: total 0 00000100:00080000:0.0:1782759360.245794:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917183834000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782759360.245913:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64639963-9ce8-4d96-947c-ead0c5123d19+3:2360:x1869355197174272:12345-192.168.204.31@tcp:251:umount.0 Request processed in 175us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759360.245921:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2491 00000020:00010000:1.0:1782759360.245998:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917183833000: total 0 00010000:00010000:1.0:1782759360.246047:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917183833000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759360.246079:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777de754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf668a5 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759360.246129:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917183833000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782759360.246140:0:5789:0:(genops.c:906:class_export_put()) final put ffff917183833000/64639963-9ce8-4d96-947c-ead0c5123d19 00010000:00010000:1.0:1782759360.246165:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759360.246167:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759360.246169:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759360.246843:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917183833000/64639963-9ce8-4d96-947c-ead0c5123d19 for MGS 00000020:00000080:3.0:1782759360.246892:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917183834000 for MGS 00010000:00010000:1.0:1782759361.131990:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782759361.487135:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000020:00000080:1.0:1782759361.487144:0:6622:0:(genops.c:906:class_export_put()) final put ffff917082d39800/bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000020:00000080:2.0:1782759361.487223:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d39800/bd371628-a5bd-41ce-acb3-f5927fa4d9d9 for lustre-OST0000 00000020:00000080:2.0:1782759361.487276:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d3f800 for lustre-OST0000 00000020:00000080:3.0:1782759361.846291:0:133628:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe098e3e40 20000000:00000080:3.0:1782759361.846307:0:133628:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7778c00 uarg=0000000000000000 10000000:01000000:3.0:1782759361.846704:0:133628:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759361.846724:0:133628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.846739:0:133628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.846747:0:133628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.846781:0:133628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.846800:0:133628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 18 pid: 5793 timeout: 3530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759361.846814:0:133628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:133628:1869355211891584:0@lo:104: 00000100:00100000:3.0:1782759361.846939:0:133628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759361.847031:0:133628:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759361.847073:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891584 00000100:00100000:0.0:1782759361.847088:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891584 00000100:00100000:0.0:1782759361.847146:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1782759361.847159:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:133628:x1869355211891584:12345-0@lo:104: 00010000:00010000:0.0:1782759361.847172:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847220:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759361.847226:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:133628:x1869355211891584:12345-0@lo:104: Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759361.847233:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00010000:00010000:0.0:1782759361.847253:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759361.847258:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847265:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759361.847269:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847277:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759361.847284:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759361.847289:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759361.847313:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847320:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759361.847337:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847352:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777de405 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de40c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847364:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759361.847366:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759361.847368:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759361.847383:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211891712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759361.847410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759361.847437:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891712 00000100:00100000:0.0:1782759361.847441:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891712 00010000:00010000:0.0:1782759361.847456:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 19 pid: 5793 timeout: 3530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759361.847475:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1782759361.847480:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718904f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211891712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759361.847489:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759361.847493:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 19 pid: 5793 timeout: 3530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847502:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 19 pid: 5793 timeout: 3530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847515:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847523:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847543:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847550:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847556:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847563:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847568:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759361.847571:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847578:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847586:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759361.847594:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759361.847619:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718904f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211891712:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759361.847625:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1782759361.847675:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211891712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759361.847738:0:133628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99800/0xdd99f5c4777de40c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777de405 expref: 18 pid: 5793 timeout: 3530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759361.847748:0:133628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:133628:1869355211891584:0@lo:104: 00010000:00010000:3.0:1782759361.847759:0:133628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.847767:0:133628:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.847773:0:133628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759361.847779:0:133628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7a1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1782759361.981184:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000001:00080000:1.0:1782759361.981197:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967979 is committed 00000020:00000080:1.0:1782759361.981201:0:5824:0:(genops.c:906:class_export_put()) final put ffff9170836cd800/bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000020:00000080:0.0:1782759361.981277:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836cd800/bd371628-a5bd-41ce-acb3-f5927fa4d9d9 for lustre-MDT0000 00000020:00000080:0.0:1782759361.981350:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836cb000 for lustre-MDT0000 00000001:00100000:1.0:1782759361.981619:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000020:00000080:1.0:1782759361.981624:0:7507:0:(genops.c:906:class_export_put()) final put ffff917082b44000/bd371628-a5bd-41ce-acb3-f5927fa4d9d9 00000020:00000080:0.0:1782759361.981657:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917082b44000/bd371628-a5bd-41ce-acb3-f5927fa4d9d9 for lustre-OST0001 00000020:00000080:0.0:1782759361.981694:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082b47000 for lustre-OST0001 00010000:00010000:3.0:1782759362.158790:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759362.247535:0:133680:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff85ab4430 20000000:00000080:1.0:1782759362.247552:0:133680:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928e400 uarg=0000000000000000 10000000:01000000:1.0:1782759362.247973:0:133680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759362.247995:0:133680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248012:0:133680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248022:0:133680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248026:0:133680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248031:0:133680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248041:0:133680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248045:0:133680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759362.248049:0:133680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248057:0:133680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248082:0:133680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248091:0:133680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.248097:0:133680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de7a8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759362.476172:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759362.476196:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211891840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759362.476264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759362.476393:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891840 00000100:00100000:2.0:1782759362.476401:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891840 00000100:00080000:1.0:1782759362.476649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759362.476697:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:2.0:1782759362.476707:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211891840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759362.476742:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759362.476800:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211891840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759362.476808:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1782759362.476918:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211891840:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1782759362.989775:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759362.989785:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759362.989792:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759362.989880:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759362.989895:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759362.989909:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759362.989944:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211891968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759362.990037:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759362.990124:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211891968 00000100:00100000:1.0:1782759362.990139:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211891968 00000100:00100000:1.0:1782759362.990205:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1782759362.990216:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211891968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759362.990233:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759362.990251:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777de7af expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759362.990299:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818b0840 going to sleep for 11 seconds 00010000:00010000:1.0:1782759362.990300:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.990319:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759362.990329:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782759362.990407:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211891968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759362.990414:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:0.0:1782759362.990498:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211891968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759362.990521:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759362.990532:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759362.990558:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759362.990565:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759362.990573:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.180046:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759363.560328:0:133827:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0ec545e0 20000000:00000080:3.0:1782759363.560350:0:133827:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c7400 uarg=0000000000000000 10000000:01000000:3.0:1782759363.560655:0:133827:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759363.560671:0:133827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.560685:0:133827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.560694:0:133827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.560733:0:133827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.560748:0:133827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 18 pid: 5794 timeout: 3531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759363.560763:0:133827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:133827:1869355211892096:0@lo:104: 00000100:00100000:3.0:1782759363.560848:0:133827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759363.560883:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759363.560899:0:133827:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaada80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759363.560900:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892096 00000100:00100000:0.0:1782759363.560909:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892096 00000100:00100000:0.0:1782759363.560961:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1782759363.560973:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081256050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:133827:x1869355211892096:12345-0@lo:104: 00010000:00010000:0.0:1782759363.560986:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759363.561067:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759363.561074:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081256050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:133827:x1869355211892096:12345-0@lo:104: Request processed in 104us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759363.561077:0:133827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:133827:1869355211892096:0@lo:104: 00000100:00100000:0.0:1782759363.561088:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00010000:00010000:3.0:1782759363.561102:0:133827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561180:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759363.561188:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561196:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759363.561200:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561213:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759363.561221:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759363.561226:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759363.561259:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561266:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759363.561311:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561319:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777de7af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de7b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561335:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759363.561338:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759363.561339:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782759363.561341:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759363.561353:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211892224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759363.561382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759363.561465:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892224 00000100:00100000:1.0:1782759363.561469:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892224 00010000:00010000:1.0:1782759363.561489:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 19 pid: 5794 timeout: 3531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759363.561516:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1782759363.561523:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211892224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759363.561534:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759363.561540:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 19 pid: 5794 timeout: 3531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561551:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 19 pid: 5794 timeout: 3531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561563:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777de7af expref: 19 pid: 5794 timeout: 3531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561575:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561583:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561606:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561613:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561620:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561627:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561633:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759363.561636:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561644:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561661:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.561670:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759363.561692:0:133827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.561702:0:133827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759363.561715:0:133827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7bd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759363.561756:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211892224:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759363.561764:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1782759363.561813:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211892224:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1782759363.923765:0:133875:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe65787cb0 20000000:00000080:1.0:1782759363.923787:0:133875:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928dc00 uarg=0000000000000000 10000000:01000000:1.0:1782759363.924147:0:133875:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759363.924175:0:133875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924200:0:133875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924214:0:133875:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924222:0:133875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924229:0:133875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924238:0:133875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924244:0:133875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759363.924249:0:133875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924258:0:133875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924273:0:133875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924281:0:133875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759363.924288:0:133875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777de7c4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.203997:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759364.257083:0:133923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6e97f340 20000000:00000080:3.0:1782759364.257100:0:133923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7778400 uarg=0000000000000000 10000000:01000000:3.0:1782759364.257285:0:133923:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759364.257303:0:133923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257319:0:133923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257329:0:133923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257335:0:133923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257342:0:133923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257349:0:133923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257354:0:133923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759364.257358:0:133923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257365:0:133923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257383:0:133923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257391:0:133923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.257397:0:133923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7cb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759364.524084:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759364.524086:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759364.524108:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211892864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759364.524109:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211892480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759364.524113:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211892352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759364.524122:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211892608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759364.524198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759364.524199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759364.524235:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892864 00000100:00100000:0.0:1782759364.524244:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892864 00000100:00100000:3.0:1782759364.524252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759364.524297:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211892736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759364.524299:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759364.524303:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892608 00000100:00100000:0.0:1782759364.524308:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892608 00000100:00100000:1.0:1782759364.524312:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892352 00000100:00100000:3.0:1782759364.524313:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211892992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759364.524319:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892352 00000100:00100000:2.0:1782759364.524339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759364.524351:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:1.0:1782759364.524366:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:0.0:1782759364.524366:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211892864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759364.524378:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:1.0:1782759364.524381:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211892352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759364.524391:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211892608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759364.524406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759364.524438:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211892864:12345-0@lo:400:kworker.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759364.524448:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:1.0:1782759364.524453:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211892352:12345-0@lo:400:kworker.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759364.524455:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211892608:12345-0@lo:400:kworker.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759364.524470:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892480 00000100:00100000:1.0:1782759364.524471:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:3.0:1782759364.524472:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1782759364.524477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759364.524477:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892480 00000100:00100000:3.0:1782759364.524506:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:3.0:1782759364.524516:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211892480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759364.524523:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211892608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759364.524526:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892736 00000100:00100000:0.0:1782759364.524531:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892736 00000100:00080000:1.0:1782759364.524534:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759364.524559:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211892992 00000100:00100000:3.0:1782759364.524561:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211892480:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759364.524564:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211892992 00000100:00080000:1.0:1782759364.524570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759364.524573:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00080000:1.0:1782759364.524578:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759364.524578:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1782759364.524601:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211892736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759364.524603:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211892352:0@lo:400:kworker.0 00000100:00100000:2.0:1782759364.524615:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1782759364.524622:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211892480:0@lo:400:kworker.0 00000100:00100000:2.0:1782759364.524635:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211892992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759364.524637:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211892736:12345-0@lo:400:kworker.0 Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759364.524644:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1782759364.524663:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211892864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759364.524682:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211892736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759364.524703:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211892992:12345-0@lo:400:kworker.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759364.524710:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1782759364.524741:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211892992:0@lo:400:kworker.0 00000020:00000080:2.0:1782759364.594902:0:133971:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd80e40b70 20000000:00000080:2.0:1782759364.594919:0:133971:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30c8000 uarg=0000000000000000 10000000:01000000:2.0:1782759364.595168:0:133971:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759364.595185:0:133971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595198:0:133971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595205:0:133971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595210:0:133971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595214:0:133971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595218:0:133971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595222:0:133971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759364.595225:0:133971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595229:0:133971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595247:0:133971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595252:0:133971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759364.595256:0:133971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777de7d2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 133971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782759364.925408:0:134019:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc4c04390 20000000:00000080:0.0:1782759364.925424:0:134019:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928dc00 uarg=0000000000000000 10000000:01000000:0.0:1782759364.925591:0:134019:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759364.925611:0:134019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925623:0:134019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925630:0:134019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925635:0:134019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925639:0:134019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925643:0:134019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925647:0:134019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759364.925650:0:134019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925655:0:134019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925673:0:134019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925681:0:134019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.925687:0:134019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99800/0xdd99f5c4777de7d9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759364.971892:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759364.971898:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759364.971902:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759364.971945:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.971956:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.971969:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759364.971996:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211893120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759364.972079:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759364.972121:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893120 00000100:00100000:3.0:1782759364.972130:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893120 00000100:00100000:0.0:1782759364.972147:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759364.972192:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:3.0:1782759364.972203:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211893120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759364.972217:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759364.972232:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777de7e0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.972256:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.972268:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759364.972278:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759364.972324:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211893120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759364.972332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:0.0:1782759364.972373:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211893120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759364.972390:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.972400:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759364.972423:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759364.972427:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759364.972432:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759365.035988:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759365.036074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759365.036118:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893248 00000100:00100000:2.0:1782759365.036126:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893248 00000100:00100000:2.0:1782759365.036168:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1782759365.036175:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211893248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759365.036206:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759365.036252:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211893248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759365.036257:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1782759365.036290:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211893248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759365.228980:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759366.252051:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759366.875530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759366.875886:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174400 00000100:00100000:2.0:1782759366.875908:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174400 00000100:00100000:2.0:1782759366.875990:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2495 00000100:00100000:2.0:1782759366.876001:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1869355197174400:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:2.0:1782759366.876099:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 01697319-0183-474b-b73f-4abf62e355d7@192.168.204.31@tcp t0 exp 0000000000000000 cur 3435 last 0 00000020:00000080:2.0:1782759366.876135:0:5794:0:(genops.c:1406:class_connect()) connect: client 01697319-0183-474b-b73f-4abf62e355d7, cookie 0xdd99f5c4777de7ee 00000100:00080000:2.0:1782759366.876191:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917084d24000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759366.876281:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+5:2360:x1869355197174400:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 281us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759366.876310:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2495 00000100:00100000:2.0:1782759366.877954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.878045:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174528 00000100:00100000:3.0:1782759366.878059:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174528 00000100:00100000:3.0:1782759366.878234:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2496 00000100:00100000:3.0:1782759366.878255:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+5:94000:x1869355197174528:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759366.878295:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759366.878320:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777de7f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66923 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759366.878356:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777de7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66923 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759366.878369:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777de7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66923 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759366.878390:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd800, rc 0) 00000100:00100000:3.0:1782759366.878467:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+6:94000:x1869355197174528:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 221us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.878475:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2496 00000100:00100000:1.0:1782759366.882686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759366.882782:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174656 00000100:00100000:2.0:1782759366.882797:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174656 00000100:00100000:2.0:1782759366.882891:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2497 00000100:00100000:2.0:1782759366.882903:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+6:94000:x1869355197174656:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759366.883251:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+6:94000:x1869355197174656:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 350us (576us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759366.883261:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2497 00000100:00100000:0.0:1782759366.885068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.885191:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174784 00000100:00100000:3.0:1782759366.885202:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174784 00000100:00100000:3.0:1782759366.885260:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2498 00000100:00100000:3.0:1782759366.885272:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+6:94000:x1869355197174784:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759366.885290:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759366.885316:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6692a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759366.885356:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6692a expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759366.885369:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6692a expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759366.885394:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759366.885448:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+7:94000:x1869355197174784:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 179us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.885455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2498 00000100:00100000:0.0:1782759366.888107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.888231:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197174912 00000100:00100000:3.0:1782759366.888241:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197174912 00000100:00100000:3.0:1782759366.888287:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2499 00000100:00100000:3.0:1782759366.888358:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01697319-0183-474b-b73f-4abf62e355d7+7:94000:x1869355197174912:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759366.888744:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01697319-0183-474b-b73f-4abf62e355d7+8:94000:x1869355197174912:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 439us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.888753:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2499 00000100:00100000:1.0:1782759366.891228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.891349:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175040 00000100:00100000:3.0:1782759366.891369:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175040 00000100:00100000:3.0:1782759366.891435:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2500 00000100:00100000:3.0:1782759366.891449:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+8:94000:x1869355197175040:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759366.891771:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+8:94000:x1869355197175040:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 325us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.891781:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2500 00000100:00100000:0.0:1782759366.895768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.896021:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175168 00000100:00100000:3.0:1782759366.896033:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175168 00000100:00100000:3.0:1782759366.896115:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2501 00000100:00100000:3.0:1782759366.896127:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01697319-0183-474b-b73f-4abf62e355d7+8:94019:x1869355197175168:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759366.896504:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01697319-0183-474b-b73f-4abf62e355d7+8:94019:x1869355197175168:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 378us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.896525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2501 00000100:00100000:0.0:1782759366.907145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.907237:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175296 00000100:00100000:3.0:1782759366.907249:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175296 00000100:00100000:3.0:1782759366.907315:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2502 00000100:00100000:3.0:1782759366.907327:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+8:94019:x1869355197175296:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759366.907665:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+8:94019:x1869355197175296:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 341us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.907671:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2502 00000100:00100000:1.0:1782759366.911122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759366.911243:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175424 00000100:00100000:2.0:1782759366.911253:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175424 00000100:00100000:2.0:1782759366.911321:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2503 00000100:00100000:2.0:1782759366.911332:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+8:94000:x1869355197175424:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759366.911350:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759366.911367:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66954 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759366.911393:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66954 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759366.911404:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66954 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759366.911412:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64000, rc 0) 00000100:00100000:2.0:1782759366.911465:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+9:94000:x1869355197175424:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759366.911496:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2503 00000100:00100000:0.0:1782759366.913513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.913584:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175552 00000100:00100000:3.0:1782759366.913591:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175552 00000100:00100000:3.0:1782759366.913626:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2504 00000100:00100000:3.0:1782759366.913643:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+9:94000:x1869355197175552:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782759366.913669:0:5793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782759366.913696:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782759366.913701:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782759366.913704:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782759366.913707:0:5793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782759366.915024:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+9:94000:x1869355197175552:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1377us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.915033:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2504 00000100:00100000:1.0:1782759366.917192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759366.917256:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175680 00000100:00100000:2.0:1782759366.917267:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175680 00000100:00100000:2.0:1782759366.917331:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2505 00000100:00100000:2.0:1782759366.917341:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+9:94000:x1869355197175680:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759366.917361:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759366.917387:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777de80a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6695b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759366.917416:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777de80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6695b expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759366.917427:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777de80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6695b expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759366.917436:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64a00, rc 0) 00000100:00100000:2.0:1782759366.917485:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+10:94000:x1869355197175680:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 146us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759366.917493:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2505 00000100:00100000:0.0:1782759366.921666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.921764:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175808 00000100:00100000:3.0:1782759366.921774:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175808 00000100:00100000:3.0:1782759366.921864:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2506 00000100:00100000:3.0:1782759366.921875:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+10:94000:x1869355197175808:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759366.922220:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+10:94000:x1869355197175808:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 347us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.922235:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2506 00000100:00100000:0.0:1782759366.923572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759366.923881:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197175936 00000100:00100000:2.0:1782759366.923890:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197175936 00000100:00100000:2.0:1782759366.923928:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2507 00000100:00100000:2.0:1782759366.923934:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+10:94000:x1869355197175936:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759366.924135:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01697319-0183-474b-b73f-4abf62e355d7+10:94000:x1869355197175936:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 199us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759366.924142:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2507 00000100:00100000:1.0:1782759366.927656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.927911:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176064 00000100:00100000:3.0:1782759366.927919:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176064 00000100:00100000:3.0:1782759366.927967:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2508 00000100:00100000:3.0:1782759366.927988:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+10:94023:x1869355197176064:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759366.928266:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+10:94023:x1869355197176064:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 290us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.928272:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2508 00000100:00100000:0.0:1782759366.933648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.933775:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176192 00000100:00100000:3.0:1782759366.933789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176192 00000100:00100000:3.0:1782759366.934054:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2509 00000100:00100000:3.0:1782759366.934065:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01697319-0183-474b-b73f-4abf62e355d7+10:94023:x1869355197176192:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759366.934354:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01697319-0183-474b-b73f-4abf62e355d7+10:94023:x1869355197176192:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 290us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.934363:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2509 00000100:00100000:0.0:1782759366.936539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759366.936643:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176320 00000100:00100000:1.0:1782759366.936654:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176320 00000100:00100000:1.0:1782759366.936765:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1785 00000100:00100000:1.0:1782759366.936785:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1869355197176320:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759366.936852:0:7487:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3f194d1f-b374-4c82-8e12-63c3c7af011e@192.168.204.31@tcp t0 exp 0000000000000000 cur 3435 last 0 00000020:00000080:1.0:1782759366.936903:0:7487:0:(genops.c:1406:class_connect()) connect: client 3f194d1f-b374-4c82-8e12-63c3c7af011e, cookie 0xdd99f5c4777de811 00000004:00100000:1.0:1782759366.936991:0:7487:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759366.937308:0:7487:0:(import.c:65:import_set_state_nolock()) ffff9171bb693000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759366.937379:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:2360:x1869355197176320:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 594us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759366.937388:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1785 00000100:00100000:1.0:1782759366.939965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.940026:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176576 00000100:00100000:3.0:1782759366.940036:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176576 00000100:00100000:1.0:1782759366.940053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.940103:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176448 00000100:00080000:0.0:1782759366.940108:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759366.940123:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1786 00000100:00100000:1.0:1782759366.940133:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:94000:x1869355197176576:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:3.0:1782759366.940158:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176448 00000004:00000024:1.0:1782759366.940186:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:3.0:1782759366.940200:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1787 00000100:00100000:3.0:1782759366.940209:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:0:x1869355197176448:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782759366.940225:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:1.0:1782759366.940270:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:94000:x1869355197176576:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 137us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759366.940278:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1786 00000100:00100000:3.0:1782759366.940379:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:0:x1869355197176448:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 170us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.940386:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1787 00000100:00100000:0.0:1782759366.942076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759366.942176:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176704 00000100:00100000:1.0:1782759366.942183:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176704 00000100:00100000:1.0:1782759366.942258:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1788 00000100:00100000:1.0:1782759366.942266:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:94000:x1869355197176704:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782759366.942349:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:94000:x1869355197176704:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759366.942356:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1788 00000100:00100000:0.0:1782759366.944142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759366.944191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759366.944376:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197177088 00000100:00100000:1.0:1782759366.944383:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197177088 00000100:00100000:1.0:1782759366.944437:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 231 00000100:00100000:1.0:1782759366.944446:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:94000:x1869355197177088:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782759366.944734:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782759366.944863:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176832 00000100:00100000:3.0:1782759366.944870:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176832 00000100:00100000:0.0:1782759366.944899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759366.944961:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197176960 00000100:00100000:2.0:1782759366.944968:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 915 00000100:00100000:2.0:1782759366.944987:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355197176832:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759366.945016:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3f194d1f-b374-4c82-8e12-63c3c7af011e@192.168.204.31@tcp t0 exp 0000000000000000 cur 3435 last 0 00000020:00000080:2.0:1782759366.945061:0:6597:0:(genops.c:1406:class_connect()) connect: client 3f194d1f-b374-4c82-8e12-63c3c7af011e, cookie 0xdd99f5c4777de818 00000100:00100000:1.0:1782759366.945062:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:94000:x1869355197177088:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 615us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759366.945072:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 231 00002000:00100000:2.0:1782759366.945108:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3f194d1f-b374-4c82-8e12-63c3c7af011e/ffff917084d24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759366.945134:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759366.945319:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759366.945347:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917084d21000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759366.945387:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:2360:x1869355197176832:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 410us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759366.945390:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197176960 00000100:00100000:2.0:1782759366.945399:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 915 00000100:00100000:2.0:1782759366.945417:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 916 00000100:00100000:2.0:1782759366.945422:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355197176960:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759366.945438:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3f194d1f-b374-4c82-8e12-63c3c7af011e@192.168.204.31@tcp t0 exp 0000000000000000 cur 3435 last 0 00000020:00000080:2.0:1782759366.945457:0:6597:0:(genops.c:1406:class_connect()) connect: client 3f194d1f-b374-4c82-8e12-63c3c7af011e, cookie 0xdd99f5c4777de81f 00002000:00100000:2.0:1782759366.945468:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3f194d1f-b374-4c82-8e12-63c3c7af011e/ffff917084d23000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759366.945482:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759366.945593:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782759366.945607:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917084d26000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759366.945638:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:2360:x1869355197176960:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 214us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759366.945646:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 916 00000100:00100000:1.0:1782759367.058053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759367.058119:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197177216 00000100:00100000:2.0:1782759367.058130:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197177216 00000100:00100000:2.0:1782759367.058205:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1789 00000100:00100000:2.0:1782759367.058216:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:94046:x1869355197177216:12345-192.168.204.31@tcp:101:findmnt.0 00010000:00010000:2.0:1782759367.058239:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759367.058262:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777de826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66985 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.058317:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de82d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.058329:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.058342:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759367.058531:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759367.058536:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759367.058650:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.058676:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777de826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66985 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.058693:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de82d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66985 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.058701:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6500) 00010000:00010000:2.0:1782759367.058704:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759367.058707:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65600, rc 0) 00000100:00100000:2.0:1782759367.058761:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:94046:x1869355197177216:12345-192.168.204.31@tcp:101:findmnt.0 Request processed in 547us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759367.058773:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1789 00000100:00100000:0.0:1782759367.068932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759367.069164:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197177344 00000100:00100000:1.0:1782759367.069174:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197177344 00000100:00100000:1.0:1782759367.069224:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1782759367.069235:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:94048:x1869355197177344:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:1.0:1782759367.069388:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:94048:x1869355197177344:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 150us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759367.069397:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1782759367.070767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.070861:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197177600 00000100:00100000:3.0:1782759367.070867:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197177600 00000100:00100000:3.0:1782759367.070907:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1790 00000100:00100000:3.0:1782759367.070918:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:94048:x1869355197177600:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782759367.070965:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759367.071005:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de82d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66985 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.071026:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6500) 00010000:00010000:3.0:1782759367.071038:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759367.071359:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.071372:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.071382:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.071396:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.071403:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.071409:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759367.072456:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782759367.072467:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.072475:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.072481:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.072487:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759367.072491:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.072498:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.072508:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1100) 00010000:00010000:3.0:1782759367.072512:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759367.072515:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.072521:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777de834 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759367.072534:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039ebeaf2 reply state 00000000dd02532c transno 4294967980 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759367.072542:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759367.072619:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f194d1f-b374-4c82-8e12-63c3c7af011e+8:94048:x1869355197177600:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1702us (1853us total) trans 4294967980 rc 0/0 00000100:00100000:3.0:1782759367.072636:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1790 00010000:00010000:3.0:1782759367.074607:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.074622:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.074629:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.074634:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759367.074638:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.074645:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.074658:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff9171908a1400) 00010000:00010000:3.0:1782759367.074661:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759367.074665:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.074670:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de83b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759367.076350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759367.076435:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197177728 00000100:00100000:1.0:1782759367.076444:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197177728 00000100:00100000:1.0:1782759367.076503:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1791 00000100:00100000:1.0:1782759367.076513:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:93516:x1869355197177728:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1782759367.076537:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759367.076559:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777de842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6698c expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.076617:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777de849 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.076630:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777de849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.076660:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777de849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759367.076717:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759367.076721:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759367.076744:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777de849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.076767:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777de842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6698c expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.076781:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777de849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6698c expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.076789:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:1.0:1782759367.076791:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759367.076794:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782759367.076877:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+8:93516:x1869355197177728:12345-192.168.204.31@tcp:101:bash.0 Request processed in 366us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759367.076884:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1791 00000100:00100000:2.0:1782759367.078696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.078810:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197177856 00000100:00100000:3.0:1782759367.078859:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197177856 00000100:00100000:3.0:1782759367.078922:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1792 00000100:00100000:3.0:1782759367.078936:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f194d1f-b374-4c82-8e12-63c3c7af011e+8:93516:x1869355197177856:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1782759367.078959:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759367.079010:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777de850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66993 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079081:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079095:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079108:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079123:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079130:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079137:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079283:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777de865 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079292:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777de865 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079309:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777de865 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759367.079344:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782759367.079348:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759367.079377:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777de865 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079420:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079428:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079435:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079440:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759367.079445:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079453:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079466:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:3.0:1782759367.079476:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759367.079484:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079491:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079506:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079513:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079518:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079530:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759367.079533:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079539:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079547:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff9171908a1700) 00010000:00010000:3.0:1782759367.079549:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759367.079551:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079557:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777de85e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079589:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777de850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66993 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079603:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777de865 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66993 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.079611:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759367.079614:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759367.079616:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc400, rc 0) 00000100:00100000:3.0:1782759367.079681:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3f194d1f-b374-4c82-8e12-63c3c7af011e+9:93516:x1869355197177856:12345-192.168.204.31@tcp:101:bash.0 Request processed in 749us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759367.079689:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1792 00000100:00100000:0.0:1782759367.082626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.082722:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197178112 00000100:00100000:3.0:1782759367.082744:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197178112 00000100:00100000:1.0:1782759367.083121:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1793 00000100:00100000:1.0:1782759367.083135:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+9:93516:x1869355197178112:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1782759367.083160:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759367.083181:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777de86c lrc: 2/0,0 mode: --/CW res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6699a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.083332:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 3/0,1 mode: --/CW res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.083353:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 3/0,1 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.083364:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 3/0,1 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.083393:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,1 mode: --/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.083400:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,1 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.083407:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,1 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759367.084044:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e:0x0], index 0: 0 00010000:00010000:1.0:1782759367.084207:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de881 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084217:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de881 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084224:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de881 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084257:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 3/0,1 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084264:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 2/0,0 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084271:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 3/0,0 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084282:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759367.084287:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 3/0,0 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084295:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 4/0,0 mode: CW/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084308:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:1.0:1782759367.084310:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759367.084314:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 2/0,0 mode: --/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084318:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777de873 lrc: 0/0,0 mode: --/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759367.084328:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f4b66ba reply state 000000003d79dd35 transno 4294967981 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,1 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759367.084335:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759367.084357:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777de86c lrc: 0/0,0 mode: --/CW res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6699a expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084366:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de881 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6699a expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.084371:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:1.0:1782759367.084373:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759367.084375:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782759367.084446:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+12:93516:x1869355197178112:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1314us (1832us total) trans 4294967981 rc 0/0 00000100:00100000:1.0:1782759367.084462:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1793 00010000:00010000:3.0:1782759367.086050:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,1 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.086064:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 2/0,0 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.086071:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,0 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.086076:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759367.086081:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 3/0,0 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.086089:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 4/0,0 mode: PW/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.086107:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0xf3f79968 (ffff9171889c5100) 00010000:00010000:3.0:1782759367.086111:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759367.086114:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 2/0,0 mode: --/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.086119:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777de87a lrc: 0/0,0 mode: --/PW res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759367.088008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759367.088048:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197178240 00000100:00100000:2.0:1782759367.088058:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197178240 00000100:00080000:3.0:1782759367.088089:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759367.088127:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 917 00000100:00100000:2.0:1782759367.088138:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:93516:x1869355197178240:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1782759367.088155:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759367.088173:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ff52db/0xdd99f5c4777de88f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf669a1 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759367.088200:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782759367.088219:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=3435s v=(0 0) 00010000:00010000:2.0:1782759367.088224:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759367.088233:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ff52db/0xdd99f5c4777de88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669a1 expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.088251:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4ff52db/0xdd99f5c4777de88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669a1 expref: 7 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.088263:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64800, rc 0) 00000100:00100000:2.0:1782759367.088319:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:93516:x1869355197178240:12345-192.168.204.31@tcp:101:bash.0 Request processed in 183us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759367.088325:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 917 00000100:00100000:2.0:1782759367.091769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759367.091806:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197178496 00000100:00100000:2.0:1782759367.091816:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197178496 00000100:00100000:2.0:1782759367.091995:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 232 00000100:00100000:2.0:1782759367.092008:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3f194d1f-b374-4c82-8e12-63c3c7af011e+11:93516:x1869355197178496:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:2.0:1782759367.092475:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3f194d1f-b374-4c82-8e12-63c3c7af011e+12:93516:x1869355197178496:12345-192.168.204.31@tcp:35:bash.0 Request processed in 469us (709us total) trans 4294967982 rc 0/0 00000100:00100000:2.0:1782759367.092484:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 232 00000001:00100000:1.0:1782759367.101312:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3f194d1f-b374-4c82-8e12-63c3c7af011e 00000001:00080000:1.0:1782759367.103620:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967981 is committed 00000001:00100000:1.0:1782759367.103633:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3f194d1f-b374-4c82-8e12-63c3c7af011e 00010000:00010000:3.0:1782759367.276023:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759367.444559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.444682:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197178624 00000100:00100000:3.0:1782759367.444747:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197178624 00002000:00100000:3.0:1782759367.444888:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2e:0x0] (0->1) req@ffff917081828700 x1869355197178624/t0(0) o4->3f194d1f-b374-4c82-8e12-63c3c7af011e@192.168.204.31@tcp:528/0 lens 496/0 e 0 to 0 dl 1782759378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759367.444917:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917081828700 with x1869355197178624 ext(0->1) 00002000:00010000:3.0:1782759367.444923:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917081828700 00000100:00100000:3.0:1782759367.445016:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:3.0:1782759367.445027:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+7:2361:x1869355197178624:12345-192.168.204.31@tcp:4:bash.0 00000001:00100000:0.0:1782759367.470596:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3f194d1f-b374-4c82-8e12-63c3c7af011e 00000100:00100000:2.0:1782759367.471178:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+8:2361:x1869355197178624:12345-192.168.204.31@tcp:4:bash.0 Request processed in 26141us (26615us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1782759367.471201:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00002000:00100000:2.0:1782759367.471214:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2e:0x0] (0->1) req@ffff917081828700 x1869355197178624/t4294967394(0) o4->3f194d1f-b374-4c82-8e12-63c3c7af011e@192.168.204.31@tcp:528/0 lens 496/448 e 0 to 0 dl 1782759378 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759367.471224:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917081828700 with x1869355197178624 ext(0->1) 00002000:00010000:2.0:1782759367.471230:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917081828700 00000100:00100000:3.0:1782759367.474273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.474326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759367.474360:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197178752 00000100:00100000:0.0:1782759367.474380:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197178752 00000100:00100000:0.0:1782759367.474435:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197178880 00000100:00100000:0.0:1782759367.474439:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197178880 00000100:00100000:2.0:1782759367.474475:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:3.0:1782759367.474491:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:2.0:1782759367.474491:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01697319-0183-474b-b73f-4abf62e355d7+11:2363:x1869355197178752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782759367.474507:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01697319-0183-474b-b73f-4abf62e355d7+11:2363:x1869355197178880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759367.474511:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759367.474518:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759367.474534:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777de80a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6695b expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.474534:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777de7fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6692a expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.474566:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759367.474566:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759367.474631:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01697319-0183-474b-b73f-4abf62e355d7+9:2363:x1869355197178880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759367.474632:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01697319-0183-474b-b73f-4abf62e355d7+9:2363:x1869355197178752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 145us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759367.474647:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 166 00000100:00100000:2.0:1782759367.474654:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 165 00000100:00100000:3.0:1782759367.475021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759367.475188:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197179008 00000100:00100000:1.0:1782759367.475193:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197179008 00000100:00100000:1.0:1782759367.475268:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:1.0:1782759367.475276:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:01697319-0183-474b-b73f-4abf62e355d7+8:2361:x1869355197179008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759367.475293:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759367.475309:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66954 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.475319:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759367.475353:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:01697319-0183-474b-b73f-4abf62e355d7+7:2361:x1869355197179008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759367.475360:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 167 00000100:00100000:1.0:1782759367.476047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.476167:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197179136 00000100:00100000:3.0:1782759367.476172:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197179136 00000100:00100000:3.0:1782759367.476222:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 918 00000100:00100000:3.0:1782759367.476232:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3f194d1f-b374-4c82-8e12-63c3c7af011e+5:2360:x1869355197179136:12345-192.168.204.31@tcp:9:umount.0 00000100:00080000:0.0:1782759367.476233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1782759367.476259:0:126932:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de81f 00000100:00080000:3.0:1782759367.476267:0:126932:0:(import.c:65:import_set_state_nolock()) ffff917084d26000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1782759367.476288:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1782759367.476304:0:126932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967385 00000100:00100000:3.0:1782759367.476726:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3f194d1f-b374-4c82-8e12-63c3c7af011e+2:2360:x1869355197179136:12345-192.168.204.31@tcp:9:umount.0 Request processed in 496us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759367.476734:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 918 00000100:00100000:3.0:1782759367.479908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759367.480151:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197179392 00000100:00100000:2.0:1782759367.480162:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197179392 00000100:00100000:2.0:1782759367.480234:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 919 00000100:00100000:2.0:1782759367.480245:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+8:2360:x1869355197179392:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1782759367.480304:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de818 00000020:00010000:2.0:1782759367.480314:0:6597:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917084d24800: total 0 00000100:00080000:2.0:1782759367.480319:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917084d21000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759367.480365:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967394 00000100:00100000:2.0:1782759367.480624:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3f194d1f-b374-4c82-8e12-63c3c7af011e+6:2360:x1869355197179392:12345-192.168.204.31@tcp:9:umount.0 Request processed in 380us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759367.480633:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 919 00000020:00010000:3.0:1782759367.480699:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917084d24800: total 0 00010000:00010000:3.0:1782759367.480734:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917084d24800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1782759367.480765:0:7496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1782759367.480769:0:7496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb mtime from disk: 0 -> 1782759366 00002000:00010000:3.0:1782759367.480771:0:7496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb ctime from disk: 0 -> 1782759366 00010000:00010000:3.0:1782759367.480795:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ff52db/0xdd99f5c4777de88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669a1 expref: 5 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.480841:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917084d24800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759367.480854:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.480857:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.480858:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759367.485059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759367.485129:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197179904 00000100:00100000:1.0:1782759367.485138:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197179904 00000100:00100000:0.0:1782759367.485268:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:0.0:1782759367.485283:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f194d1f-b374-4c82-8e12-63c3c7af011e+9:2360:x1869355197179904:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1782759367.485318:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de811 00000020:00010000:0.0:1782759367.485327:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9171bb692800: total 0 00000100:00080000:0.0:1782759367.485331:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9171bb693000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759367.485356:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967982 00000020:00010000:3.0:1782759367.485367:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9171bb692800: total 0 00010000:00010000:3.0:1782759367.485373:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.485438:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9171bb692800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1782759367.485478:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:3.0:1782759367.485482:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759367.485491:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777de849 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6698c expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.485516:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:3.0:1782759367.485519:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759367.485524:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de881 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6699a expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.485562:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759367.485565:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759367.485570:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777de865 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66993 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.485587:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9171bb692800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1782759367.485602:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.485604:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.485606:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759367.486040:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f194d1f-b374-4c82-8e12-63c3c7af011e+4:2360:x1869355197179904:12345-192.168.204.31@tcp:39:umount.0 Request processed in 761us (990us total) trans 4294967983 rc 0/0 00000100:00100000:0.0:1782759367.486050:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:1.0:1782759367.493607:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759367.493770:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180160 00000100:00100000:3.0:1782759367.493780:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180160 00000100:00100000:3.0:1782759367.493868:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2510 00000100:00100000:3.0:1782759367.493880:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+7:2360:x1869355197180160:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782759367.493920:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de7ee 00000020:00010000:3.0:1782759367.493928:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917084d26800: total 0 00000100:00080000:3.0:1782759367.493932:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917084d24000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782759367.494105:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01697319-0183-474b-b73f-4abf62e355d7+3:2360:x1869355197180160:12345-192.168.204.31@tcp:251:umount.0 Request processed in 227us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759367.494117:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2510 00000020:00010000:1.0:1782759367.494175:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917084d26800: total 0 00010000:00010000:1.0:1782759367.494231:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917084d26800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759367.494264:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777de7f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66923 expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759367.494298:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917084d26800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782759367.494310:0:5788:0:(genops.c:906:class_export_put()) final put ffff917084d26800/01697319-0183-474b-b73f-4abf62e355d7 00010000:00010000:1.0:1782759367.494330:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759367.494332:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759367.494334:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759367.494380:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d26800/01697319-0183-474b-b73f-4abf62e355d7 for MGS 00000020:00000080:2.0:1782759367.494423:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d24000 for MGS 00000100:00100000:0.0:1782759367.596998:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211893376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759367.597062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759367.597162:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893376 00000100:00100000:2.0:1782759367.597170:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893376 00000100:00100000:2.0:1782759367.597220:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1782759367.597228:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211893376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759367.597247:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42401792 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782759367.597801:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759367.600243:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211893376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759367.601802:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211893376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4571us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759367.601814:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000020:00000080:2.0:1782759367.873240:0:134316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfee1bdb0 20000000:00000080:2.0:1782759367.873255:0:134316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30d8c00 uarg=0000000000000000 10000000:01000000:2.0:1782759367.873625:0:134316:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759367.873642:0:134316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.873659:0:134316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.873668:0:134316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.873711:0:134316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.873723:0:134316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 18 pid: 5796 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759367.873736:0:134316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:134316:1869355211893504:0@lo:104: 00000100:00100000:2.0:1782759367.873794:0:134316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759367.873896:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893504 00000100:00100000:1.0:1782759367.873905:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893504 00000100:00100000:1.0:1782759367.873951:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1782759367.873973:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:134316:x1869355211893504:12345-0@lo:104: 00010000:00010000:1.0:1782759367.873985:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759367.874008:0:134316:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa0230c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782759367.874039:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759367.874046:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:134316:x1869355211893504:12345-0@lo:104: Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759367.874054:0:134316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:134316:1869355211893504:0@lo:104: 00000100:00100000:1.0:1782759367.874055:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00010000:00010000:2.0:1782759367.874078:0:134316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874131:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759367.874138:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874145:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759367.874148:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874166:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759367.874173:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759367.874178:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759367.874205:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874211:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759367.874230:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874237:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de7e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de7e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759367.874252:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211893632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759367.874253:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.874257:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759367.874260:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759367.874291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759367.874324:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893632 00000100:00100000:3.0:1782759367.874329:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893632 00010000:00010000:3.0:1782759367.874347:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 19 pid: 5796 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759367.874376:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1782759367.874383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211893632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759367.874393:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759367.874397:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 19 pid: 5796 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874412:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 19 pid: 5796 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874423:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de7e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777de7e0 expref: 19 pid: 5796 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874434:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874441:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874452:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874459:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874465:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874471:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874476:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759367.874480:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874486:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874516:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759367.874525:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759367.874565:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211893632:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759367.874571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00010000:00010000:2.0:1782759367.874612:0:134316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759367.874630:0:134316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759367.874637:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211893632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759367.874646:0:134316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777de896 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759368.299918:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759369.172462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.172543:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180288 00000100:00100000:2.0:1782759369.172553:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180288 00000100:00100000:2.0:1782759369.172601:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2511 00000100:00100000:2.0:1782759369.172610:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355197180288:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:2.0:1782759369.172637:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a50d6dc1-3383-40db-82b8-0842594d7a3e@192.168.204.31@tcp t0 exp 0000000000000000 cur 3437 last 0 00000020:00000080:2.0:1782759369.172688:0:5796:0:(genops.c:1406:class_connect()) connect: client a50d6dc1-3383-40db-82b8-0842594d7a3e, cookie 0xdd99f5c4777de89d 00000100:00080000:2.0:1782759369.172733:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917183836800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759369.172813:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+5:2360:x1869355197180288:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 203us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.172819:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2511 00000100:00100000:2.0:1782759369.174886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.174979:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180416 00000100:00100000:3.0:1782759369.174987:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180416 00000100:00100000:3.0:1782759369.175034:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2512 00000100:00100000:3.0:1782759369.175043:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+5:94157:x1869355197180416:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759369.175059:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759369.175075:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de8a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf669b6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.175103:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669b6 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.175115:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669b6 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.175124:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759369.175184:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+6:94157:x1869355197180416:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.175191:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2512 00000100:00100000:1.0:1782759369.178259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.178328:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180544 00000100:00100000:2.0:1782759369.178336:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180544 00000100:00100000:2.0:1782759369.178387:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2513 00000100:00100000:2.0:1782759369.178397:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+6:94157:x1869355197180544:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759369.178708:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+6:94157:x1869355197180544:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 312us (456us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759369.178716:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2513 00000100:00100000:0.0:1782759369.180610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.180671:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180672 00000100:00100000:3.0:1782759369.180700:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180672 00000100:00100000:3.0:1782759369.180769:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2514 00000100:00100000:3.0:1782759369.180780:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+6:94157:x1869355197180672:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759369.180799:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759369.180846:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777de8ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf669bd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.180882:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777de8ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669bd expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.180893:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777de8ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669bd expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.180903:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc400, rc 0) 00000100:00100000:3.0:1782759369.180987:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+7:94157:x1869355197180672:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 208us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.180993:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2514 00000100:00100000:3.0:1782759369.182359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.182469:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180800 00000100:00100000:2.0:1782759369.182476:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180800 00000100:00100000:2.0:1782759369.182515:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2515 00000100:00100000:2.0:1782759369.182523:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+7:94157:x1869355197180800:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759369.182894:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94157:x1869355197180800:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 370us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.182902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2515 00000100:00100000:2.0:1782759369.186387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.186487:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197180928 00000100:00100000:1.0:1782759369.186502:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197180928 00000100:00100000:1.0:1782759369.186575:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2516 00000100:00100000:1.0:1782759369.186587:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94157:x1869355197180928:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759369.186944:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94157:x1869355197180928:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 348us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.186963:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2516 00000100:00100000:0.0:1782759369.188786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.188859:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181056 00000100:00100000:3.0:1782759369.188870:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181056 00000100:00100000:3.0:1782759369.188989:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2517 00000100:00100000:3.0:1782759369.189000:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94176:x1869355197181056:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759369.189279:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94176:x1869355197181056:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 280us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.189287:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2517 00000100:00100000:3.0:1782759369.200024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.200157:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181184 00000100:00100000:1.0:1782759369.200175:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181184 00000100:00100000:1.0:1782759369.200273:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2518 00000100:00100000:1.0:1782759369.200298:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94176:x1869355197181184:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759369.200730:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94176:x1869355197181184:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 446us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.200740:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2518 00000100:00100000:2.0:1782759369.202478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.202527:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181312 00000100:00100000:3.0:1782759369.202585:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181312 00000100:00100000:3.0:1782759369.202641:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2519 00000100:00100000:3.0:1782759369.202651:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:94157:x1869355197181312:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759369.202667:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759369.202684:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777de8b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf669e7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.202711:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777de8b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669e7 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.202723:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777de8b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669e7 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.202734:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759369.202791:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+9:94157:x1869355197181312:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 141us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.202798:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2519 00000100:00100000:0.0:1782759369.204661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.204770:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181440 00000100:00100000:1.0:1782759369.204785:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181440 00000100:00100000:1.0:1782759369.204883:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2520 00000100:00100000:1.0:1782759369.204894:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+9:94157:x1869355197181440:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782759369.204927:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782759369.204967:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782759369.204972:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782759369.204976:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782759369.204978:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782759369.206600:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+9:94157:x1869355197181440:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1702us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.206615:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2520 00000100:00100000:2.0:1782759369.209245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.209316:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181568 00000100:00100000:3.0:1782759369.209330:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181568 00000100:00100000:3.0:1782759369.209390:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2521 00000100:00100000:3.0:1782759369.209403:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+9:94157:x1869355197181568:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759369.209419:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759369.209436:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de8b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf669ee expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.209464:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de8b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669ee expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.209475:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de8b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669ee expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.209497:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759369.209562:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94157:x1869355197181568:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 162us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.209570:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2521 00000100:00100000:0.0:1782759369.210988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.211063:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181696 00000100:00100000:1.0:1782759369.211073:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181696 00000100:00100000:1.0:1782759369.211132:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2522 00000100:00100000:1.0:1782759369.211155:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94157:x1869355197181696:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759369.211534:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94157:x1869355197181696:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 393us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.211546:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2522 00000100:00100000:2.0:1782759369.216540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.216624:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181824 00000100:00100000:3.0:1782759369.216638:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181824 00000100:00100000:3.0:1782759369.216865:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2523 00000100:00100000:3.0:1782759369.216877:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94157:x1869355197181824:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759369.217166:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94157:x1869355197181824:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 292us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.217172:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2523 00000100:00100000:2.0:1782759369.219431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.219532:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197181952 00000100:00100000:1.0:1782759369.219539:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197181952 00000100:00100000:1.0:1782759369.219620:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2524 00000100:00100000:1.0:1782759369.219631:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94180:x1869355197181952:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759369.219887:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94180:x1869355197181952:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 257us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.219894:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2524 00000100:00100000:0.0:1782759369.223084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.223140:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197182080 00000100:00100000:3.0:1782759369.223150:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197182080 00000100:00100000:3.0:1782759369.223205:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2525 00000100:00100000:3.0:1782759369.223214:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94180:x1869355197182080:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759369.223531:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:94180:x1869355197182080:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 317us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.223540:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2525 00000100:00100000:2.0:1782759369.226012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.226122:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197182208 00000100:00100000:3.0:1782759369.226131:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197182208 00000100:00100000:3.0:1782759369.226176:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1795 00000100:00100000:3.0:1782759369.226184:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1869355197182208:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782759369.226212:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from a7b70f26-bb36-4d07-b714-13af3386dd52@192.168.204.31@tcp t0 exp 0000000000000000 cur 3437 last 0 00000020:00000080:3.0:1782759369.226261:0:5802:0:(genops.c:1406:class_connect()) connect: client a7b70f26-bb36-4d07-b714-13af3386dd52, cookie 0xdd99f5c4777de8c0 00000004:00100000:3.0:1782759369.226299:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782759369.226418:0:5802:0:(import.c:65:import_set_state_nolock()) ffff917082d38800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1782759369.226437:0:5802:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de8c0 00000100:00080000:3.0:1782759369.226446:0:5802:0:(import.c:65:import_set_state_nolock()) ffff917082d38800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759369.226473:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967983 00000100:00100000:3.0:1782759369.226591:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+4:2360:x1869355197182208:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 407us (584us total) trans 4294967984 rc -30/-30 00000100:00100000:3.0:1782759369.226599:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1795 00010000:00010000:1.0:1782759369.226637:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759369.250417:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.250560:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197182592 00000100:00100000:1.0:1782759369.250571:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197182592 00000100:00100000:1.0:1782759369.250619:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1796 00000100:00100000:1.0:1782759369.250627:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1869355197182592:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759369.250656:0:7487:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from a7b70f26-bb36-4d07-b714-13af3386dd52@192.168.204.31@tcp t0 exp 0000000000000000 cur 3437 last 0 00000020:00000080:1.0:1782759369.250698:0:7487:0:(genops.c:1406:class_connect()) connect: client a7b70f26-bb36-4d07-b714-13af3386dd52, cookie 0xdd99f5c4777de8c7 00000004:00100000:1.0:1782759369.250713:0:7487:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759369.250864:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917083574800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759369.250947:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7b70f26-bb36-4d07-b714-13af3386dd52+6:2360:x1869355197182592:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 320us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.250955:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1796 00000100:00100000:0.0:1782759369.257590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.257705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.257854:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197182848 00000100:00100000:2.0:1782759369.257865:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197182848 00000100:00100000:3.0:1782759369.257909:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197182720 00000100:00100000:2.0:1782759369.257958:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1797 00000100:00100000:2.0:1782759369.257969:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+6:94157:x1869355197182848:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:3.0:1782759369.257989:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197182720 00000004:00000024:2.0:1782759369.258012:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1782759369.258074:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+7:94157:x1869355197182848:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 108us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.258081:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1797 00000100:00100000:3.0:1782759369.258093:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000100:00100000:3.0:1782759369.258106:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a7b70f26-bb36-4d07-b714-13af3386dd52+6:0:x1869355197182720:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782759369.258121:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000100:00100000:3.0:1782759369.258152:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a7b70f26-bb36-4d07-b714-13af3386dd52+6:0:x1869355197182720:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 50us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.258159:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000100:00080000:1.0:1782759369.258242:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1782759369.259899:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759369.259905:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759369.259909:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759369.259959:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.259988:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.259998:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759369.260023:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211893760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759369.260078:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759369.260139:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893760 00000100:00100000:1.0:1782759369.260145:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893760 00000100:00100000:0.0:1782759369.260147:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189041000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759369.260176:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:1.0:1782759369.260182:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211893760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759369.260197:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759369.260208:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777de8ce expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.260225:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.260233:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.260241:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759369.260277:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211893760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.260281:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1782759369.260784:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211893760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759369.260815:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.260851:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759369.260872:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759369.260941:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.260950:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759369.261085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.261125:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197182976 00000100:00100000:1.0:1782759369.261130:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197182976 00000100:00100000:1.0:1782759369.261171:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1799 00000100:00100000:1.0:1782759369.261177:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7b70f26-bb36-4d07-b714-13af3386dd52+6:94157:x1869355197182976:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782759369.261245:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a7b70f26-bb36-4d07-b714-13af3386dd52+6:94157:x1869355197182976:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 68us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.261252:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1799 00000100:00100000:2.0:1782759369.263564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.263711:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197183360 00000100:00100000:1.0:1782759369.263719:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197183360 00000100:00100000:1.0:1782759369.263759:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:1.0:1782759369.263766:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+6:94157:x1869355197183360:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782759369.264008:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1782759369.264445:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+6:94157:x1869355197183360:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 677us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.264465:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:2.0:1782759369.265814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.265919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.266070:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197183104 00000100:00100000:1.0:1782759369.266078:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197183104 00000100:00100000:1.0:1782759369.266118:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197183232 00000100:00100000:1.0:1782759369.266120:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197183232 00000100:00100000:1.0:1782759369.266145:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 920 00000100:00100000:1.0:1782759369.266152:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355197183104:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759369.266178:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a7b70f26-bb36-4d07-b714-13af3386dd52@192.168.204.31@tcp t0 exp 0000000000000000 cur 3437 last 0 00000020:00000080:1.0:1782759369.266215:0:6598:0:(genops.c:1406:class_connect()) connect: client a7b70f26-bb36-4d07-b714-13af3386dd52, cookie 0xdd99f5c4777de8dc 00002000:00100000:1.0:1782759369.266234:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a7b70f26-bb36-4d07-b714-13af3386dd52/ffff917083572800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759369.266269:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759369.266359:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782759369.266388:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917083576800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759369.266440:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+6:2360:x1869355197183104:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 287us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.266447:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 920 00000100:00100000:1.0:1782759369.266468:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 921 00000100:00100000:1.0:1782759369.266472:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355197183232:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759369.266487:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from a7b70f26-bb36-4d07-b714-13af3386dd52@192.168.204.31@tcp t0 exp 0000000000000000 cur 3437 last 0 00000020:00000080:1.0:1782759369.266505:0:6598:0:(genops.c:1406:class_connect()) connect: client a7b70f26-bb36-4d07-b714-13af3386dd52, cookie 0xdd99f5c4777de8e3 00002000:00100000:1.0:1782759369.266510:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a7b70f26-bb36-4d07-b714-13af3386dd52/ffff917083570800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759369.266524:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759369.266565:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782759369.266595:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917083577800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759369.266620:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+6:2360:x1869355197183232:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 145us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.266627:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 921 00010000:00010000:3.0:1782759369.324192:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759369.360544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.360606:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197183488 00000100:00100000:2.0:1782759369.360615:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197183488 00000100:00100000:2.0:1782759369.360674:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1800 00000100:00100000:2.0:1782759369.360684:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7b70f26-bb36-4d07-b714-13af3386dd52+6:94203:x1869355197183488:12345-192.168.204.31@tcp:101:findmnt.0 00010000:00010000:2.0:1782759369.360704:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759369.360727:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777de8ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.360788:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de8f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.360802:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.360815:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759369.361045:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759369.361049:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759369.361140:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.361166:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777de8ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a26 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.361183:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a26 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.361192:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759369.361195:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759369.361199:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65600, rc 0) 00000100:00100000:2.0:1782759369.361278:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a7b70f26-bb36-4d07-b714-13af3386dd52+7:94203:x1869355197183488:12345-192.168.204.31@tcp:101:findmnt.0 Request processed in 594us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.361286:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1800 00000100:00100000:1.0:1782759369.370172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.370221:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197183616 00000100:00100000:0.0:1782759369.370231:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197183616 00000100:00100000:0.0:1782759369.370290:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1801 00000100:00100000:0.0:1782759369.370300:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+7:94205:x1869355197183616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1782759369.370330:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759369.370350:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de8f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a2d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.370412:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.370426:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.370438:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.370452:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.370460:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.370466:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371088:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777de90d lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371096:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777de90d lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371101:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777de90d lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759369.371161:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759369.371167:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759369.371225:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777de90d lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371234:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371238:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371243:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371246:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759369.371249:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371253:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371262:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:0.0:1782759369.371264:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759369.371266:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371270:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371278:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371282:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371297:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371302:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759369.371305:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371312:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371320:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff917183a70500) 00010000:00010000:0.0:1782759369.371322:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759369.371325:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371331:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de906 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371360:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a2d expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371374:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777de90d lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a2d expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.371381:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759369.371383:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759369.371386:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759369.371438:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+8:94205:x1869355197183616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1140us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.371450:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1801 00000100:00100000:3.0:1782759369.374728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.374881:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197183872 00000100:00100000:2.0:1782759369.374891:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197183872 00000100:00100000:2.0:1782759369.374951:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1802 00000100:00100000:2.0:1782759369.374961:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+8:94205:x1869355197183872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1782759369.374981:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759369.374997:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777de914 lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a34 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375065:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 3/1,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375087:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375097:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375111:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375118:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375124:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375495:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777de929 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375503:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777de929 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375511:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777de929 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759369.375521:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x2:0x0]: returning size 2 00010000:00010000:2.0:1782759369.375548:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375555:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 2/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375562:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375575:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759369.375579:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375587:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 4/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375599:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:2.0:1782759369.375602:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759369.375607:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375613:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777de91b lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375625:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375631:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 2/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375636:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375641:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759369.375643:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375649:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 4/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375676:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0xf3f79968 (ffff9171c08f6200) 00010000:00010000:2.0:1782759369.375682:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759369.375685:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 2/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375691:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777de922 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375731:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777de914 lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a34 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375745:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777de929 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a34 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.375752:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:2.0:1782759369.375754:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759369.375757:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64000, rc 0) 00000100:00100000:2.0:1782759369.375819:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+9:94205:x1869355197183872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 860us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.375850:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1802 00000100:00100000:3.0:1782759369.378789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.378893:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184000 00000100:00100000:2.0:1782759369.378902:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184000 00000100:00100000:2.0:1782759369.378986:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 922 00000100:00100000:2.0:1782759369.378997:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7b70f26-bb36-4d07-b714-13af3386dd52+6:2362:x1869355197184000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1782759369.379015:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1782759369.379016:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759369.379039:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ff3a74/0xdd99f5c4777de937 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a3b expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759369.379081:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 2, mtime: 0x6a42bfc6, atime: 0x0, ctime: 0x6a42bfc6, blocks: 0x1 00010000:00010000:2.0:1782759369.379101:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=3437s v=(0 0) 00010000:00010000:2.0:1782759369.379106:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759369.379116:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ff3a74/0xdd99f5c4777de937 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a3b expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.379139:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7ff3a74/0xdd99f5c4777de937 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a3b expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759369.379151:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64a00, rc 0) 00000100:00100000:2.0:1782759369.379206:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a7b70f26-bb36-4d07-b714-13af3386dd52+7:2362:x1869355197184000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 211us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.379215:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 922 00000100:00100000:1.0:1782759369.381663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.381789:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184128 00000100:00100000:2.0:1782759369.381797:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184128 00002000:00100000:2.0:1782759369.381864:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff917081829f80 x1869355197184128/t0(0) o3->a7b70f26-bb36-4d07-b714-13af3386dd52@192.168.204.31@tcp:530/0 lens 488/0 e 0 to 0 dl 1782759380 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759369.381876:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917081829f80 with x1869355197184128 ext(0->4095) 00002000:00010000:2.0:1782759369.381882:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917081829f80 00000100:00100000:2.0:1782759369.384076:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:2.0:1782759369.384094:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+7:2361:x1869355197184128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1782759369.384314:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+7:2361:x1869355197184128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 224us (2657us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782759369.384338:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00002000:00100000:2.0:1782759369.384348:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff917081829f80 x1869355197184128/t0(0) o3->a7b70f26-bb36-4d07-b714-13af3386dd52@192.168.204.31@tcp:530/0 lens 488/4536 e 0 to 0 dl 1782759380 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759369.384357:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917081829f80 with x1869355197184128 ext(0->4095) 00002000:00010000:2.0:1782759369.384363:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917081829f80 00000100:00100000:0.0:1782759369.388989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.389157:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184384 00000100:00100000:2.0:1782759369.389167:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184384 00000100:00100000:2.0:1782759369.389221:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:2.0:1782759369.389232:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+9:94205:x1869355197184384:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1782759369.389375:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+9:94205:x1869355197184384:12345-192.168.204.31@tcp:35:cat.0 Request processed in 145us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.389383:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:3.0:1782759369.644549:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211893888:0@lo:400:kworker.0 00000100:00100000:2.0:1782759369.644588:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211894272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759369.644638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759369.644640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759369.644737:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211894016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759369.644759:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211894144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759369.646850:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211894400:0@lo:400:kworker.0 00000100:00100000:3.0:1782759369.646903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759369.646986:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211893888 00000100:00100000:3.0:1782759369.646994:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211893888 00000100:00100000:3.0:1782759369.647055:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:3.0:1782759369.647064:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211893888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759369.647119:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211893888:12345-0@lo:400:kworker.0 Request processed in 56us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.647127:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:1.0:1782759369.647167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759369.647179:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211893888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759369.647208:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894400 00000100:00100000:1.0:1782759369.647212:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894400 00000100:00100000:3.0:1782759369.647237:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894272 00000100:00100000:3.0:1782759369.647244:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894272 00000100:00100000:1.0:1782759369.647249:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894144 00000100:00100000:1.0:1782759369.647253:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894144 00000100:00100000:3.0:1782759369.647281:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1782759369.647293:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:3.0:1782759369.647294:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211894272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759369.647306:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211894400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759369.647396:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211894272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759369.647412:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211894400:12345-0@lo:400:kworker.0 Request processed in 109us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.647421:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1782759369.647428:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1782759369.647439:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211894144:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759369.647447:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759369.647470:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759369.647482:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211894144:12345-0@lo:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.647491:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:1.0:1782759369.647499:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211894144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759369.647949:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211894400:0@lo:400:kworker.0 00000100:00100000:3.0:1782759369.648031:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211894272:12345-0@lo:400:kworker.0 Request processed in 52us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.648038:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1782759369.648381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759369.648414:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211894528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759369.648444:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894016 00000100:00100000:0.0:1782759369.648445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759369.648451:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894016 00000100:00100000:2.0:1782759369.648506:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1782759369.648513:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759369.648558:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211894016:12345-0@lo:400:kworker.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.648564:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1782759369.649024:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211894016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759369.649093:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894528 00000100:00100000:1.0:1782759369.649097:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894528 00000100:00100000:1.0:1782759369.649150:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00080000:2.0:1782759369.649151:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759369.649159:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211894528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759369.649206:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211894528:12345-0@lo:400:kworker.0 Request processed in 49us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.649222:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1782759369.649250:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211894528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759369.769710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.769755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.769793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.769869:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184512 00000100:00100000:2.0:1782759369.769880:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184512 00000100:00100000:1.0:1782759369.769893:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184640 00000100:00100000:1.0:1782759369.769906:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184640 00000100:00100000:2.0:1782759369.769978:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184768 00000100:00100000:2.0:1782759369.769984:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184768 00000100:00100000:1.0:1782759369.769993:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 168 00000100:00100000:3.0:1782759369.770013:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 169 00000100:00100000:1.0:1782759369.770018:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a50d6dc1-3383-40db-82b8-0842594d7a3e+12:2362:x1869355197184512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759369.770044:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782759369.770078:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718904fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a50d6dc1-3383-40db-82b8-0842594d7a3e+12:2361:x1869355197184640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759369.770082:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777de8ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669bd expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.770100:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759369.770113:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759369.770122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782759369.770127:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de8b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669ee expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.770147:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759369.770208:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:2362:x1869355197184512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 202us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.770214:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718904fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a50d6dc1-3383-40db-82b8-0842594d7a3e+10:2361:x1869355197184640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 147us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.770225:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 168 00000100:00100000:3.0:1782759369.770240:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 169 00000100:00100000:1.0:1782759369.770266:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 170 00000100:00100000:1.0:1782759369.770289:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a50d6dc1-3383-40db-82b8-0842594d7a3e+8:2363:x1869355197184768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759369.770300:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759369.770314:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777de8b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669e7 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.770328:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759369.770373:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a50d6dc1-3383-40db-82b8-0842594d7a3e+7:2363:x1869355197184768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.770378:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 170 00000100:00100000:2.0:1782759369.770509:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197184896 00000100:00100000:2.0:1782759369.770515:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197184896 00000100:00100000:2.0:1782759369.770564:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 923 00000100:00080000:1.0:1782759369.770565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759369.770581:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+6:2360:x1869355197184896:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1782759369.770610:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de8e3 00000100:00080000:2.0:1782759369.770619:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917083577800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759369.770679:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967385 00000100:00100000:2.0:1782759369.770898:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a7b70f26-bb36-4d07-b714-13af3386dd52+3:2360:x1869355197184896:12345-192.168.204.31@tcp:9:umount.0 Request processed in 318us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.770907:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 923 00010000:00010000:0.0:1782759369.771140:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759369.773226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.773278:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197185152 00000100:00100000:3.0:1782759369.773298:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197185152 00000100:00100000:3.0:1782759369.773353:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 924 00000100:00100000:3.0:1782759369.773363:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+7:2360:x1869355197185152:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1782759369.773386:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de8dc 00000020:00010000:3.0:1782759369.773393:0:6599:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917083572800: total 0 00000100:00080000:3.0:1782759369.773396:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917083576800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759369.773440:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967394 00000020:00010000:0.0:1782759369.773459:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917083572800: total 0 00010000:00010000:0.0:1782759369.773513:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917083572800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759369.773574:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ff3a74/0xdd99f5c4777de937 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a3b expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.773601:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917083572800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759369.773615:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759369.773616:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759369.773619:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759369.773623:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a7b70f26-bb36-4d07-b714-13af3386dd52+3:2360:x1869355197185152:12345-192.168.204.31@tcp:9:umount.0 Request processed in 260us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.773631:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 924 00000100:00100000:3.0:1782759369.777206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.777273:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197185664 00000100:00100000:1.0:1782759369.777282:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197185664 00000100:00100000:1.0:1782759369.777415:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1803 00000100:00100000:1.0:1782759369.777426:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a7b70f26-bb36-4d07-b714-13af3386dd52+9:2360:x1869355197185664:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1782759369.777459:0:19544:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de8c7 00000020:00010000:1.0:1782759369.777465:0:19544:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917083571000: total 0 00000100:00080000:1.0:1782759369.777470:0:19544:0:(import.c:65:import_set_state_nolock()) ffff917083574800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759369.777497:0:19544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967984 00000020:00010000:3.0:1782759369.777551:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917083571000: total 0 00010000:00010000:3.0:1782759369.777556:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759369.777644:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917083571000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1782759369.777696:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:3.0:1782759369.777700:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:1.0:1782759369.777706:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a7b70f26-bb36-4d07-b714-13af3386dd52+8:2360:x1869355197185664:12345-192.168.204.31@tcp:39:umount.0 Request processed in 280us (505us total) trans 4294967985 rc 0/0 00010000:00010000:3.0:1782759369.777709:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777de90d lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a2d expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759369.777719:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1803 00010000:00010000:3.0:1782759369.777750:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:3.0:1782759369.777753:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759369.777758:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777de8f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a26 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.777774:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:3.0:1782759369.777777:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759369.777781:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777de929 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a34 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.777806:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917083571000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1782759369.777839:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759369.777841:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759369.777842:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759369.785586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.785698:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197185920 00000100:00100000:3.0:1782759369.785709:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197185920 00000100:00100000:3.0:1782759369.785758:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2528 00000100:00100000:3.0:1782759369.785767:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+7:2360:x1869355197185920:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782759369.785802:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de89d 00000020:00010000:3.0:1782759369.785808:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917183834000: total 0 00000100:00080000:3.0:1782759369.785812:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917183836800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1782759369.785851:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917183834000: total 0 00010000:00010000:0.0:1782759369.785903:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917183834000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759369.785950:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777de8a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf669b6 expref: 3 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759369.785973:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a50d6dc1-3383-40db-82b8-0842594d7a3e+3:2360:x1869355197185920:12345-192.168.204.31@tcp:251:umount.0 Request processed in 204us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.785988:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2528 00010000:00010000:0.0:1782759369.785993:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917183834000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782759369.786010:0:5789:0:(genops.c:906:class_export_put()) final put ffff917183834000/a50d6dc1-3383-40db-82b8-0842594d7a3e 00010000:00010000:0.0:1782759369.786031:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759369.786033:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759369.786036:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759369.786070:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917183834000/a50d6dc1-3383-40db-82b8-0842594d7a3e for MGS 00000020:00000080:2.0:1782759369.786113:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917183836800 for MGS 00000100:00100000:0.0:1782759369.896576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.896675:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186048 00000100:00100000:1.0:1782759369.896686:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186048 00000100:00100000:1.0:1782759369.896731:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2529 00000100:00100000:1.0:1782759369.896751:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1869355197186048:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782759369.896781:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0cdac69a-0dcb-4fea-ac81-86836ccb2625@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:1.0:1782759369.896815:0:5794:0:(genops.c:1406:class_connect()) connect: client 0cdac69a-0dcb-4fea-ac81-86836ccb2625, cookie 0xdd99f5c4777de93e 00000100:00080000:1.0:1782759369.896889:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917083575000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759369.896969:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+5:2360:x1869355197186048:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 228us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.896975:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2529 00000100:00100000:1.0:1782759369.898554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.899583:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186176 00000100:00100000:3.0:1782759369.899593:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186176 00000100:00100000:3.0:1782759369.899646:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2530 00000100:00100000:3.0:1782759369.899657:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cdac69a-0dcb-4fea-ac81-86836ccb2625+5:94242:x1869355197186176:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759369.899673:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759369.899691:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a50 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.899720:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a50 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.899732:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a50 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759369.899766:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759369.899968:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cdac69a-0dcb-4fea-ac81-86836ccb2625+6:94242:x1869355197186176:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 313us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.899973:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2530 00000100:00100000:2.0:1782759369.902544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.902672:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186304 00000100:00100000:1.0:1782759369.902680:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186304 00000100:00100000:1.0:1782759369.902748:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2531 00000100:00100000:1.0:1782759369.902756:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+6:94242:x1869355197186304:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759369.903105:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+6:94242:x1869355197186304:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 348us (564us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759369.903119:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2531 00000100:00100000:0.0:1782759369.905588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.905736:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186432 00000100:00100000:3.0:1782759369.905746:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186432 00000100:00100000:0.0:1782759369.905944:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2532 00000100:00100000:0.0:1782759369.905959:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+6:94242:x1869355197186432:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759369.905975:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759369.905994:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98a00/0xdd99f5c4777de94c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a57 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.906022:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98a00/0xdd99f5c4777de94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a57 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.906032:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98a00/0xdd99f5c4777de94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a57 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759369.906040:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98a00, rc 0) 00000100:00100000:0.0:1782759369.906092:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+7:94242:x1869355197186432:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 139us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.906100:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2532 00000100:00100000:3.0:1782759369.908245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.908373:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186560 00000100:00100000:1.0:1782759369.908391:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186560 00000100:00100000:1.0:1782759369.908444:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2533 00000100:00100000:1.0:1782759369.908453:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+7:94242:x1869355197186560:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759369.908745:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94242:x1869355197186560:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 292us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.908754:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2533 00000100:00100000:2.0:1782759369.909980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.910065:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186688 00000100:00100000:3.0:1782759369.910072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186688 00000100:00100000:3.0:1782759369.910117:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2534 00000100:00100000:3.0:1782759369.910126:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94242:x1869355197186688:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759369.910303:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94242:x1869355197186688:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 178us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.910311:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2534 00000100:00100000:2.0:1782759369.911950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.912110:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186816 00000100:00100000:1.0:1782759369.912117:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186816 00000100:00100000:1.0:1782759369.912164:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2535 00000100:00100000:1.0:1782759369.912174:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94261:x1869355197186816:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759369.912410:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94261:x1869355197186816:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 237us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.912424:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2535 00000100:00100000:1.0:1782759369.919742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.919914:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197186944 00000100:00100000:0.0:1782759369.919936:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197186944 00000100:00100000:0.0:1782759369.919988:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2536 00000100:00100000:0.0:1782759369.919999:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94261:x1869355197186944:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759369.920287:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94261:x1869355197186944:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 290us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.920295:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2536 00000100:00100000:2.0:1782759369.923803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.923883:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187072 00000100:00100000:1.0:1782759369.923892:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187072 00000100:00100000:1.0:1782759369.923963:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2537 00000100:00100000:1.0:1782759369.923974:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:94242:x1869355197187072:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759369.923991:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759369.924008:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a81 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.924035:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a81 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.924061:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a81 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.924071:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759369.924134:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+9:94242:x1869355197187072:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.924141:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2537 00000100:00100000:2.0:1782759369.926315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.926451:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187200 00000100:00100000:0.0:1782759369.926459:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187200 00000100:00100000:0.0:1782759369.926543:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2538 00000100:00100000:0.0:1782759369.926553:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+9:94242:x1869355197187200:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782759369.926590:0:5793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782759369.926616:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782759369.926620:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782759369.926624:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782759369.926626:0:5793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782759369.928136:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+9:94242:x1869355197187200:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1577us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.928152:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2538 00000100:00100000:2.0:1782759369.932281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.932389:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187328 00000100:00100000:1.0:1782759369.932398:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187328 00000100:00100000:1.0:1782759369.932453:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2539 00000100:00100000:1.0:1782759369.932463:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+9:94242:x1869355197187328:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759369.932479:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759369.932494:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777de95a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66a88 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.932523:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777de95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a88 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.932531:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777de95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a88 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759369.932538:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782759369.932596:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94242:x1869355197187328:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.932603:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2539 00000100:00100000:2.0:1782759369.933964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.934053:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187456 00000100:00100000:0.0:1782759369.934061:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187456 00000100:00100000:0.0:1782759369.934104:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2540 00000100:00100000:0.0:1782759369.934114:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94242:x1869355197187456:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759369.934489:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94242:x1869355197187456:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 376us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.934497:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2540 00000100:00100000:3.0:1782759369.936961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.937056:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187584 00000100:00100000:1.0:1782759369.937075:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187584 00000100:00100000:1.0:1782759369.937138:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2541 00000100:00100000:1.0:1782759369.937148:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94242:x1869355197187584:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759369.937369:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94242:x1869355197187584:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 221us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.937383:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2541 00000100:00100000:2.0:1782759369.939117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.939380:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187712 00000100:00100000:0.0:1782759369.939391:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187712 00000100:00100000:0.0:1782759369.939435:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2542 00000100:00100000:0.0:1782759369.939445:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94265:x1869355197187712:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759369.939647:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94265:x1869355197187712:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 203us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.939655:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2542 00000100:00100000:2.0:1782759369.941996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.942094:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187840 00000100:00100000:1.0:1782759369.942102:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187840 00000100:00100000:3.0:1782759369.942173:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2543 00000100:00100000:3.0:1782759369.942184:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94265:x1869355197187840:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759369.942357:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:94265:x1869355197187840:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.942362:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2543 00000100:00100000:3.0:1782759369.944673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.944730:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197187968 00000100:00100000:1.0:1782759369.944749:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197187968 00000100:00100000:1.0:1782759369.944791:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1804 00000100:00100000:1.0:1782759369.944797:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1869355197187968:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759369.944819:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0b87cb72-f86b-4a9a-9327-2f356f4d3092@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:1.0:1782759369.944885:0:5802:0:(genops.c:1406:class_connect()) connect: client 0b87cb72-f86b-4a9a-9327-2f356f4d3092, cookie 0xdd99f5c4777de961 00000004:00100000:1.0:1782759369.944914:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759369.945060:0:5802:0:(import.c:65:import_set_state_nolock()) ffff917083574000 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1782759369.945079:0:5802:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de961 00000100:00080000:1.0:1782759369.945086:0:5802:0:(import.c:65:import_set_state_nolock()) ffff917083574000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759369.945114:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967985 00010000:00010000:0.0:1782759369.945257:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759369.945259:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+4:2360:x1869355197187968:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 452us (583us total) trans 4294967986 rc -30/-30 00000100:00100000:1.0:1782759369.945276:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1804 00000100:00100000:2.0:1782759369.956712:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.956756:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197188352 00000100:00100000:3.0:1782759369.956765:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197188352 00000100:00100000:3.0:1782759369.956801:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1805 00000100:00100000:3.0:1782759369.956808:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1869355197188352:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782759369.956868:0:7487:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0b87cb72-f86b-4a9a-9327-2f356f4d3092@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:3.0:1782759369.956902:0:7487:0:(genops.c:1406:class_connect()) connect: client 0b87cb72-f86b-4a9a-9327-2f356f4d3092, cookie 0xdd99f5c4777de968 00000004:00100000:3.0:1782759369.956914:0:7487:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782759369.957093:0:7487:0:(import.c:65:import_set_state_nolock()) ffff917082d3e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759369.957149:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:2360:x1869355197188352:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 340us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.957154:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1805 00000100:00100000:3.0:1782759369.959150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.959221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.959293:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197188480 00000100:00100000:2.0:1782759369.959304:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197188480 00000100:00100000:1.0:1782759369.959339:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197188608 00000100:00100000:1.0:1782759369.959345:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197188608 00000100:00080000:3.0:1782759369.959378:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759369.959401:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1806 00000100:00100000:2.0:1782759369.959410:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1807 00000100:00100000:1.0:1782759369.959415:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:94242:x1869355197188608:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:2.0:1782759369.959430:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:0:x1869355197188480:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759369.959481:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000004:00000024:1.0:1782759369.959481:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1782759369.959569:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:0:x1869355197188480:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.959576:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:94242:x1869355197188608:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 164us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.959580:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1807 00000100:00100000:1.0:1782759369.959590:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1806 00000100:00100000:1.0:1782759369.960812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759369.960880:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197188736 00000100:00100000:3.0:1782759369.960899:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197188736 00000100:00100000:3.0:1782759369.960969:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1808 00000100:00100000:3.0:1782759369.960976:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:94242:x1869355197188736:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782759369.961082:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:94242:x1869355197188736:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759369.961089:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1808 00000100:00100000:0.0:1782759369.963057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759369.963095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759369.963146:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197188864 00000100:00100000:2.0:1782759369.963160:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197188864 00000100:00100000:2.0:1782759369.963215:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197188992 00000100:00100000:2.0:1782759369.963218:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197188992 00000100:00100000:2.0:1782759369.963250:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 925 00000100:00100000:2.0:1782759369.963259:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355197188864:12345-192.168.204.31@tcp:8:mount.lustre.0 00000100:00100000:0.0:1782759369.963287:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 926 00000100:00100000:0.0:1782759369.963298:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355197188992:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759369.963314:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0b87cb72-f86b-4a9a-9327-2f356f4d3092@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00010000:00080000:0.0:1782759369.963334:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0b87cb72-f86b-4a9a-9327-2f356f4d3092@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:2.0:1782759369.963367:0:6597:0:(genops.c:1406:class_connect()) connect: client 0b87cb72-f86b-4a9a-9327-2f356f4d3092, cookie 0xdd99f5c4777de96f 00000020:00000080:0.0:1782759369.963375:0:6598:0:(genops.c:1406:class_connect()) connect: client 0b87cb72-f86b-4a9a-9327-2f356f4d3092, cookie 0xdd99f5c4777de976 00002000:00100000:2.0:1782759369.963382:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0b87cb72-f86b-4a9a-9327-2f356f4d3092/ffff917084d26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759369.963391:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b87cb72-f86b-4a9a-9327-2f356f4d3092/ffff9170836cd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759369.963396:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1782759369.963406:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782759369.963546:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:2.0:1782759369.963552:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782759369.963576:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9170836cf800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1782759369.963590:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917084d24000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759369.963680:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:2360:x1869355197188864:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 419us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759369.963706:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 925 00000100:00100000:0.0:1782759369.963811:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:2360:x1869355197188992:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 510us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759369.963862:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 926 00000100:00100000:2.0:1782759369.964023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759369.964101:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197189120 00000100:00100000:1.0:1782759369.964107:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197189120 00000100:00100000:1.0:1782759369.964161:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 235 00000100:00100000:1.0:1782759369.964172:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:94242:x1869355197189120:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782759369.964475:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1782759369.964608:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:94242:x1869355197189120:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 437us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759369.964617:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 235 00000100:00100000:1.0:1782759370.069051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.069100:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197189248 00000100:00100000:3.0:1782759370.069111:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197189248 00000100:00100000:3.0:1782759370.069161:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1809 00000100:00100000:3.0:1782759370.069167:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:94288:x1869355197189248:12345-192.168.204.31@tcp:101:findmnt.0 00010000:00010000:3.0:1782759370.069185:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759370.069205:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de97d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ac0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.069265:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de984 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.069287:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.069295:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759370.069447:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782759370.069450:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759370.069533:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.069556:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777de97d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ac0 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.069573:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ac0 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.069579:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759370.069581:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759370.069583:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759370.069636:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:94288:x1869355197189248:12345-192.168.204.31@tcp:101:findmnt.0 Request processed in 469us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.069642:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1809 00000100:00100000:0.0:1782759370.078913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.079054:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197189376 00000100:00100000:1.0:1782759370.079064:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197189376 00000100:00100000:1.0:1782759370.079123:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1810 00000100:00100000:1.0:1782759370.079132:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:94290:x1869355197189376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759370.079155:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759370.079175:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ac7 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079234:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079247:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079272:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079287:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079295:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079302:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079766:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777de9a0 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079776:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777de9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.079784:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777de9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759370.079905:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759370.079909:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759370.080002:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777de9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080016:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080023:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080040:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080047:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759370.080052:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080060:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080076:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1700) 00010000:00010000:1.0:1782759370.080079:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759370.080084:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080091:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777de992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080103:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080109:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080115:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080120:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759370.080123:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080139:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080148:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff9171889c5600) 00010000:00010000:1.0:1782759370.080150:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759370.080153:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080159:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777de999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080191:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777de98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ac7 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080205:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777de9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ac7 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.080213:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759370.080216:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759370.080218:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782759370.080297:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b87cb72-f86b-4a9a-9327-2f356f4d3092+8:94290:x1869355197189376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1165us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.080305:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1810 00000100:00100000:2.0:1782759370.083062:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.083118:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197189632 00000100:00100000:0.0:1782759370.083127:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197189632 00000100:00100000:0.0:1782759370.083178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1811 00000100:00100000:0.0:1782759370.083189:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+8:94290:x1869355197189632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1782759370.083208:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759370.083227:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777de9a7 lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ace expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083302:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 3/1,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083315:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083326:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083341:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083348:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083355:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083698:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de9bc lrc: 3/1,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083708:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de9bc lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083715:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de9bc lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759370.083725:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x2:0x0]: returning size 2 00010000:00010000:0.0:1782759370.083749:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083756:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 2/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083768:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083773:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759370.083777:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083785:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 4/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083796:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171889c5300) 00010000:00010000:0.0:1782759370.083799:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759370.083803:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083809:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777de9ae lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083842:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083849:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083856:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083862:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759370.083865:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083881:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083890:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0xf3f79968 (ffff917183a70500) 00010000:00010000:0.0:1782759370.083893:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759370.083895:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 2/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083902:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777de9b5 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083967:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777de9a7 lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ace expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083982:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de9bc lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ace expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.083990:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759370.083993:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759370.083995:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98400, rc 0) 00000100:00100000:0.0:1782759370.084054:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+9:94290:x1869355197189632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 867us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.084062:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1811 00000100:00100000:3.0:1782759370.086358:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.086418:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197189760 00000100:00100000:1.0:1782759370.086428:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197189760 00000100:00100000:1.0:1782759370.086498:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 927 00000100:00100000:1.0:1782759370.086506:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:2361:x1869355197189760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759370.086547:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782759370.086560:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759370.086576:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777de9ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ad5 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759370.086609:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 2, mtime: 0x6a42bfc6, atime: 0x0, ctime: 0x6a42bfc6, blocks: 0x1 00010000:00010000:1.0:1782759370.086630:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=3438s v=(0 0) 00010000:00010000:1.0:1782759370.086635:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759370.086645:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777de9ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ad5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.086663:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777de9ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ad5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.086677:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782759370.086744:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:2361:x1869355197189760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 237us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.086751:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 927 00000100:00100000:2.0:1782759370.088964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.089011:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197189888 00000100:00100000:1.0:1782759370.089019:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197189888 00002000:00100000:1.0:1782759370.089070:0:55099:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff917082b4c380 x1869355197189888/t0(0) o3->0b87cb72-f86b-4a9a-9327-2f356f4d3092@192.168.204.31@tcp:531/0 lens 488/0 e 0 to 0 dl 1782759381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759370.089081:0:55099:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917082b4c380 with x1869355197189888 ext(0->4095) 00002000:00010000:1.0:1782759370.089088:0:55099:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917082b4c380 00000100:00100000:1.0:1782759370.089120:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:1.0:1782759370.089129:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:2362:x1869355197189888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1782759370.089376:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:2362:x1869355197189888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 246us (430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782759370.089385:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00002000:00100000:1.0:1782759370.089393:0:55099:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff917082b4c380 x1869355197189888/t0(0) o3->0b87cb72-f86b-4a9a-9327-2f356f4d3092@192.168.204.31@tcp:531/0 lens 488/4536 e 0 to 0 dl 1782759381 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759370.089403:0:55099:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917082b4c380 with x1869355197189888 ext(0->4095) 00002000:00010000:1.0:1782759370.089407:0:55099:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917082b4c380 00000100:00100000:2.0:1782759370.091587:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.091665:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197190144 00000100:00100000:0.0:1782759370.091675:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197190144 00000100:00100000:0.0:1782759370.091729:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 236 00000100:00100000:0.0:1782759370.091743:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b87cb72-f86b-4a9a-9327-2f356f4d3092+9:94290:x1869355197190144:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1782759370.091927:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0b87cb72-f86b-4a9a-9327-2f356f4d3092+9:94290:x1869355197190144:12345-192.168.204.31@tcp:35:cat.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.091935:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 236 00000100:00100000:2.0:1782759370.156079:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211894656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759370.156152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759370.156197:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894656 00000100:00100000:3.0:1782759370.156207:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894656 00000100:00100000:3.0:1782759370.156271:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1782759370.156283:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211894656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759370.156317:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759370.156378:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211894656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.156386:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1782759370.156432:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211894656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759370.348091:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759370.425780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.425992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.426019:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.426050:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197190528 00000100:00100000:2.0:1782759370.426060:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197190528 00000100:00100000:1.0:1782759370.426092:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197190272 00000100:00100000:1.0:1782759370.426100:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197190272 00000100:00100000:3.0:1782759370.426108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.426113:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197190400 00000100:00100000:2.0:1782759370.426118:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197190400 00000100:00100000:3.0:1782759370.426135:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197190656 00000100:00100000:1.0:1782759370.426137:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 171 00000100:00100000:3.0:1782759370.426142:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197190656 00000100:00100000:1.0:1782759370.426151:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+12:2363:x1869355197190528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759370.426157:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 172 00000100:00100000:2.0:1782759370.426170:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+12:2361:x1869355197190272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759370.426172:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759370.426181:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782759370.426194:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 928 00010000:00010000:1.0:1782759370.426196:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777de953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a81 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.426198:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98a00/0xdd99f5c4777de94c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a57 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759370.426209:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0b87cb72-f86b-4a9a-9327-2f356f4d3092+6:2360:x1869355197190656:12345-192.168.204.31@tcp:9:umount.0 00010000:00010000:2.0:1782759370.426226:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759370.426226:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1782759370.426239:0:126932:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de976 00000100:00080000:3.0:1782759370.426249:0:126932:0:(import.c:65:import_set_state_nolock()) ffff9170836cf800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782759370.426289:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:2363:x1869355197190528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 138us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759370.426290:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+10:2361:x1869355197190272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000001:00000004:3.0:1782759370.426301:0:126932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967385 00000100:00100000:2.0:1782759370.426309:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 172 00000100:00100000:1.0:1782759370.426317:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 171 00000100:00100000:2.0:1782759370.426335:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 173 00000100:00100000:2.0:1782759370.426345:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+8:2361:x1869355197190400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759370.426355:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1782759370.426372:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759370.426384:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759370.426392:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777de95a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a88 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.426404:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759370.426427:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+7:2361:x1869355197190400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759370.426436:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 173 00000100:00100000:3.0:1782759370.426484:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0b87cb72-f86b-4a9a-9327-2f356f4d3092+3:2360:x1869355197190656:12345-192.168.204.31@tcp:9:umount.0 Request processed in 281us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.426489:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 928 00000100:00100000:2.0:1782759370.429579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.429653:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197190912 00000100:00100000:0.0:1782759370.429678:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197190912 00000100:00100000:0.0:1782759370.429755:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 929 00000100:00100000:0.0:1782759370.429768:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+7:2360:x1869355197190912:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759370.429806:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de96f 00000020:00010000:0.0:1782759370.429818:0:6598:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917084d26800: total 0 00000100:00080000:0.0:1782759370.429845:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917084d24000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759370.429897:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967394 00000020:00010000:1.0:1782759370.429905:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917084d26800: total 0 00010000:00010000:1.0:1782759370.430003:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917084d26800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759370.430080:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9e340f6/0xdd99f5c4777de9ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ad5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.430124:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917084d26800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782759370.430138:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.430140:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.430141:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759370.430164:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b87cb72-f86b-4a9a-9327-2f356f4d3092+3:2360:x1869355197190912:12345-192.168.204.31@tcp:9:umount.0 Request processed in 397us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.430174:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 929 00000100:00100000:1.0:1782759370.433990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.434141:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197191424 00000100:00100000:3.0:1782759370.434152:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197191424 00000100:00100000:3.0:1782759370.434215:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1812 00000100:00100000:3.0:1782759370.434228:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b87cb72-f86b-4a9a-9327-2f356f4d3092+9:2360:x1869355197191424:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1782759370.434263:0:5801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de968 00000020:00010000:3.0:1782759370.434272:0:5801:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917082d3c000: total 0 00000100:00080000:3.0:1782759370.434277:0:5801:0:(import.c:65:import_set_state_nolock()) ffff917082d3e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759370.434300:0:5801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967986 00000020:00010000:1.0:1782759370.434310:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917082d3c000: total 0 00010000:00010000:1.0:1782759370.434315:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.434379:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917082d3c000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1782759370.434413:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff917183a70100) 00010000:00010000:1.0:1782759370.434416:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759370.434424:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777de9bc lrc: 0/0,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ace expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.434454:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759370.434457:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759370.434461:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777de9a0 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ac7 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.434482:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1700) 00010000:00010000:1.0:1782759370.434484:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759370.434488:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777de984 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ac0 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.434502:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917082d3c000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1782759370.434514:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.434516:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.434518:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759370.434539:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b87cb72-f86b-4a9a-9327-2f356f4d3092+4:2360:x1869355197191424:12345-192.168.204.31@tcp:39:umount.0 Request processed in 313us (556us total) trans 4294967987 rc 0/0 00000100:00100000:3.0:1782759370.434548:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1812 00000100:00100000:2.0:1782759370.441948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.442015:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197191680 00000100:00100000:3.0:1782759370.442025:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197191680 00000100:00100000:3.0:1782759370.442088:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2544 00000100:00100000:3.0:1782759370.442099:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+7:2360:x1869355197191680:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782759370.442148:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de93e 00000020:00010000:3.0:1782759370.442159:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917083576000: total 0 00000100:00080000:3.0:1782759370.442164:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917083575000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1782759370.442224:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917083576000: total 0 00000100:00100000:3.0:1782759370.442244:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cdac69a-0dcb-4fea-ac81-86836ccb2625+3:2360:x1869355197191680:12345-192.168.204.31@tcp:251:umount.0 Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.442252:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2544 00010000:00010000:1.0:1782759370.442322:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917083576000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759370.442357:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777de945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66a50 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.442375:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917083576000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782759370.442387:0:5789:0:(genops.c:906:class_export_put()) final put ffff917083576000/0cdac69a-0dcb-4fea-ac81-86836ccb2625 00010000:00010000:1.0:1782759370.442401:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.442403:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.442405:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759370.442440:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917083576000/0cdac69a-0dcb-4fea-ac81-86836ccb2625 for MGS 00000020:00000080:3.0:1782759370.442510:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083575000 for MGS 00000100:00100000:2.0:1782759370.537504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.537706:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197191808 00000100:00100000:3.0:1782759370.537716:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197191808 00000100:00100000:3.0:1782759370.537754:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2545 00000100:00100000:3.0:1782759370.537762:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355197191808:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:3.0:1782759370.537791:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c34f0302-84ba-4f6c-941a-94cd3d91164a@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:3.0:1782759370.537850:0:5796:0:(genops.c:1406:class_connect()) connect: client c34f0302-84ba-4f6c-941a-94cd3d91164a, cookie 0xdd99f5c4777de9d1 00000100:00080000:3.0:1782759370.537895:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917082d39800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759370.537972:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+5:2360:x1869355197191808:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 210us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.537980:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2545 00000100:00100000:2.0:1782759370.539515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.539561:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197191936 00000100:00100000:3.0:1782759370.539586:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197191936 00000100:00100000:3.0:1782759370.539631:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2546 00000100:00100000:3.0:1782759370.539638:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+5:94327:x1869355197191936:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759370.539655:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759370.539674:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777de9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66aea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.539700:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777de9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66aea expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.539709:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777de9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66aea expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.539717:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759370.539761:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+6:94327:x1869355197191936:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 123us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.539765:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2546 00000100:00100000:2.0:1782759370.540814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.540870:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192064 00000100:00100000:3.0:1782759370.540875:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192064 00000100:00100000:3.0:1782759370.540919:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2547 00000100:00100000:3.0:1782759370.540929:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+6:94327:x1869355197192064:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759370.541209:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+6:94327:x1869355197192064:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 280us (397us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759370.541219:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2547 00000100:00100000:2.0:1782759370.542245:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.542973:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192192 00000100:00100000:0.0:1782759370.542984:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192192 00000100:00100000:0.0:1782759370.543047:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2548 00000100:00100000:0.0:1782759370.543057:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+6:94327:x1869355197192192:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759370.543076:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759370.543097:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98000/0xdd99f5c4777de9df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66af1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.543130:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98000/0xdd99f5c4777de9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66af1 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.543143:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98000/0xdd99f5c4777de9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66af1 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759370.543169:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98000, rc 0) 00000100:00100000:0.0:1782759370.543228:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+7:94327:x1869355197192192:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 172us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.543236:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2548 00000100:00100000:2.0:1782759370.544424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.544476:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192320 00000100:00100000:3.0:1782759370.544483:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192320 00000100:00100000:3.0:1782759370.544518:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2549 00000100:00100000:3.0:1782759370.544525:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+7:94327:x1869355197192320:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759370.544873:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94327:x1869355197192320:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 346us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.544881:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2549 00000100:00100000:2.0:1782759370.546181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.546273:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192448 00000100:00100000:0.0:1782759370.546285:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192448 00000100:00100000:0.0:1782759370.546352:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2550 00000100:00100000:0.0:1782759370.546380:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94327:x1869355197192448:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759370.546648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94327:x1869355197192448:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 273us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.546655:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2550 00000100:00100000:2.0:1782759370.548692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.548787:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192576 00000100:00100000:3.0:1782759370.548796:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192576 00000100:00100000:3.0:1782759370.548871:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2551 00000100:00100000:3.0:1782759370.548881:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94345:x1869355197192576:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759370.549206:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94345:x1869355197192576:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 325us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.549215:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2551 00000100:00100000:2.0:1782759370.556934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.557069:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192704 00000100:00100000:0.0:1782759370.557086:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192704 00000100:00100000:0.0:1782759370.557194:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2552 00000100:00100000:0.0:1782759370.557223:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94345:x1869355197192704:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759370.557630:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94345:x1869355197192704:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 412us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.557640:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2552 00000100:00100000:2.0:1782759370.559923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.560048:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192832 00000100:00100000:3.0:1782759370.560059:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192832 00000100:00100000:3.0:1782759370.560115:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2553 00000100:00100000:3.0:1782759370.560126:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:94327:x1869355197192832:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759370.560147:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759370.560170:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777de9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b1b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.560206:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777de9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b1b expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.560219:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777de9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b1b expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.560230:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:3.0:1782759370.560292:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c34f0302-84ba-4f6c-941a-94cd3d91164a+9:94327:x1869355197192832:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 168us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.560314:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2553 00000100:00100000:2.0:1782759370.566449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.566526:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197192960 00000100:00100000:0.0:1782759370.566540:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197192960 00000100:00100000:0.0:1782759370.566613:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2554 00000100:00100000:0.0:1782759370.566626:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+9:94327:x1869355197192960:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782759370.566664:0:5793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782759370.566703:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782759370.566712:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782759370.566716:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782759370.566718:0:5793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782759370.567809:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+9:94327:x1869355197192960:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 1181us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.567871:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2554 00000100:00100000:2.0:1782759370.569546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.569601:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193088 00000100:00100000:1.0:1782759370.569611:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193088 00000100:00100000:1.0:1782759370.569663:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2555 00000100:00100000:1.0:1782759370.569671:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c34f0302-84ba-4f6c-941a-94cd3d91164a+9:94327:x1869355197193088:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759370.569688:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759370.569705:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777de9ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b22 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.569732:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777de9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b22 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.569741:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777de9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b22 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.569749:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782759370.569789:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94327:x1869355197193088:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.569797:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2555 00000100:00100000:2.0:1782759370.570896:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.570975:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193216 00000100:00100000:0.0:1782759370.570989:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193216 00000100:00100000:0.0:1782759370.571024:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2556 00000100:00100000:0.0:1782759370.571032:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94327:x1869355197193216:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759370.571332:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94327:x1869355197193216:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 300us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.571339:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2556 00000100:00100000:2.0:1782759370.572110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.572197:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193344 00000100:00100000:1.0:1782759370.572217:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193344 00000100:00100000:1.0:1782759370.572268:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2557 00000100:00100000:1.0:1782759370.572280:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94327:x1869355197193344:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759370.572523:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94327:x1869355197193344:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 246us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.572532:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2557 00000100:00100000:2.0:1782759370.573895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.573955:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193472 00000100:00100000:0.0:1782759370.573964:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193472 00000100:00100000:0.0:1782759370.574008:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2558 00000100:00100000:0.0:1782759370.574018:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94348:x1869355197193472:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759370.574257:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94348:x1869355197193472:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 240us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.574265:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2558 00000100:00100000:2.0:1782759370.576272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.576350:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193600 00000100:00100000:1.0:1782759370.576362:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193600 00000100:00100000:1.0:1782759370.576409:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2559 00000100:00100000:1.0:1782759370.576418:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94348:x1869355197193600:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759370.576662:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:94348:x1869355197193600:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 241us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.576672:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2559 00000100:00100000:2.0:1782759370.578090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.578151:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193728 00000100:00100000:1.0:1782759370.578158:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193728 00000100:00100000:1.0:1782759370.578204:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1813 00000100:00100000:1.0:1782759370.578211:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2360:x1869355197193728:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759370.578242:0:19544:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bfc64b95-1b47-4b60-bd0b-0edd969e3bf4@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:1.0:1782759370.578284:0:19544:0:(genops.c:1406:class_connect()) connect: client bfc64b95-1b47-4b60-bd0b-0edd969e3bf4, cookie 0xdd99f5c4777de9f4 00000004:00100000:1.0:1782759370.578305:0:19544:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759370.578421:0:19544:0:(import.c:65:import_set_state_nolock()) ffff917083575800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759370.578482:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:2360:x1869355197193728:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 269us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.578489:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1813 00000100:00100000:2.0:1782759370.579714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.579760:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193856 00000100:00100000:0.0:1782759370.579765:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193856 00000100:00100000:2.0:1782759370.579787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.579848:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197193984 00000100:00100000:0.0:1782759370.579850:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197193984 00000100:00080000:1.0:1782759370.579855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759370.579870:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:0.0:1782759370.579877:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:0:x1869355197193856:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:1.0:1782759370.579888:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1815 00000004:00000024:0.0:1782759370.579897:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000100:00100000:1.0:1782759370.579900:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:94327:x1869355197193984:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759370.579952:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000100:00100000:0.0:1782759370.580026:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:0:x1869355197193856:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 147us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.580029:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:94327:x1869355197193984:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.580038:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1815 00000100:00100000:0.0:1782759370.580050:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:0.0:1782759370.580818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.580862:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197194112 00000100:00100000:2.0:1782759370.580873:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197194112 00000100:00100000:2.0:1782759370.580919:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1816 00000100:00100000:2.0:1782759370.580929:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:94327:x1869355197194112:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782759370.580979:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:94327:x1869355197194112:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759370.580985:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1816 00000100:00100000:2.0:1782759370.581807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.581857:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197194240 00000100:00100000:1.0:1782759370.581861:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197194240 00000100:00100000:1.0:1782759370.581883:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 930 00000100:00100000:1.0:1782759370.581888:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355197194240:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759370.581914:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bfc64b95-1b47-4b60-bd0b-0edd969e3bf4@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:1.0:1782759370.581947:0:9120:0:(genops.c:1406:class_connect()) connect: client bfc64b95-1b47-4b60-bd0b-0edd969e3bf4, cookie 0xdd99f5c4777de9fb 00002000:00100000:1.0:1782759370.581955:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfc64b95-1b47-4b60-bd0b-0edd969e3bf4/ffff917083577000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759370.581963:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1782759370.582053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.582093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.582104:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197194368 00000100:00100000:3.0:1782759370.582110:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197194368 00002000:00080000:1.0:1782759370.582132:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1782759370.582144:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 931 00000100:00100000:3.0:1782759370.582151:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2360:x1869355197194368:12345-192.168.204.31@tcp:8:mount.lustre.0 00000100:00100000:2.0:1782759370.582154:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197194496 00000100:00100000:2.0:1782759370.582158:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197194496 00000100:00080000:1.0:1782759370.582163:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917083576000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1782759370.582169:0:126932:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bfc64b95-1b47-4b60-bd0b-0edd969e3bf4@192.168.204.31@tcp t0 exp 0000000000000000 cur 3438 last 0 00000020:00000080:3.0:1782759370.582190:0:126932:0:(genops.c:1406:class_connect()) connect: client bfc64b95-1b47-4b60-bd0b-0edd969e3bf4, cookie 0xdd99f5c4777dea02 00000100:00100000:2.0:1782759370.582191:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 237 00002000:00100000:3.0:1782759370.582197:0:126932:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfc64b95-1b47-4b60-bd0b-0edd969e3bf4/ffff917082d3f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1782759370.582199:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:94327:x1869355197194496:12345-192.168.204.31@tcp:33:mount.lustre.0 00002000:00100000:3.0:1782759370.582204:0:126932:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1782759370.582217:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:2360:x1869355197194240:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 327us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.582223:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 930 00002000:00080000:3.0:1782759370.582302:0:126932:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782759370.582317:0:126932:0:(import.c:65:import_set_state_nolock()) ffff917082d3e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759370.582354:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:2360:x1869355197194368:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 202us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.582360:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 931 00000004:00200000:2.0:1782759370.582372:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782759370.582507:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:94327:x1869355197194496:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 308us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759370.582514:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 237 00000100:00100000:0.0:1782759370.674292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.674346:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197194624 00000100:00100000:3.0:1782759370.674356:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197194624 00000100:00100000:3.0:1782759370.674418:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1817 00000100:00100000:3.0:1782759370.674428:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:94371:x1869355197194624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1782759370.674449:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759370.674471:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dea09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b4c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.674528:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dea10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.674539:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dea10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.674560:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dea10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759370.674714:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782759370.674718:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759370.674810:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dea10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.674873:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dea09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b4c expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.674886:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dea10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b4c expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759370.674893:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759370.674896:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759370.674899:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759370.674971:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:94371:x1869355197194624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 545us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759370.674979:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1817 00000100:00100000:0.0:1782759370.676348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.676404:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197194752 00000100:00100000:1.0:1782759370.676412:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197194752 00000100:00100000:1.0:1782759370.676465:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00100000:1.0:1782759370.676475:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:94371:x1869355197194752:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759370.676490:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759370.676504:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dea17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b53 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.676557:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.676569:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.676579:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.676593:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.676599:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.676606:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677035:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dea2c lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677045:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dea2c lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677052:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dea2c lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759370.677141:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759370.677145:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759370.677216:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dea2c lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677238:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677245:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677252:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677258:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759370.677262:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677270:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677280:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:1.0:1782759370.677283:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759370.677287:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677294:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dea1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677304:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677310:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677317:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677328:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759370.677331:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677338:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677346:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff9171889c5300) 00010000:00010000:1.0:1782759370.677348:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759370.677351:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677357:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dea25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677384:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dea17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b53 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677393:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dea2c lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b53 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.677398:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171889c5600) 00010000:00010000:1.0:1782759370.677399:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759370.677401:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759370.677446:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+8:94371:x1869355197194752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 975us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.677451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00100000:1.0:1782759370.678848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.678934:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195008 00000100:00100000:2.0:1782759370.678942:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195008 00000100:00100000:2.0:1782759370.678994:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1819 00000100:00100000:2.0:1782759370.679004:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+8:94371:x1869355197195008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1782759370.679019:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759370.679034:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dea33 lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b5a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679089:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 3/1,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679100:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679133:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679149:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679156:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679163:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679487:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777dea48 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679496:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777dea48 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679504:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777dea48 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759370.679513:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x2:0x0]: returning size 2 00010000:00010000:2.0:1782759370.679548:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679556:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 2/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679562:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679568:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759370.679578:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679586:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 4/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679597:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171889c5600) 00010000:00010000:2.0:1782759370.679600:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759370.679604:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679611:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64400/0xdd99f5c4777dea3a lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679622:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679629:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 2/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679635:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679641:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759370.679644:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679650:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 4/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679657:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0xf3f79968 (ffff9171c08f6200) 00010000:00010000:2.0:1782759370.679660:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759370.679669:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 2/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679675:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777dea41 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679718:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dea33 lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b5a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679734:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777dea48 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b5a expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.679742:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759370.679744:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759370.679747:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64000, rc 0) 00000100:00100000:2.0:1782759370.679807:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+9:94371:x1869355197195008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 804us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759370.679815:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1819 00000100:00100000:0.0:1782759370.681732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.681783:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195136 00000100:00100000:2.0:1782759370.681792:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195136 00000100:00100000:2.0:1782759370.681879:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 932 00000100:00080000:1.0:1782759370.681890:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759370.681891:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:2363:x1869355197195136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1782759370.681921:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759370.681940:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd1d326/0xdd99f5c4777dea56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b61 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759370.681973:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 2, mtime: 0x6a42bfc6, atime: 0x0, ctime: 0x6a42bfc6, blocks: 0x1 00010000:00010000:2.0:1782759370.681990:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=3439s v=(0 0) 00010000:00010000:2.0:1782759370.682003:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759370.682012:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd1d326/0xdd99f5c4777dea56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b61 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.682030:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edd1d326/0xdd99f5c4777dea56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b61 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.682042:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65600, rc 0) 00000100:00100000:2.0:1782759370.682086:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:2363:x1869355197195136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 198us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759370.682094:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 932 00000100:00100000:0.0:1782759370.683546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.683594:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195264 00000100:00100000:2.0:1782759370.683600:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195264 00002000:00100000:2.0:1782759370.683635:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff9171b7767b80 x1869355197195264/t0(0) o3->bfc64b95-1b47-4b60-bd0b-0edd969e3bf4@192.168.204.31@tcp:531/0 lens 488/0 e 0 to 0 dl 1782759381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759370.683645:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b7767b80 with x1869355197195264 ext(0->4095) 00002000:00010000:2.0:1782759370.683650:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171b7767b80 00000100:00100000:2.0:1782759370.683674:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1782759370.683684:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:2362:x1869355197195264:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1782759370.683864:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:2362:x1869355197195264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 182us (318us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782759370.683871:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00002000:00100000:2.0:1782759370.683877:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff9171b7767b80 x1869355197195264/t0(0) o3->bfc64b95-1b47-4b60-bd0b-0edd969e3bf4@192.168.204.31@tcp:531/0 lens 488/4536 e 0 to 0 dl 1782759381 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759370.683883:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b7767b80 with x1869355197195264 ext(0->4095) 00002000:00010000:2.0:1782759370.683895:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171b7767b80 00000100:00100000:1.0:1782759370.685413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.685472:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195520 00000100:00100000:0.0:1782759370.685480:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195520 00000100:00100000:0.0:1782759370.685522:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 238 00000100:00100000:0.0:1782759370.685530:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+9:94371:x1869355197195520:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1782759370.685628:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+9:94371:x1869355197195520:12345-192.168.204.31@tcp:35:cat.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.685635:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 238 00000100:00100000:0.0:1782759370.979408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.979453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.979490:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195648 00000100:00100000:1.0:1782759370.979502:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195648 00000100:00100000:0.0:1782759370.979515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759370.979536:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195776 00000100:00100000:2.0:1782759370.979543:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195776 00000100:00100000:3.0:1782759370.979561:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197195904 00000100:00100000:1.0:1782759370.979566:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 174 00000100:00100000:3.0:1782759370.979567:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197195904 00000100:00100000:1.0:1782759370.979577:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c34f0302-84ba-4f6c-941a-94cd3d91164a+12:2362:x1869355197195648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759370.979590:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 175 00010000:00010000:1.0:1782759370.979593:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759370.979600:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1782759370.979605:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c34f0302-84ba-4f6c-941a-94cd3d91164a+12:2361:x1869355197195776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759370.979616:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759370.979620:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1782759370.979624:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98000/0xdd99f5c4777de9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66af1 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.979631:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777de9ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b22 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759370.979650:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759370.979651:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759370.979715:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:2361:x1869355197195776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.979716:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c34f0302-84ba-4f6c-941a-94cd3d91164a+10:2362:x1869355197195648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 136us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.979724:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 174 00000100:00100000:2.0:1782759370.979738:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 175 00000100:00100000:1.0:1782759370.979760:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 176 00000100:00100000:1.0:1782759370.979769:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718904dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c34f0302-84ba-4f6c-941a-94cd3d91164a+8:2363:x1869355197195904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759370.979778:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759370.979788:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777de9e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b1b expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.979799:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759370.979814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759370.979861:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718904dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c34f0302-84ba-4f6c-941a-94cd3d91164a+7:2363:x1869355197195904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759370.979868:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 176 00000100:00100000:0.0:1782759370.979909:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197196032 00000100:00100000:0.0:1782759370.979915:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197196032 00000100:00080000:2.0:1782759370.979958:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759370.979971:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 933 00000100:00100000:0.0:1782759370.979982:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:2360:x1869355197196032:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759370.980009:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dea02 00000100:00080000:0.0:1782759370.980027:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082d3e000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1782759370.980050:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1782759370.980058:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967385 00000100:00100000:0.0:1782759370.980228:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+3:2360:x1869355197196032:12345-192.168.204.31@tcp:9:umount.0 Request processed in 249us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.980233:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 933 00000100:00100000:2.0:1782759370.982026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.982103:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197196288 00000100:00100000:3.0:1782759370.982110:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197196288 00000100:00100000:3.0:1782759370.982151:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 934 00000100:00100000:3.0:1782759370.982159:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+7:2360:x1869355197196288:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1782759370.982181:0:126932:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de9fb 00000020:00010000:3.0:1782759370.982187:0:126932:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917083577000: total 0 00000100:00080000:3.0:1782759370.982200:0:126932:0:(import.c:65:import_set_state_nolock()) ffff917083576000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1782759370.982232:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917083577000: total 0 00000001:00000004:3.0:1782759370.982233:0:126932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967394 00010000:00010000:1.0:1782759370.982288:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917083577000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759370.982351:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd1d326/0xdd99f5c4777dea56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b61 expref: 5 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.982374:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917083577000, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1782759370.982386:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+4:2360:x1869355197196288:12345-192.168.204.31@tcp:9:umount.0 Request processed in 226us (363us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759370.982392:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759370.982396:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 934 00010000:00010000:1.0:1782759370.982397:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.982402:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759370.985704:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759370.985749:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197196800 00000100:00100000:3.0:1782759370.985757:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197196800 00000100:00100000:3.0:1782759370.985801:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1820 00000100:00100000:3.0:1782759370.985808:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+9:2360:x1869355197196800:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1782759370.985859:0:5801:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de9f4 00000020:00010000:3.0:1782759370.985871:0:5801:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917083570000: total 0 00000100:00080000:3.0:1782759370.985875:0:5801:0:(import.c:65:import_set_state_nolock()) ffff917083575800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759370.985906:0:5801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967987 00000020:00010000:1.0:1782759370.985926:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917083570000: total 0 00010000:00010000:1.0:1782759370.985932:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.985984:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917083570000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1782759370.986017:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:1.0:1782759370.986021:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759370.986038:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dea10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b4c expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.986069:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:1.0:1782759370.986072:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759370.986077:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777dea48 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b5a expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759370.986092:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfc64b95-1b47-4b60-bd0b-0edd969e3bf4+6:2360:x1869355197196800:12345-192.168.204.31@tcp:39:umount.0 Request processed in 283us (393us total) trans 4294967988 rc 0/0 00000100:00100000:3.0:1782759370.986099:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1820 00010000:00010000:1.0:1782759370.986101:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171889c5600) 00010000:00010000:1.0:1782759370.986106:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759370.986112:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dea2c lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b53 expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.986128:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917083570000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1782759370.986141:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.986144:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.986158:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759370.992127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759370.992191:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197056 00000100:00100000:0.0:1782759370.992199:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197056 00000100:00100000:0.0:1782759370.992263:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2560 00000100:00100000:0.0:1782759370.992273:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+7:2360:x1869355197197056:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1782759370.992320:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777de9d1 00000020:00010000:0.0:1782759370.992327:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917082d3f800: total 0 00000100:00080000:0.0:1782759370.992331:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917082d39800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782759370.992405:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c34f0302-84ba-4f6c-941a-94cd3d91164a+3:2360:x1869355197197056:12345-192.168.204.31@tcp:251:umount.0 Request processed in 134us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759370.992413:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2560 00000020:00010000:1.0:1782759370.992594:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917082d3f800: total 0 00010000:00010000:1.0:1782759370.992649:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917082d3f800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759370.992677:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777de9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66aea expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759370.992693:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917082d3f800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782759370.992701:0:5788:0:(genops.c:906:class_export_put()) final put ffff917082d3f800/c34f0302-84ba-4f6c-941a-94cd3d91164a 00010000:00010000:1.0:1782759370.992723:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.992725:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759370.992727:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759370.992760:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3f800/c34f0302-84ba-4f6c-941a-94cd3d91164a for MGS 00000020:00000080:2.0:1782759370.992796:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d39800 for MGS 00000100:00100000:2.0:1782759371.073472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.073561:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197184 00000100:00100000:1.0:1782759371.073571:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197184 00000100:00100000:1.0:1782759371.073736:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2561 00000100:00100000:1.0:1782759371.073745:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1869355197197184:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782759371.073773:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 247c9e87-b248-41f5-b285-1da82b8890ea@192.168.204.31@tcp t0 exp 0000000000000000 cur 3439 last 0 00000020:00000080:1.0:1782759371.073810:0:5794:0:(genops.c:1406:class_connect()) connect: client 247c9e87-b248-41f5-b285-1da82b8890ea, cookie 0xdd99f5c4777dea5d 00000100:00080000:1.0:1782759371.073907:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917083571800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759371.073977:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+5:2360:x1869355197197184:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 231us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.073985:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2561 00000100:00100000:2.0:1782759371.075694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.077004:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197312 00000100:00100000:0.0:1782759371.077014:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197312 00000100:00100000:0.0:1782759371.077071:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2562 00000100:00100000:0.0:1782759371.077081:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+5:94408:x1869355197197312:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759371.077098:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759371.077116:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99400/0xdd99f5c4777dea64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b76 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.077144:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99400/0xdd99f5c4777dea64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b76 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.077156:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99400/0xdd99f5c4777dea64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b76 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.077182:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99400, rc 0) 00000100:00100000:0.0:1782759371.077239:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+6:94408:x1869355197197312:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 159us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.077247:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2562 00000100:00100000:2.0:1782759371.078668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.078776:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197440 00000100:00100000:1.0:1782759371.078782:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197440 00000100:00100000:1.0:1782759371.078819:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2563 00000100:00100000:1.0:1782759371.078856:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+6:94408:x1869355197197440:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759371.079178:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+6:94408:x1869355197197440:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 323us (512us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759371.079193:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2563 00000100:00100000:2.0:1782759371.080389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.080847:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197568 00000100:00100000:0.0:1782759371.080855:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197568 00000100:00100000:0.0:1782759371.080906:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2564 00000100:00100000:0.0:1782759371.080917:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+6:94408:x1869355197197568:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759371.080931:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759371.080948:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dea6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66b7d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.080972:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dea6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b7d expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.080983:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dea6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b7d expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.080992:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99e00, rc 0) 00000100:00100000:0.0:1782759371.081038:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+7:94408:x1869355197197568:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 125us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.081045:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2564 00000100:00100000:2.0:1782759371.081975:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.082048:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197696 00000100:00100000:1.0:1782759371.082053:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197696 00000100:00100000:1.0:1782759371.082088:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2565 00000100:00100000:1.0:1782759371.082097:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+7:94408:x1869355197197696:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759371.082347:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+8:94408:x1869355197197696:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 250us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.082352:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2565 00000100:00100000:2.0:1782759371.084478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.084546:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197824 00000100:00100000:0.0:1782759371.084554:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197824 00000100:00100000:0.0:1782759371.084596:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2566 00000100:00100000:0.0:1782759371.084606:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+8:94408:x1869355197197824:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759371.084799:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+8:94408:x1869355197197824:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 194us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.084807:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2566 00000100:00100000:2.0:1782759371.087908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.087987:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197197952 00000100:00100000:1.0:1782759371.087995:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197197952 00000100:00100000:1.0:1782759371.088037:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2567 00000100:00100000:1.0:1782759371.088046:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+8:94427:x1869355197197952:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759371.088530:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+8:94427:x1869355197197952:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 483us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.088538:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2567 00000100:00100000:2.0:1782759371.102348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.102423:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198080 00000100:00100000:0.0:1782759371.102433:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198080 00000100:00100000:0.0:1782759371.102499:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2568 00000100:00100000:0.0:1782759371.102511:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+8:94427:x1869355197198080:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759371.102810:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+8:94427:x1869355197198080:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 301us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.102819:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2568 00000100:00100000:2.0:1782759371.107878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.108518:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198208 00000100:00100000:1.0:1782759371.108529:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198208 00000100:00100000:1.0:1782759371.108579:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2569 00000100:00100000:1.0:1782759371.108589:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+8:94408:x1869355197198208:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759371.108607:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759371.108627:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dea72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ba7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.108657:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dea72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ba7 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.108681:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dea72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ba7 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.108690:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759371.108747:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+9:94408:x1869355197198208:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 159us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.108754:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2569 00000100:00100000:2.0:1782759371.110486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.110556:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198336 00000100:00100000:0.0:1782759371.110567:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198336 00000100:00100000:0.0:1782759371.110634:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2570 00000100:00100000:0.0:1782759371.110646:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+9:94408:x1869355197198336:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782759371.110671:0:5793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782759371.110701:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782759371.110706:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782759371.110709:0:5793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782759371.110711:0:5793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782759371.111586:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+9:94408:x1869355197198336:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 932us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.111596:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2570 00000100:00100000:2.0:1782759371.113260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.113355:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198464 00000100:00100000:1.0:1782759371.113368:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198464 00000100:00100000:1.0:1782759371.113421:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2571 00000100:00100000:1.0:1782759371.113431:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+9:94408:x1869355197198464:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759371.113446:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759371.113464:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dea79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66bae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.113494:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dea79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bae expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.113504:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dea79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bae expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.113513:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782759371.113565:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+10:94408:x1869355197198464:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.113572:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2571 00000100:00100000:2.0:1782759371.114380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.114457:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198592 00000100:00100000:0.0:1782759371.114463:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198592 00000100:00100000:0.0:1782759371.114495:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2572 00000100:00100000:0.0:1782759371.114500:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+10:94408:x1869355197198592:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759371.114760:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+10:94408:x1869355197198592:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 258us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.114768:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2572 00000100:00100000:2.0:1782759371.115692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.115745:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198720 00000100:00100000:1.0:1782759371.115758:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198720 00000100:00100000:1.0:1782759371.115808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2573 00000100:00100000:1.0:1782759371.115861:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+10:94408:x1869355197198720:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782759371.116057:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+10:94408:x1869355197198720:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 240us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.116065:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2573 00000100:00100000:2.0:1782759371.117291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.117355:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198848 00000100:00100000:0.0:1782759371.117362:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198848 00000100:00100000:0.0:1782759371.117400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2574 00000100:00100000:0.0:1782759371.117408:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+10:94431:x1869355197198848:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759371.117580:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+10:94431:x1869355197198848:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 171us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.117587:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2574 00000100:00100000:2.0:1782759371.119009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.119087:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197198976 00000100:00100000:1.0:1782759371.119109:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197198976 00000100:00100000:1.0:1782759371.119173:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2575 00000100:00100000:1.0:1782759371.119185:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+10:94431:x1869355197198976:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759371.119470:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247c9e87-b248-41f5-b285-1da82b8890ea+10:94431:x1869355197198976:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.119478:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2575 00000100:00100000:2.0:1782759371.121382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.121507:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197199104 00000100:00100000:1.0:1782759371.121516:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197199104 00000100:00100000:1.0:1782759371.121568:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1821 00000100:00100000:1.0:1782759371.121577:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1869355197199104:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759371.121610:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from dab61a37-fe21-41db-bb18-bddb62944063@192.168.204.31@tcp t0 exp 0000000000000000 cur 3439 last 0 00000020:00000080:1.0:1782759371.121692:0:5802:0:(genops.c:1406:class_connect()) connect: client dab61a37-fe21-41db-bb18-bddb62944063, cookie 0xdd99f5c4777dea80 00000004:00100000:1.0:1782759371.121732:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759371.121955:0:5802:0:(import.c:65:import_set_state_nolock()) ffff917083572000 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1782759371.121982:0:5802:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dea80 00000100:00080000:1.0:1782759371.122586:0:5802:0:(import.c:65:import_set_state_nolock()) ffff917083572000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759371.122628:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967988 00010000:00010000:3.0:1782759371.122814:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759371.122920:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dab61a37-fe21-41db-bb18-bddb62944063+4:2360:x1869355197199104:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1339us (1540us total) trans 4294967989 rc -30/-30 00000100:00100000:1.0:1782759371.122945:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1821 00000100:00100000:2.0:1782759371.143298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.143397:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197199488 00000100:00100000:0.0:1782759371.143406:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197199488 00000100:00100000:0.0:1782759371.143566:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00100000:0.0:1782759371.143580:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1869355197199488:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782759371.143611:0:5803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from dab61a37-fe21-41db-bb18-bddb62944063@192.168.204.31@tcp t0 exp 0000000000000000 cur 3439 last 0 00000020:00000080:0.0:1782759371.143666:0:5803:0:(genops.c:1406:class_connect()) connect: client dab61a37-fe21-41db-bb18-bddb62944063, cookie 0xdd99f5c4777dea87 00000004:00100000:0.0:1782759371.143682:0:5803:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782759371.143800:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9170836c9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759371.143905:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dab61a37-fe21-41db-bb18-bddb62944063+6:2360:x1869355197199488:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 317us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.143914:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00100000:2.0:1782759371.145273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759371.145313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759371.145396:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197199744 00000100:00100000:3.0:1782759371.145404:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197199744 00000100:00100000:1.0:1782759371.145430:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197199616 00000100:00100000:1.0:1782759371.145436:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197199616 00000100:00100000:3.0:1782759371.145469:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1823 00000100:00080000:2.0:1782759371.145470:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759371.145483:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dab61a37-fe21-41db-bb18-bddb62944063+7:94408:x1869355197199744:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:1.0:1782759371.145486:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1824 00000100:00100000:1.0:1782759371.145499:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dab61a37-fe21-41db-bb18-bddb62944063+7:0:x1869355197199616:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782759371.145522:0:5801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000004:00000024:1.0:1782759371.145532:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261385216 avail 2259288064 00000100:00100000:3.0:1782759371.145588:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dab61a37-fe21-41db-bb18-bddb62944063+7:94408:x1869355197199744:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.145588:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dab61a37-fe21-41db-bb18-bddb62944063+7:0:x1869355197199616:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759371.145604:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1823 00000100:00100000:1.0:1782759371.145614:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1824 00000100:00100000:2.0:1782759371.146500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.146543:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197199872 00000100:00100000:0.0:1782759371.146557:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197199872 00000100:00100000:0.0:1782759371.146598:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1825 00000100:00100000:0.0:1782759371.146607:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dab61a37-fe21-41db-bb18-bddb62944063+6:94408:x1869355197199872:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782759371.146675:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dab61a37-fe21-41db-bb18-bddb62944063+6:94408:x1869355197199872:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.146683:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1825 00000100:00100000:2.0:1782759371.148029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759371.148055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.148085:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200000 00000100:00100000:2.0:1782759371.148092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.148093:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200000 00000100:00100000:0.0:1782759371.148137:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200128 00000100:00100000:0.0:1782759371.148142:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200128 00000100:00100000:2.0:1782759371.148159:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 935 00000100:00100000:2.0:1782759371.148168:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355197200000:12345-192.168.204.31@tcp:8:mount.lustre.0 00000100:00100000:0.0:1782759371.148173:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 936 00000100:00100000:0.0:1782759371.148181:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355197200128:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759371.148199:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from dab61a37-fe21-41db-bb18-bddb62944063@192.168.204.31@tcp t0 exp 0000000000000000 cur 3439 last 0 00010000:00080000:0.0:1782759371.148203:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from dab61a37-fe21-41db-bb18-bddb62944063@192.168.204.31@tcp t0 exp 0000000000000000 cur 3439 last 0 00000100:00100000:3.0:1782759371.148234:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200256 00000020:00000080:2.0:1782759371.148239:0:6599:0:(genops.c:1406:class_connect()) connect: client dab61a37-fe21-41db-bb18-bddb62944063, cookie 0xdd99f5c4777dea8e 00000100:00100000:3.0:1782759371.148240:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200256 00000020:00000080:0.0:1782759371.148240:0:6598:0:(genops.c:1406:class_connect()) connect: client dab61a37-fe21-41db-bb18-bddb62944063, cookie 0xdd99f5c4777dea95 00002000:00100000:2.0:1782759371.148252:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dab61a37-fe21-41db-bb18-bddb62944063/ffff917183836800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759371.148268:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dab61a37-fe21-41db-bb18-bddb62944063/ffff9170836ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759371.148277:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1782759371.148287:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782759371.148294:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 239 00000100:00100000:3.0:1782759371.148304:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dab61a37-fe21-41db-bb18-bddb62944063+6:94408:x1869355197200256:12345-192.168.204.31@tcp:33:mount.lustre.0 00002000:00080000:2.0:1782759371.148402:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1782759371.148403:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782759371.148433:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917183835000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1782759371.148441:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9170836ca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759371.148497:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dab61a37-fe21-41db-bb18-bddb62944063+6:2360:x1869355197200000:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 328us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.148500:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dab61a37-fe21-41db-bb18-bddb62944063+6:2360:x1869355197200128:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 315us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759371.148509:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 935 00000004:00200000:3.0:1782759371.148521:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782759371.148523:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 936 00000100:00100000:3.0:1782759371.148697:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dab61a37-fe21-41db-bb18-bddb62944063+6:94408:x1869355197200256:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 395us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759371.148705:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 239 00000100:00100000:2.0:1782759371.247049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.247130:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200384 00000100:00100000:1.0:1782759371.247141:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200384 00000100:00100000:1.0:1782759371.247192:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1826 00000100:00100000:1.0:1782759371.247200:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dab61a37-fe21-41db-bb18-bddb62944063+6:94455:x1869355197200384:12345-192.168.204.31@tcp:101:findmnt.0 00010000:00010000:1.0:1782759371.247221:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759371.247246:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dea9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66be6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.247322:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777deaa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.247333:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777deaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.247341:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777deaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759371.247528:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759371.247536:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759371.247598:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777deaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.247626:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dea9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66be6 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.247644:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777deaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66be6 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.247652:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5600) 00010000:00010000:1.0:1782759371.247655:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759371.247658:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759371.247710:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dab61a37-fe21-41db-bb18-bddb62944063+7:94455:x1869355197200384:12345-192.168.204.31@tcp:101:findmnt.0 Request processed in 510us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.247716:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1826 00000100:00100000:1.0:1782759371.255872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759371.255970:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200512 00000100:00100000:2.0:1782759371.255982:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200512 00000100:00100000:2.0:1782759371.256038:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1827 00000100:00100000:2.0:1782759371.256049:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dab61a37-fe21-41db-bb18-bddb62944063+7:94457:x1869355197200512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1782759371.256069:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759371.256088:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777deaaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66bed expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256148:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256161:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256171:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256184:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256190:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256196:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256569:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777deabf lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256578:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777deabf lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256593:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777deabf lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759371.256678:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759371.256681:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759371.256739:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777deabf lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256748:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256752:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256758:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256761:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759371.256763:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256768:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256784:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5600) 00010000:00010000:2.0:1782759371.256790:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759371.256795:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256800:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65a00/0xdd99f5c4777deab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256889:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256908:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256914:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256918:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759371.256921:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256925:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256936:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff9171c08f6200) 00010000:00010000:2.0:1782759371.256939:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759371.256943:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256948:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65600/0xdd99f5c4777deab8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256972:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64000/0xdd99f5c4777deaaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bed expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256980:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777deabf lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bed expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.256993:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759371.256995:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759371.256996:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64800, rc 0) 00000100:00100000:2.0:1782759371.257059:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dab61a37-fe21-41db-bb18-bddb62944063+8:94457:x1869355197200512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1014us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759371.257064:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1827 00000100:00100000:2.0:1782759371.258695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.258755:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200768 00000100:00100000:0.0:1782759371.258763:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200768 00000100:00100000:0.0:1782759371.258812:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1828 00000100:00100000:0.0:1782759371.258861:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dab61a37-fe21-41db-bb18-bddb62944063+8:94457:x1869355197200768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1782759371.258879:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759371.258910:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777deac6 lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66bf4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.258986:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 3/1,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.258998:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259007:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259020:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259027:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259034:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259376:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deadb lrc: 3/1,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259386:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deadb lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259394:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deadb lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759371.259403:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x2:0x0]: returning size 2 00010000:00010000:0.0:1782759371.259440:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 3/1,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259447:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 2/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259459:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259465:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759371.259468:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 3/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259476:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 4/0,0 mode: CR/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259486:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:0.0:1782759371.259489:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759371.259493:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 2/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259499:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deacd lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259511:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259517:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 2/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259522:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259527:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759371.259530:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259545:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 4/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259554:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0xf3f79968 (ffff917183a70500) 00010000:00010000:0.0:1782759371.259556:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759371.259559:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 2/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259566:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dead4 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0xf3f79968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259605:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777deac6 lrc: 0/0,0 mode: --/CR res: [0x200000417:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bf4 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259626:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deadb lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bf4 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.259633:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff917183a70b00) 00010000:00010000:0.0:1782759371.259636:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759371.259639:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98e00, rc 0) 00000100:00100000:0.0:1782759371.259705:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dab61a37-fe21-41db-bb18-bddb62944063+9:94457:x1869355197200768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 885us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.259713:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1828 00000100:00100000:0.0:1782759371.261714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759371.261775:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197200896 00000100:00100000:3.0:1782759371.261786:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197200896 00000100:00080000:2.0:1782759371.261867:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759371.261878:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 937 00000100:00100000:3.0:1782759371.261890:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dab61a37-fe21-41db-bb18-bddb62944063+6:2362:x1869355197200896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1782759371.261917:0:126932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759371.261936:0:126932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d46c9cc/0xdd99f5c4777deae9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66bfb expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759371.261957:0:126932:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 2, mtime: 0x6a42bfc6, atime: 0x0, ctime: 0x6a42bfc6, blocks: 0x1 00010000:00010000:3.0:1782759371.261973:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=3439s v=(0 0) 00010000:00010000:3.0:1782759371.261977:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759371.261986:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d46c9cc/0xdd99f5c4777deae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bfb expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759371.262001:0:126932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d46c9cc/0xdd99f5c4777deae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bfb expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759371.262012:0:126932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759371.262065:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dab61a37-fe21-41db-bb18-bddb62944063+7:2362:x1869355197200896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 178us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759371.262083:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 937 00000100:00100000:1.0:1782759371.264353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759371.264398:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197201024 00000100:00100000:2.0:1782759371.264405:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197201024 00002000:00100000:2.0:1782759371.264441:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff9170810e1f80 x1869355197201024/t0(0) o3->dab61a37-fe21-41db-bb18-bddb62944063@192.168.204.31@tcp:532/0 lens 488/0 e 0 to 0 dl 1782759382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759371.264450:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9170810e1f80 with x1869355197201024 ext(0->4095) 00002000:00010000:2.0:1782759371.264454:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9170810e1f80 00000100:00100000:2.0:1782759371.264478:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1782759371.264484:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dab61a37-fe21-41db-bb18-bddb62944063+7:2362:x1869355197201024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1782759371.264640:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dab61a37-fe21-41db-bb18-bddb62944063+7:2362:x1869355197201024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 155us (292us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782759371.264645:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00002000:00100000:2.0:1782759371.264651:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff9170810e1f80 x1869355197201024/t0(0) o3->dab61a37-fe21-41db-bb18-bddb62944063@192.168.204.31@tcp:532/0 lens 488/4536 e 0 to 0 dl 1782759382 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759371.264657:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9170810e1f80 with x1869355197201024 ext(0->4095) 00002000:00010000:2.0:1782759371.264660:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9170810e1f80 00000100:00100000:2.0:1782759371.266427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.266495:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197201280 00000100:00100000:0.0:1782759371.266502:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197201280 00000100:00100000:0.0:1782759371.266545:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 240 00000100:00100000:0.0:1782759371.266554:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dab61a37-fe21-41db-bb18-bddb62944063+9:94457:x1869355197201280:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1782759371.266679:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dab61a37-fe21-41db-bb18-bddb62944063+9:94457:x1869355197201280:12345-192.168.204.31@tcp:35:cat.0 Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.266686:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 240 00010000:00010000:1.0:1782759371.372018:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759371.590718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.590740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.590765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759371.590799:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197201408 00000100:00100000:3.0:1782759371.590800:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197201536 00000100:00100000:3.0:1782759371.590811:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197201536 00000100:00100000:2.0:1782759371.590811:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197201408 00000100:00100000:1.0:1782759371.590848:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197201664 00000100:00100000:1.0:1782759371.590853:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197201664 00000100:00100000:3.0:1782759371.590918:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 177 00000100:00100000:1.0:1782759371.590929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 178 00000100:00100000:3.0:1782759371.590933:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:247c9e87-b248-41f5-b285-1da82b8890ea+12:2363:x1869355197201536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759371.590938:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 179 00000100:00100000:1.0:1782759371.590942:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247c9e87-b248-41f5-b285-1da82b8890ea+12:2364:x1869355197201408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759371.590952:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:247c9e87-b248-41f5-b285-1da82b8890ea+12:2361:x1869355197201664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759371.590959:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759371.590960:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759371.590962:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759371.590981:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dea79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bae expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.590983:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777dea72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ba7 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759371.590983:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dea6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b7d expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759371.591015:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759371.591015:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759371.591015:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759371.591068:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:247c9e87-b248-41f5-b285-1da82b8890ea+9:2361:x1869355197201664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.591070:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247c9e87-b248-41f5-b285-1da82b8890ea+9:2364:x1869355197201408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759371.591084:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 179 00000100:00100000:1.0:1782759371.591091:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 178 00000100:00100000:3.0:1782759371.591108:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:247c9e87-b248-41f5-b285-1da82b8890ea+7:2363:x1869355197201536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 179us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759371.591117:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 177 00000100:00100000:0.0:1782759371.591218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.591237:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197201792 00000100:00100000:1.0:1782759371.591242:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197201792 00000100:00100000:1.0:1782759371.591302:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 938 00000100:00100000:1.0:1782759371.591321:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dab61a37-fe21-41db-bb18-bddb62944063+6:2360:x1869355197201792:12345-192.168.204.31@tcp:9:umount.0 00000100:00080000:2.0:1782759371.591322:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1782759371.591349:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dea95 00000100:00080000:1.0:1782759371.591358:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9170836ca800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782759371.591396:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1782759371.591421:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967385 00000100:00100000:1.0:1782759371.591603:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dab61a37-fe21-41db-bb18-bddb62944063+3:2360:x1869355197201792:12345-192.168.204.31@tcp:9:umount.0 Request processed in 293us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759371.591610:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 938 00000100:00100000:1.0:1782759371.593526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.593583:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197202048 00000100:00100000:0.0:1782759371.593589:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197202048 00000100:00100000:0.0:1782759371.593637:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 939 00000100:00100000:0.0:1782759371.593647:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dab61a37-fe21-41db-bb18-bddb62944063+7:2360:x1869355197202048:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759371.593671:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dea8e 00000020:00010000:0.0:1782759371.593679:0:6598:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917183836800: total 0 00000100:00080000:0.0:1782759371.593683:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917183835000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759371.593716:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967394 00000020:00010000:3.0:1782759371.593720:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917183836800: total 0 00010000:00010000:3.0:1782759371.593759:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917183836800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759371.593809:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d46c9cc/0xdd99f5c4777deae9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bfb expref: 6 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759371.593860:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917183836800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759371.593876:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759371.593879:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759371.593881:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759371.593907:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dab61a37-fe21-41db-bb18-bddb62944063+3:2360:x1869355197202048:12345-192.168.204.31@tcp:9:umount.0 Request processed in 262us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.593913:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 939 00000100:00100000:0.0:1782759371.596690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759371.596733:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197202560 00000100:00100000:1.0:1782759371.596741:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197202560 00000100:00100000:1.0:1782759371.596790:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1829 00000100:00100000:1.0:1782759371.596799:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dab61a37-fe21-41db-bb18-bddb62944063+9:2360:x1869355197202560:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1782759371.596847:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dea87 00000020:00010000:1.0:1782759371.596854:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9170836cb000: total 0 00000100:00080000:1.0:1782759371.596858:0:7487:0:(import.c:65:import_set_state_nolock()) ffff9170836c9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759371.596875:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967989 00000020:00010000:0.0:1782759371.596880:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9170836cb000: total 0 00010000:00010000:0.0:1782759371.596883:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759371.596930:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9170836cb000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1782759371.596957:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:0.0:1782759371.596959:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759371.596965:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777deabf lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bed expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.597004:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5600) 00010000:00010000:0.0:1782759371.597006:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759371.597009:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777deaa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66be6 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.597022:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x2:0x0].0x0 (ffff917183a70b00) 00010000:00010000:0.0:1782759371.597023:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759371.597025:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deadb lrc: 0/0,0 mode: --/PR res: [0x200000417:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66bf4 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759371.597036:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9170836cb000, canceled 3 locks, left on hash table 0. 00000100:00100000:1.0:1782759371.597042:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dab61a37-fe21-41db-bb18-bddb62944063+5:2360:x1869355197202560:12345-192.168.204.31@tcp:39:umount.0 Request processed in 243us (357us total) trans 4294967990 rc 0/0 00010000:00010000:0.0:1782759371.597045:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759371.597048:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759371.597051:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759371.597053:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1829 00000100:00100000:2.0:1782759371.603705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759371.603755:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197202816 00000100:00100000:0.0:1782759371.603764:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197202816 00000100:00100000:0.0:1782759371.603812:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2576 00000100:00100000:0.0:1782759371.603842:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+7:2360:x1869355197202816:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1782759371.603881:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777dea5d 00000020:00010000:0.0:1782759371.603899:0:5793:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917083575000: total 0 00000100:00080000:0.0:1782759371.603904:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917083571800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1782759371.603957:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917083575000: total 0 00000100:00100000:0.0:1782759371.603976:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247c9e87-b248-41f5-b285-1da82b8890ea+3:2360:x1869355197202816:12345-192.168.204.31@tcp:251:umount.0 Request processed in 154us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759371.603985:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2576 00010000:00010000:2.0:1782759371.604011:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917083575000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782759371.604050:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99400/0xdd99f5c4777dea64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66b76 expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759371.604068:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917083575000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1782759371.604079:0:5788:0:(genops.c:906:class_export_put()) final put ffff917083575000/247c9e87-b248-41f5-b285-1da82b8890ea 00010000:00010000:2.0:1782759371.604095:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759371.604098:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759371.604100:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759371.604125:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917083575000/247c9e87-b248-41f5-b285-1da82b8890ea for MGS 00000020:00000080:3.0:1782759371.604168:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083571800 for MGS 00000001:00100000:1.0:1782759372.226895:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000001:00100000:1.0:1782759372.226908:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00100000:1.0:1782759372.226924:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00100000:1.0:1782759372.226936:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000020:00000080:1.0:1782759372.227024:0:7507:0:(genops.c:906:class_export_put()) final put ffff9170836ca000/dab61a37-fe21-41db-bb18-bddb62944063 00000001:00100000:1.0:1782759372.227050:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:2.0:1782759372.227052:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836ca000/dab61a37-fe21-41db-bb18-bddb62944063 for lustre-OST0001 00000001:00100000:1.0:1782759372.227058:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:1.0:1782759372.227062:0:7507:0:(genops.c:906:class_export_put()) final put ffff917083570800/a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:2.0:1782759372.227134:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836ca800 for lustre-OST0001 00000001:00100000:1.0:1782759372.227140:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000020:00000080:2.0:1782759372.227141:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917083570800/a7b70f26-bb36-4d07-b714-13af3386dd52 for lustre-OST0001 00000020:00000080:1.0:1782759372.227147:0:7507:0:(genops.c:906:class_export_put()) final put ffff917082d3f000/bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00100000:1.0:1782759372.227160:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000020:00000080:1.0:1782759372.227162:0:7507:0:(genops.c:906:class_export_put()) final put ffff9170836cd000/0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000020:00000080:2.0:1782759372.227171:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083577800 for lustre-OST0001 00000001:00100000:1.0:1782759372.227172:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3f194d1f-b374-4c82-8e12-63c3c7af011e 00000020:00000080:1.0:1782759372.227174:0:7507:0:(genops.c:906:class_export_put()) final put ffff917084d23000/3f194d1f-b374-4c82-8e12-63c3c7af011e 00000020:00000080:2.0:1782759372.227187:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3f000/bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 for lustre-OST0001 00000020:00000080:2.0:1782759372.227202:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836cd000/0b87cb72-f86b-4a9a-9327-2f356f4d3092 for lustre-OST0001 00000020:00000080:2.0:1782759372.227216:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d23000/3f194d1f-b374-4c82-8e12-63c3c7af011e for lustre-OST0001 00000020:00000080:2.0:1782759372.227230:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d3e000 for lustre-OST0001 00000020:00000080:2.0:1782759372.227233:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836cf800 for lustre-OST0001 00000020:00000080:2.0:1782759372.227236:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d26000 for lustre-OST0001 00000001:00100000:0.0:1782759372.230509:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000001:00100000:0.0:1782759372.230518:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3f194d1f-b374-4c82-8e12-63c3c7af011e 00000001:00080000:0.0:1782759372.230529:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967983 is committed 00000001:00100000:0.0:1782759372.230609:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000001:00080000:0.0:1782759372.230615:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967990 is committed 00000020:00000080:0.0:1782759372.230618:0:5824:0:(genops.c:906:class_export_put()) final put ffff9170836cb000/dab61a37-fe21-41db-bb18-bddb62944063 00000001:00100000:0.0:1782759372.230628:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000001:00080000:0.0:1782759372.230632:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967989 is committed 00000001:00100000:0.0:1782759372.230635:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000020:00000080:0.0:1782759372.230637:0:5824:0:(genops.c:906:class_export_put()) final put ffff917083573000/dab61a37-fe21-41db-bb18-bddb62944063 00000020:00000080:2.0:1782759372.230638:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836cb000/dab61a37-fe21-41db-bb18-bddb62944063 for lustre-MDT0000 00000001:00100000:0.0:1782759372.230645:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00100000:0.0:1782759372.230650:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00080000:0.0:1782759372.230655:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967986 is committed 00000001:00100000:0.0:1782759372.230659:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000020:00000080:0.0:1782759372.230660:0:5824:0:(genops.c:906:class_export_put()) final put ffff917083573800/0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00100000:0.0:1782759372.230668:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000001:00080000:0.0:1782759372.230671:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967985 is committed 00000001:00100000:0.0:1782759372.230678:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:0.0:1782759372.230680:0:5824:0:(genops.c:906:class_export_put()) final put ffff917083571000/a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:2.0:1782759372.230694:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917083573000/dab61a37-fe21-41db-bb18-bddb62944063 for lustre-MDT0000 00000020:00000080:0.0:1782759372.230811:0:5824:0:(genops.c:906:class_export_put()) final put ffff9171bb692800/3f194d1f-b374-4c82-8e12-63c3c7af011e 00000001:00100000:0.0:1782759372.230853:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00080000:0.0:1782759372.230860:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967988 is committed 00000020:00000080:0.0:1782759372.230863:0:5824:0:(genops.c:906:class_export_put()) final put ffff917083570000/bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00100000:0.0:1782759372.230868:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00080000:0.0:1782759372.230892:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967987 is committed 00000001:00100000:0.0:1782759372.230898:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000020:00000080:0.0:1782759372.230900:0:5824:0:(genops.c:906:class_export_put()) final put ffff917082d3c000/0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00100000:0.0:1782759372.230907:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000001:00080000:0.0:1782759372.230915:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967984 is committed 00000001:00100000:0.0:1782759372.230927:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:0.0:1782759372.230930:0:5824:0:(genops.c:906:class_export_put()) final put ffff917082d3c800/a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:2.0:1782759372.231066:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836c9800 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231072:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917083573800/0b87cb72-f86b-4a9a-9327-2f356f4d3092 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231110:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917083571000/a7b70f26-bb36-4d07-b714-13af3386dd52 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231140:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083572000 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231146:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff9171bb692800/3f194d1f-b374-4c82-8e12-63c3c7af011e for lustre-MDT0000 00000020:00000080:2.0:1782759372.231178:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917083570000/bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231205:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3c000/0b87cb72-f86b-4a9a-9327-2f356f4d3092 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231239:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3c800/a7b70f26-bb36-4d07-b714-13af3386dd52 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231267:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083574000 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231279:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083574800 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231282:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171bb693000 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231286:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083575800 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231293:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d3e800 for lustre-MDT0000 00000020:00000080:2.0:1782759372.231297:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d38800 for lustre-MDT0000 00010000:00010000:3.0:1782759372.396041:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759372.716009:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759372.716027:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211894784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759372.716082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759372.716116:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894784 00000100:00100000:3.0:1782759372.716126:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894784 00000100:00100000:3.0:1782759372.716196:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1782759372.716208:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211894784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759372.716259:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42401792 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759372.716319:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211894784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759372.716327:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00080000:0.0:1782759372.716357:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759372.716406:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211894784:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782759372.743435:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000001:00100000:0.0:1782759372.743454:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00100000:0.0:1782759372.743462:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00100000:0.0:1782759372.743469:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000001:00100000:0.0:1782759372.743474:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dab61a37-fe21-41db-bb18-bddb62944063 00000020:00000080:0.0:1782759372.743477:0:6622:0:(genops.c:906:class_export_put()) final put ffff917183836800/dab61a37-fe21-41db-bb18-bddb62944063 00000001:00100000:0.0:1782759372.743498:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000020:00000080:0.0:1782759372.743501:0:6622:0:(genops.c:906:class_export_put()) final put ffff917084d26800/0b87cb72-f86b-4a9a-9327-2f356f4d3092 00000001:00100000:0.0:1782759372.743506:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3f194d1f-b374-4c82-8e12-63c3c7af011e 00000001:00080000:0.0:1782759372.743514:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967394 is committed 00000020:00000080:0.0:1782759372.743524:0:6622:0:(genops.c:906:class_export_put()) final put ffff917084d24800/3f194d1f-b374-4c82-8e12-63c3c7af011e 00000020:00000080:2.0:1782759372.743530:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917183836800/dab61a37-fe21-41db-bb18-bddb62944063 for lustre-OST0000 00000001:00100000:0.0:1782759372.743537:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000020:00000080:0.0:1782759372.743541:0:6622:0:(genops.c:906:class_export_put()) final put ffff917083577000/bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 00000001:00100000:0.0:1782759372.743561:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:0.0:1782759372.743564:0:6622:0:(genops.c:906:class_export_put()) final put ffff917083572800/a7b70f26-bb36-4d07-b714-13af3386dd52 00000020:00000080:2.0:1782759372.743584:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d26800/0b87cb72-f86b-4a9a-9327-2f356f4d3092 for lustre-OST0000 00000020:00000080:2.0:1782759372.743614:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917084d24800/3f194d1f-b374-4c82-8e12-63c3c7af011e for lustre-OST0000 00000020:00000080:2.0:1782759372.743644:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917183835000 for lustre-OST0000 00000020:00000080:2.0:1782759372.743668:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917083577000/bfc64b95-1b47-4b60-bd0b-0edd969e3bf4 for lustre-OST0000 00000020:00000080:2.0:1782759372.743699:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff917083572800/a7b70f26-bb36-4d07-b714-13af3386dd52 for lustre-OST0000 00000020:00000080:2.0:1782759372.743729:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d24000 for lustre-OST0000 00000020:00000080:2.0:1782759372.743733:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917084d21000 for lustre-OST0000 00000020:00000080:2.0:1782759372.743735:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083576000 for lustre-OST0000 00000020:00000080:2.0:1782759372.743737:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917083576800 for lustre-OST0000 00010000:00010000:0.0:1782759373.419971:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759374.047121:0:134665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed4d03480 20000000:00000080:3.0:1782759374.047137:0:134665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7c2e400 uarg=0000000000000000 10000000:01000000:3.0:1782759374.049124:0:134665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759374.049147:0:134665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049165:0:134665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049174:0:134665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049211:0:134665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049226:0:134665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 18 pid: 5794 timeout: 3542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759374.049242:0:134665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:134665:1869355211894912:0@lo:104: 00000100:00100000:3.0:1782759374.049291:0:134665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759374.049340:0:134665:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759374.049351:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211894912 00000100:00100000:0.0:1782759374.049358:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211894912 00000100:00100000:0.0:1782759374.049401:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1782759374.049411:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:134665:x1869355211894912:12345-0@lo:104: 00010000:00010000:0.0:1782759374.049423:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049503:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759374.049511:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:134665:x1869355211894912:12345-0@lo:104: Request processed in 101us (218us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759374.049517:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782759374.049519:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00010000:00010000:2.0:1782759374.049526:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759374.049536:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759374.049540:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759374.049549:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759374.049556:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759374.049562:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782759374.049588:0:134665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:134665:1869355211894912:0@lo:104: 00010000:00010000:2.0:1782759374.049602:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049610:0:134665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759374.049610:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759374.049644:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759374.049646:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211895040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759374.049658:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99800/0xdd99f5c4777de8ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777de8d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759374.049676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759374.049691:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759374.049694:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759374.049696:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759374.049714:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895040 00000100:00100000:0.0:1782759374.049720:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895040 00010000:00010000:0.0:1782759374.049746:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 19 pid: 5794 timeout: 3542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759374.049780:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1782759374.049788:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211895040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759374.049797:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759374.049802:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 19 pid: 5794 timeout: 3542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049811:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 19 pid: 5794 timeout: 3542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049851:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777de8d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777de8ce expref: 19 pid: 5794 timeout: 3542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049864:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049872:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049885:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049902:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049909:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049915:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049920:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759374.049924:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049932:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049945:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049951:0:134665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759374.049955:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759374.049958:0:134665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.049964:0:134665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deaf0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759374.049992:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211895040:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759374.050000:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1782759374.050022:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211895040:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1782759374.402816:0:134713:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0a0c7d10 20000000:00000080:1.0:1782759374.402864:0:134713:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc1000 uarg=0000000000000000 10000000:01000000:1.0:1782759374.403065:0:134713:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759374.403086:0:134713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403101:0:134713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403111:0:134713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403117:0:134713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403124:0:134713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403142:0:134713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403148:0:134713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759374.403152:0:134713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403161:0:134713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403172:0:134713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403180:0:134713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.403186:0:134713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deaf7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759374.444035:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759374.760423:0:134761:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc69e6f5d0 20000000:00000080:1.0:1782759374.760438:0:134761:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc1800 uarg=0000000000000000 10000000:01000000:1.0:1782759374.760612:0:134761:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759374.760637:0:134761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760653:0:134761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760664:0:134761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760681:0:134761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760688:0:134761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760695:0:134761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760701:0:134761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759374.760705:0:134761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760713:0:134761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760726:0:134761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760734:0:134761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759374.760740:0:134761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deafe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759374.764132:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211895168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759374.764177:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211895552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759374.764274:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211895680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759374.764377:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895680 00000100:00100000:2.0:1782759374.764384:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895680 00000100:00100000:3.0:1782759374.764390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759374.764455:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:2.0:1782759374.764467:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211895680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764518:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211895680:12345-0@lo:400:kworker.0 Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759374.764526:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00080000:2.0:1782759374.764548:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759374.764578:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211895680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764786:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211895424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759374.764895:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782759374.764903:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211895296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759374.764955:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211895808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.764989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759374.765037:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895424 00000100:00100000:2.0:1782759374.765042:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895424 00000100:00100000:1.0:1782759374.765066:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895168 00000100:00100000:1.0:1782759374.765072:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895168 00000100:00100000:2.0:1782759374.765078:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895296 00000100:00100000:2.0:1782759374.765083:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895296 00000100:00100000:1.0:1782759374.765110:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:2.0:1782759374.765115:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:1.0:1782759374.765122:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211895168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.765127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211895424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759374.765172:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211895168:12345-0@lo:400:kworker.0 Request processed in 54us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759374.765179:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:2.0:1782759374.765276:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211895424:12345-0@lo:400:kworker.0 Request processed in 153us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759374.765284:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:2.0:1782759374.765298:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:2.0:1782759374.765305:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211895296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.765339:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211895296:12345-0@lo:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759374.765345:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:2.0:1782759374.765368:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895552 00000100:00100000:2.0:1782759374.765371:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895552 00000100:00100000:2.0:1782759374.765399:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895808 00000100:00100000:2.0:1782759374.765402:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895808 00000100:00100000:1.0:1782759374.765418:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:1.0:1782759374.765427:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211895552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759374.765467:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211895552:12345-0@lo:400:kworker.0 Request processed in 41us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759374.765642:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:2.0:1782759374.765655:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1782759374.765663:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211895808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.765690:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211895808:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759374.765694:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00080000:2.0:1782759374.765710:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759374.765713:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759374.765715:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759374.765737:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211895296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.765759:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211895808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.765771:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211895424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759374.765793:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211895168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759374.765925:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211895552:0@lo:400:kworker.0 00000020:00000080:2.0:1782759375.096011:0:134809:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec57713d0 20000000:00000080:2.0:1782759375.096026:0:134809:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2c000 uarg=0000000000000000 10000000:01000000:2.0:1782759375.096239:0:134809:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759375.096259:0:134809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096271:0:134809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096279:0:134809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096283:0:134809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096287:0:134809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096292:0:134809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096295:0:134809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759375.096299:0:134809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096306:0:134809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096325:0:134809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096333:0:134809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759375.096339:0:134809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777deb05 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 134809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759375.277043:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211895936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759375.277109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759375.277223:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211895936 00000100:00100000:3.0:1782759375.277233:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211895936 00000100:00100000:3.0:1782759375.277285:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1782759375.277370:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211895936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759375.277405:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759375.277457:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211895936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759375.277465:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1782759375.277522:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211895936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759375.468094:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759375.851969:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759375.851977:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759375.851982:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759375.852038:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759375.852068:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759375.852079:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759375.852104:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211896064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759375.852184:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759375.852273:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759375.852299:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896064 00000100:00100000:3.0:1782759375.852313:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896064 00000100:00100000:3.0:1782759375.852546:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1782759375.852559:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211896064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759375.852588:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759375.852607:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777deb0c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759375.852633:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759375.852644:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759375.852653:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759375.852729:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211896064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759375.852736:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1782759375.852764:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211896064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759375.852780:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759375.852790:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759375.852860:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759375.852866:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759375.852871:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759376.455640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.455819:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197202944 00000100:00100000:1.0:1782759376.455860:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197202944 00000100:00100000:1.0:1782759376.455941:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2579 00000100:00100000:1.0:1782759376.455948:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355197202944:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782759376.455976:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5eacb22c-5970-4500-a1c7-1fc375a2c1df@192.168.204.31@tcp t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:1.0:1782759376.456004:0:5796:0:(genops.c:1406:class_connect()) connect: client 5eacb22c-5970-4500-a1c7-1fc375a2c1df, cookie 0xdd99f5c4777deb1a 00000100:00080000:1.0:1782759376.456042:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917081390800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759376.456102:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+5:2360:x1869355197202944:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 154us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.456120:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2579 00000100:00100000:1.0:1782759376.457299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759376.457346:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203072 00000100:00100000:3.0:1782759376.457353:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203072 00000100:00100000:3.0:1782759376.457385:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2580 00000100:00100000:3.0:1782759376.457392:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+5:95007:x1869355197203072:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759376.457403:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759376.457415:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759376.457436:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759376.457446:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759376.457455:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc800, rc 0) 00000100:00100000:3.0:1782759376.457509:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+6:95007:x1869355197203072:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 117us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759376.457514:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2580 00000100:00100000:0.0:1782759376.462023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.462081:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203200 00000100:00100000:1.0:1782759376.462092:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203200 00000100:00100000:1.0:1782759376.462154:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2581 00000100:00100000:1.0:1782759376.462164:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+6:95007:x1869355197203200:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759376.462445:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+6:95007:x1869355197203200:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 280us (428us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759376.462461:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2581 00000100:00100000:2.0:1782759376.463636:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759376.463689:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203328 00000100:00100000:3.0:1782759376.463696:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203328 00000100:00100000:3.0:1782759376.463741:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2582 00000100:00100000:3.0:1782759376.463750:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+6:95007:x1869355197203328:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759376.463762:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759376.463777:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c17 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759376.463814:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759376.463851:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759376.463860:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd000, rc 0) 00000100:00100000:3.0:1782759376.463902:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+7:95007:x1869355197203328:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 154us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759376.463909:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2582 00000100:00100000:0.0:1782759376.465856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.465969:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203456 00000100:00100000:1.0:1782759376.465976:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203456 00000100:00100000:1.0:1782759376.466017:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2583 00000100:00100000:1.0:1782759376.466023:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+7:95007:x1869355197203456:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759376.466282:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95007:x1869355197203456:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 257us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.466289:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2583 00000100:00100000:0.0:1782759376.467425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759376.467478:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203584 00000100:00100000:3.0:1782759376.467484:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203584 00000100:00100000:3.0:1782759376.467525:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2584 00000100:00100000:3.0:1782759376.467533:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95007:x1869355197203584:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759376.467715:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95007:x1869355197203584:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 183us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759376.467732:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2584 00000100:00100000:0.0:1782759376.470047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.470136:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203712 00000100:00100000:2.0:1782759376.470145:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203712 00000100:00100000:2.0:1782759376.470194:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2585 00000100:00100000:2.0:1782759376.470203:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95025:x1869355197203712:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759376.470453:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95025:x1869355197203712:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 251us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.470462:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2585 00000100:00100000:0.0:1782759376.478745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.479756:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203840 00000100:00100000:1.0:1782759376.479767:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203840 00000100:00100000:1.0:1782759376.479866:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2586 00000100:00100000:1.0:1782759376.479876:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95025:x1869355197203840:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759376.480186:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95025:x1869355197203840:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 298us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.480194:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2586 00000100:00100000:0.0:1782759376.482654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.483812:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197203968 00000100:00100000:2.0:1782759376.483851:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197203968 00000100:00100000:2.0:1782759376.483913:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2587 00000100:00100000:2.0:1782759376.483923:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95007:x1869355197203968:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759376.483957:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759376.483975:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65600/0xdd99f5c4777deb2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c41 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759376.484005:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65600/0xdd99f5c4777deb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c41 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759376.484017:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65600/0xdd99f5c4777deb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c41 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759376.484026:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65600, rc 0) 00000100:00100000:2.0:1782759376.484092:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95007:x1869355197203968:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 170us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.484099:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2587 00000100:00100000:0.0:1782759376.488685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.488747:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204096 00000100:00100000:1.0:1782759376.488757:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204096 00000100:00100000:1.0:1782759376.488817:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2588 00000100:00100000:1.0:1782759376.488858:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95007:x1869355197204096:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782759376.488884:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782759376.488907:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782759376.488910:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782759376.488913:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782759376.488915:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782759376.491722:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95007:x1869355197204096:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 2858us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.491746:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2588 00010000:00010000:2.0:1782759376.491939:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759376.494196:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.494260:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204224 00000100:00100000:2.0:1782759376.494269:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204224 00000100:00100000:2.0:1782759376.494312:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2589 00000100:00100000:2.0:1782759376.494321:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95007:x1869355197204224:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759376.494336:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759376.494353:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777deb36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c48 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759376.494379:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777deb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c48 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759376.494390:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777deb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c48 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759376.494415:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64000, rc 0) 00000100:00100000:2.0:1782759376.494482:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95007:x1869355197204224:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 161us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.494489:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2589 00000100:00100000:0.0:1782759376.495713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.495931:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204352 00000100:00100000:1.0:1782759376.495938:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204352 00000100:00100000:1.0:1782759376.495976:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2590 00000100:00100000:1.0:1782759376.495984:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95007:x1869355197204352:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759376.496282:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95007:x1869355197204352:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 294us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.496290:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2590 00000100:00100000:0.0:1782759376.497896:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.497961:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204480 00000100:00100000:2.0:1782759376.497980:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204480 00000100:00100000:2.0:1782759376.498036:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2591 00000100:00100000:2.0:1782759376.498046:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95007:x1869355197204480:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759376.498230:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95007:x1869355197204480:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 184us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.498238:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2591 00000100:00100000:0.0:1782759376.501750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.501973:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204608 00000100:00100000:1.0:1782759376.501982:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204608 00000100:00100000:3.0:1782759376.502072:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2592 00000100:00100000:3.0:1782759376.502086:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95030:x1869355197204608:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759376.502422:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95030:x1869355197204608:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 339us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759376.502432:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2592 00000100:00100000:0.0:1782759376.504174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.504285:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204736 00000100:00100000:2.0:1782759376.504294:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204736 00000100:00100000:2.0:1782759376.504403:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2593 00000100:00100000:2.0:1782759376.504413:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95030:x1869355197204736:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759376.504637:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95030:x1869355197204736:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 224us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.504649:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2593 00000100:00100000:0.0:1782759376.506714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.507079:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204864 00000100:00100000:2.0:1782759376.507088:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204864 00000100:00100000:2.0:1782759376.507138:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000100:00100000:2.0:1782759376.507146:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1869355197204864:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782759376.507174:0:5803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:2.0:1782759376.507215:0:5803:0:(genops.c:1406:class_connect()) connect: client c5e146cd-50db-4b42-b3c2-9b1f84b4ef37, cookie 0xdd99f5c4777deb3d 00000004:00100000:2.0:1782759376.507259:0:5803:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782759376.507508:0:5803:0:(import.c:65:import_set_state_nolock()) ffff917082438800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759376.507574:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2360:x1869355197204864:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 427us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.507588:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000100:00100000:0.0:1782759376.509319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759376.509395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759376.509424:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197204992 00000100:00100000:1.0:1782759376.509431:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197204992 00000100:00100000:2.0:1782759376.509475:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205120 00000100:00100000:2.0:1782759376.509480:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205120 00000100:00080000:3.0:1782759376.509559:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759376.509606:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1831 00000100:00100000:2.0:1782759376.509612:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1832 00000100:00100000:1.0:1782759376.509616:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:0:x1869355197204992:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00100000:2.0:1782759376.509618:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:95007:x1869355197205120:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759376.509658:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1782759376.509726:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:95007:x1869355197205120:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759376.509734:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1832 00000004:00000024:1.0:1782759376.509746:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:1.0:1782759376.509776:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:0:x1869355197204992:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 162us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.509783:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1831 00000100:00100000:3.0:1782759376.513172:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759376.513315:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205248 00000100:00100000:0.0:1782759376.513323:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205248 00000100:00100000:0.0:1782759376.513376:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1833 00000100:00100000:0.0:1782759376.513387:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95007:x1869355197205248:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782759376.513510:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95007:x1869355197205248:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 125us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759376.513518:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1833 00000100:00100000:0.0:1782759376.516702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759376.516740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759376.516743:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205632 00000100:00100000:3.0:1782759376.516754:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205632 00000100:00100000:0.0:1782759376.516774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759376.516815:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205376 00000100:00100000:2.0:1782759376.516845:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205376 00000100:00100000:2.0:1782759376.516887:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205504 00000100:00100000:2.0:1782759376.516891:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205504 00000100:00100000:3.0:1782759376.516904:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 241 00000100:00100000:2.0:1782759376.516920:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 940 00000100:00100000:3.0:1782759376.516921:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95007:x1869355197205632:12345-192.168.204.31@tcp:33:mount.lustre.0 00000100:00100000:2.0:1782759376.516938:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355197205376:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759376.516976:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:2.0:1782759376.517016:0:6598:0:(genops.c:1406:class_connect()) connect: client c5e146cd-50db-4b42-b3c2-9b1f84b4ef37, cookie 0xdd99f5c4777deb44 00002000:00100000:2.0:1782759376.517040:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5e146cd-50db-4b42-b3c2-9b1f84b4ef37/ffff9171bb694800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759376.517065:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1782759376.517217:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:2.0:1782759376.517303:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759376.517336:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9171bb692800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759376.517399:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2360:x1869355197205376:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 461us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.517482:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 941 00000100:00100000:1.0:1782759376.517489:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355197205504:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759376.517506:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp t0 exp 0000000000000000 cur 3444 last 0 00000100:00100000:2.0:1782759376.517521:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 940 00000020:00000080:1.0:1782759376.517531:0:6597:0:(genops.c:1406:class_connect()) connect: client c5e146cd-50db-4b42-b3c2-9b1f84b4ef37, cookie 0xdd99f5c4777deb4b 00000100:00100000:3.0:1782759376.517534:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95007:x1869355197205632:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 619us (838us total) trans 0 rc 0/0 00002000:00100000:1.0:1782759376.517540:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5e146cd-50db-4b42-b3c2-9b1f84b4ef37/ffff917081397800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1782759376.517546:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 241 00002000:00100000:1.0:1782759376.517550:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759376.517710:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782759376.517726:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917081396000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759376.517765:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2360:x1869355197205504:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 274us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759376.517772:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 941 00000001:00100000:0.0:1782759377.344042:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000001:02000400:3.0:1782759377.345639:0:135008:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 62: e2fsck with encrypted files ======= 14:56:15 (1782759375) 00000001:00100000:0.0:1782759377.346598:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00010000:00010000:3.0:1782759377.516161:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759377.835986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759377.836010:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211896192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759377.836079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759377.836174:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896192 00000100:00100000:0.0:1782759377.836188:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896192 00000100:00100000:0.0:1782759377.836251:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1782759377.836264:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211896192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759377.836298:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782759377.836342:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759377.836358:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211896192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759377.836366:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1782759377.836421:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211896192:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1782759377.852892:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000001:02000400:0.0:1782759378.048737:0:135058:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_62 skip ZFS backend 00010000:00010000:0.0:1782759378.540028:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759378.829466:0:135106:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 63: fid2path with encrypted files ===== 14:56:17 (1782759377) 00000001:02000400:0.0:1782759379.564293:0:135155:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_63 This test needs fscrypt userspace tool 00010000:00010000:2.0:1782759379.564909:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759379.884417:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211896704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.884419:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211896448:0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.884498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759379.884499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759379.884535:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211896320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759379.884600:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896448 00000100:00100000:1.0:1782759379.884607:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896448 00000100:00100000:2.0:1782759379.884623:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759379.884657:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211896832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759379.884660:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1782759379.884683:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211896448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.884695:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211896960:0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.884703:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759379.884756:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211896448:12345-0@lo:400:kworker.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759379.884758:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211896576:0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.884760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759379.884772:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1782759379.884796:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896832 00000100:00100000:2.0:1782759379.884797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759379.884801:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896832 00000100:00100000:3.0:1782759379.884853:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211896448:0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.884881:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896320 00000100:00100000:3.0:1782759379.884908:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896320 00000100:00100000:3.0:1782759379.884949:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1782759379.884956:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211896320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.884993:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211896320:12345-0@lo:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759379.885000:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1782759379.885028:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896704 00000100:00100000:3.0:1782759379.885031:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896704 00000100:00100000:3.0:1782759379.885056:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896960 00000100:00100000:3.0:1782759379.885058:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896960 00000100:00100000:3.0:1782759379.885077:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:3.0:1782759379.885083:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211896704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.885115:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211896704:12345-0@lo:400:kworker.0 Request processed in 33us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759379.885123:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1782759379.885136:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211896576 00000100:00100000:3.0:1782759379.885141:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1782759379.885142:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211896576 00000100:00100000:3.0:1782759379.885151:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211896960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759379.885186:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211896960:12345-0@lo:400:kworker.0 Request processed in 38us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759379.885193:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1782759379.886849:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1782759379.886865:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211896832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.886915:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211896832:12345-0@lo:400:kworker.0 Request processed in 57us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759379.886923:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1782759379.886944:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1782759379.886950:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211896576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.886987:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211896576:12345-0@lo:400:kworker.0 Request processed in 36us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759379.886993:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1782759379.887030:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211896576:0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.887059:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211896320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.887071:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211896832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.887145:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211896704:0@lo:400:kworker.0 00000100:00100000:2.0:1782759379.887176:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211896960:0@lo:400:kworker.0 00000100:00080000:2.0:1782759379.887220:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759379.887225:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759379.887228:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782759380.394341:0:135203:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64a: Nodemap enforces file_perms RBAC roles ========================================================== 14:56:18 (1782759378) 00000100:00100000:2.0:1782759380.397014:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211897088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759380.397081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759380.397176:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897088 00000100:00100000:0.0:1782759380.397183:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897088 00000100:00100000:0.0:1782759380.397240:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1782759380.397250:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211897088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759380.397282:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759380.397330:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211897088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759380.397337:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1782759380.397383:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211897088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759380.586739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759380.586910:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205760 00000100:00100000:2.0:1782759380.586921:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205760 00000100:00100000:2.0:1782759380.587004:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1834 00000100:00100000:2.0:1782759380.587016:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:95807:x1869355197205760:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:2.0:1782759380.587036:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759380.587130:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777deb52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c72 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.587193:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deb59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.587206:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.587218:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759380.587607:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759380.587612:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759380.587696:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.587732:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777deb52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c72 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.587753:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c72 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.587762:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6300) 00000100:00080000:1.0:1782759380.587763:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759380.587766:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759380.587772:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64600, rc 0) 00000100:00100000:2.0:1782759380.587935:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95807:x1869355197205760:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 921us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759380.587942:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1834 00010000:00010000:1.0:1782759380.588752:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759380.590139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759380.590765:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197205888 00000100:00100000:1.0:1782759380.590773:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197205888 00000100:00100000:1.0:1782759380.590863:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:2.0:1782759380.590873:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:1.0:1782759380.590875:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171ba928050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95807:x1869355197205888:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:2.0:1782759380.590887:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:1.0:1782759380.590952:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171ba928050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95807:x1869355197205888:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 80us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759380.590976:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1782759380.592788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759380.592986:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206144 00000100:00100000:0.0:1782759380.592993:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206144 00000100:00100000:0.0:1782759380.593136:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1835 00000100:00100000:0.0:1782759380.593148:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:95807:x1869355197206144:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759380.593194:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759380.593220:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deb59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c72 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.593248:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:0.0:1782759380.593260:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759380.593534:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.593548:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.593556:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.593569:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.593575:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.593580:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759380.595160:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782759380.595176:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.595184:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.595191:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.595197:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759380.595208:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.595216:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.595229:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759380.595233:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759380.595235:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759380.595240:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deb60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759380.595262:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000295ae6a4 reply state 00000000e5a0a5ae transno 4294967991 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759380.595269:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759380.595341:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:95807:x1869355197206144:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2193us (2558us total) trans 4294967991 rc 0/0 00000100:00100000:0.0:1782759380.595349:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1835 00010000:00010000:2.0:1782759380.596321:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.596331:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.596337:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.596342:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759380.596345:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.596363:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.596374:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1362df6 (ffff917183a70400) 00010000:00010000:2.0:1782759380.596376:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759380.596379:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759380.596382:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777deb67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759381.612046:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759381.683955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759381.683994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759381.684011:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206272 00000100:00100000:2.0:1782759381.684022:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206272 00000100:00100000:3.0:1782759381.684039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759381.684075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759381.684087:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2595 00000100:00100000:2.0:1782759381.684110:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197206272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759381.684185:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197206272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759381.684194:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2595 00000100:00100000:0.0:1782759381.684195:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206400 00000100:00100000:0.0:1782759381.684201:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206400 00000100:00100000:2.0:1782759381.684248:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206528 00000100:00100000:2.0:1782759381.684253:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206528 00000100:00100000:0.0:1782759381.684292:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2469 00000100:00100000:1.0:1782759381.684298:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206656 00000100:00100000:2.0:1782759381.684309:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1922 00000100:00100000:1.0:1782759381.684311:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206656 00000100:00100000:0.0:1782759381.684319:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197206400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759381.684321:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197206528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759381.684375:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1923 00000100:00100000:2.0:1782759381.684376:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197206528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759381.684386:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197206400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759381.684402:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1922 00000100:00100000:0.0:1782759381.684403:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2469 00000100:00080000:1.0:1782759381.684430:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759381.684437:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759381.684450:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197206656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759381.684487:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197206656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759381.684495:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1923 00000020:00000080:1.0:1782759382.159261:0:135399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffee6b9230 20000000:00000080:1.0:1782759382.159280:0:135399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc0400 uarg=0000000000000000 10000000:01000000:1.0:1782759382.159713:0:135399:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759382.159735:0:135399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.159754:0:135399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.159764:0:135399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.159801:0:135399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.159816:0:135399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 18 pid: 5793 timeout: 3550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759382.160266:0:135399:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:135399:1869355211897216:0@lo:104: 00000100:00100000:1.0:1782759382.160331:0:135399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759382.160385:0:135399:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759382.160452:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897216 00000100:00100000:3.0:1782759382.160459:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897216 00000100:00100000:3.0:1782759382.160510:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1782759382.160519:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:135399:x1869355211897216:12345-0@lo:104: 00010000:00010000:3.0:1782759382.160532:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759382.160633:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759382.160640:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:135399:x1869355211897216:12345-0@lo:104: Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759382.160647:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00010000:00010000:2.0:1782759382.160712:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759382.160720:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.160736:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759382.160740:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.160749:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759382.160756:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759382.160761:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759382.160798:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.160804:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759382.160855:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.160864:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99a00/0xdd99f5c4777deb0c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777deb13 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.160880:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759382.160884:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759382.160886:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759382.160895:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759382.160905:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211897344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759382.160935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759382.160970:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897344 00000100:00100000:0.0:1782759382.160982:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897344 00010000:00010000:0.0:1782759382.161017:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 19 pid: 5793 timeout: 3550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759382.161055:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1782759382.161063:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211897344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759382.161074:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759382.161080:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 19 pid: 5793 timeout: 3550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161090:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 19 pid: 5793 timeout: 3550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161105:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161114:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161128:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161134:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161140:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161147:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161152:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759382.161161:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161169:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161177:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759382.161186:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759382.161244:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211897344:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759382.161252:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1782759382.161279:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211897344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759382.161372:0:135399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777deb13 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777deb0c expref: 18 pid: 5793 timeout: 3550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759382.161379:0:135399:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:135399:1869355211897216:0@lo:104: 00010000:00010000:1.0:1782759382.161393:0:135399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.161400:0:135399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.161404:0:135399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.161407:0:135399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777deb6e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759382.464797:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967991 is committed 00000020:00000080:2.0:1782759382.525792:0:135449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffadb3a560 20000000:00000080:2.0:1782759382.525806:0:135449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2c400 uarg=0000000000000000 10000000:01000000:2.0:1782759382.526246:0:135449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759382.526267:0:135449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526284:0:135449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526294:0:135449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526300:0:135449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526309:0:135449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526316:0:135449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526323:0:135449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759382.526327:0:135449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526336:0:135449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526349:0:135449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526356:0:135449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759382.526369:0:135449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777deb75 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759382.636481:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759382.957276:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211897472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759382.957348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759382.957400:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897472 00000100:00100000:0.0:1782759382.957408:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897472 00000100:00100000:0.0:1782759382.957467:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1782759382.957480:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211897472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759382.957513:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782759382.957577:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759382.957873:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211897472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759382.957882:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1782759382.957945:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211897472:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782759383.467909:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759383.467917:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759383.467922:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759383.467962:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.467975:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.467986:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759383.468009:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211897600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759383.468071:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759383.468123:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759383.468123:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897600 00000100:00100000:1.0:1782759383.468130:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897600 00000100:00100000:1.0:1782759383.468176:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1782759383.468189:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211897600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759383.468203:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759383.468216:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777deb7c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.468240:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.468249:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.468255:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759383.468292:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211897600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759383.468303:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1782759383.468782:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211897600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759383.468798:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.468808:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759383.468878:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759383.468891:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.468899:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759383.660059:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759383.739548:0:135597:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0e85d090 20000000:00000080:3.0:1782759383.739565:0:135597:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca2800 uarg=0000000000000000 10000000:01000000:3.0:1782759383.739988:0:135597:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759383.740006:0:135597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759383.740023:0:135597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759383.740030:0:135597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759383.740065:0:135597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759383.740083:0:135597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 18 pid: 5796 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759383.740097:0:135597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:135597:1869355211897728:0@lo:104: 00000100:00100000:3.0:1782759383.740154:0:135597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759383.740199:0:135597:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759383.740431:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897728 00000100:00100000:1.0:1782759383.740437:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897728 00000100:00100000:1.0:1782759383.740480:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1782759383.740486:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:135597:x1869355211897728:12345-0@lo:104: 00010000:00010000:1.0:1782759383.740496:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.740544:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759383.740550:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:135597:x1869355211897728:12345-0@lo:104: Request processed in 64us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759383.740556:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1782759383.740568:0:135597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:135597:1869355211897728:0@lo:104: 00010000:00010000:3.0:1782759383.740585:0:135597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.740631:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759383.740638:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.740645:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759383.740662:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.740670:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759383.740677:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759383.740683:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759383.740720:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.740727:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759383.740752:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759383.740759:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777deb7c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777deb83 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759383.740767:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759383.740782:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211897856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759383.740788:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759383.740791:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759383.740793:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759383.740816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759383.740859:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897856 00000100:00100000:1.0:1782759383.740864:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897856 00010000:00010000:1.0:1782759383.740884:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 19 pid: 5796 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759383.740915:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1782759383.740923:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211897856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759383.740937:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759383.740942:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 19 pid: 5796 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.740952:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 19 pid: 5796 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.740964:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777deb83 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777deb7c expref: 19 pid: 5796 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.740982:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.740987:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.740996:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741000:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741004:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741008:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741011:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759383.741014:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741018:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741030:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759383.741038:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759383.741049:0:135597:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759383.741056:0:135597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759383.741063:0:135597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deb8a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759383.741067:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211897856:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759383.741078:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1782759383.741107:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211897856:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1782759384.080803:0:135646:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3a311a90 20000000:00000080:2.0:1782759384.080845:0:135646:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b1000 uarg=0000000000000000 10000000:01000000:2.0:1782759384.081118:0:135646:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759384.081141:0:135646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081158:0:135646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081169:0:135646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081178:0:135646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081185:0:135646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081192:0:135646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081199:0:135646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759384.081203:0:135646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081212:0:135646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081237:0:135646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081246:0:135646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.081253:0:135646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777deb91 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759384.451566:0:135694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff60d87070 20000000:00000080:1.0:1782759384.451583:0:135694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc2400 uarg=0000000000000000 10000000:01000000:1.0:1782759384.451791:0:135694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759384.451815:0:135694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452139:0:135694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452150:0:135694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452156:0:135694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452163:0:135694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452170:0:135694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452177:0:135694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759384.452181:0:135694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452188:0:135694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452201:0:135694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452219:0:135694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.452225:0:135694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777deb98 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.683946:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759384.800385:0:135742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd972ac70 20000000:00000080:1.0:1782759384.800402:0:135742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc2000 uarg=0000000000000000 10000000:01000000:1.0:1782759384.800609:0:135742:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759384.800648:0:135742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800665:0:135742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800675:0:135742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800682:0:135742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800688:0:135742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800695:0:135742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800701:0:135742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759384.800707:0:135742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800721:0:135742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800735:0:135742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800744:0:135742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.800751:0:135742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777deb9f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759385.004047:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211897984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211898112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759385.004115:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211898368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759385.004131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759385.004209:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211898624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759385.004212:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211898496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759385.004224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759385.004273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759385.004275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759385.004318:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898112 00000100:00100000:2.0:1782759385.004324:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759385.004330:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898112 00000100:00100000:2.0:1782759385.004336:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211898240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759385.004394:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898496 00000100:00100000:1.0:1782759385.004399:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898496 00000100:00100000:2.0:1782759385.004440:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898240 00000100:00100000:2.0:1782759385.004454:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898240 00000100:00100000:0.0:1782759385.004552:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:0.0:1782759385.004565:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211898112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004595:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:2.0:1782759385.004607:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211898240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759385.004613:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898368 00000100:00100000:3.0:1782759385.004620:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898368 00000100:00100000:1.0:1782759385.004638:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:0.0:1782759385.004642:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211898112:12345-0@lo:400:kworker.0 Request processed in 76us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759385.004665:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211898496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759385.004665:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:2.0:1782759385.004675:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211898240:12345-0@lo:400:kworker.0 Request processed in 67us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759385.004679:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898624 00000100:00100000:3.0:1782759385.004684:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898624 00000100:00100000:2.0:1782759385.004685:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:3.0:1782759385.004718:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1782759385.004728:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211898368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004731:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:2.0:1782759385.004742:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211898624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004804:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211898624:12345-0@lo:400:kworker.0 Request processed in 63us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759385.004810:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211898368:12345-0@lo:400:kworker.0 Request processed in 82us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759385.004842:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:2.0:1782759385.004858:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1782759385.004884:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211897984 00000100:00100000:3.0:1782759385.004889:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211897984 00000100:00100000:2.0:1782759385.004908:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211898240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759385.004926:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1782759385.004928:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211898496:12345-0@lo:400:kworker.0 Request processed in 260us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759385.004933:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211898112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759385.004939:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211897984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.004950:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211898624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759385.004952:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1782759385.004991:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211897984:12345-0@lo:400:kworker.0 Request processed in 55us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759385.005000:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00080000:3.0:1782759385.005045:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759385.005050:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759385.005053:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759385.005081:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211898368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.005092:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211897984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759385.005110:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211898496:0@lo:400:kworker.0 00000020:00000080:3.0:1782759385.158120:0:135790:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe45ab7c60 20000000:00000080:3.0:1782759385.158136:0:135790:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917193d0a800 uarg=0000000000000000 00010000:00010000:3.0:1782759385.158341:0:135790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759385.158356:0:135790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759385.158370:0:135790:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759385.158392:0:135790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158408:0:135790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158419:0:135790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158425:0:135790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158430:0:135790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158443:0:135790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158447:0:135790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759385.158450:0:135790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158455:0:135790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158464:0:135790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158469:0:135790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759385.158475:0:135790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777deba6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 135790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759385.516215:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759385.516233:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759385.516240:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759385.516317:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.516331:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.516347:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759385.516401:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211898752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759385.516526:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759385.516600:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898752 00000100:00100000:1.0:1782759385.516629:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898752 00000100:00100000:2.0:1782759385.516634:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759385.516739:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1782759385.516757:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211898752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759385.516776:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759385.516805:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777debad expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.516876:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777debad expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.516900:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777debad expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.516913:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:0.0:1782759385.516972:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211898880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759385.517041:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211898752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759385.517058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759385.517064:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1782759385.517070:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211898752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759385.517101:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.517130:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759385.517143:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211898880 00000100:00100000:0.0:1782759385.517151:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211898880 10000000:01000000:2.0:1782759385.517160:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759385.517167:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.517176:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759385.517214:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1782759385.517226:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211898880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759385.517268:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759385.517329:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211898880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759385.517337:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1782759385.517380:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211898880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759385.708249:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759386.731938:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759386.806117:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759386.806155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759386.806173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759386.806196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759386.806197:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197207040 00000100:00100000:1.0:1782759386.806208:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197207040 00000100:00100000:2.0:1782759386.806216:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206912 00000100:00100000:2.0:1782759386.806221:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206912 00000100:00100000:1.0:1782759386.806279:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197207168 00000100:00100000:1.0:1782759386.806283:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197207168 00000100:00100000:2.0:1782759386.806284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2473 00000100:00100000:2.0:1782759386.806297:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197206912:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759386.806312:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1926 00000100:00100000:1.0:1782759386.806322:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197207040:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759386.806383:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197207040:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759386.806384:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197206784 00000100:00100000:0.0:1782759386.806391:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197206784 00000100:00100000:1.0:1782759386.806396:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1926 00000100:00100000:1.0:1782759386.806420:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1927 00000100:00100000:1.0:1782759386.806429:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197207168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759386.806434:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2599 00000100:00100000:0.0:1782759386.806445:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197206784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759386.806463:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197207168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.806471:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1927 00000100:00100000:0.0:1782759386.806481:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197206784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759386.806497:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2599 00000100:00080000:1.0:1782759386.806499:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759386.806505:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759386.806508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759386.806573:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197206912:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 278us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.806582:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2473 00000020:00000080:2.0:1782759387.132083:0:136033:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc276d9860 20000000:00000080:2.0:1782759387.132097:0:136033:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b3000 uarg=0000000000000000 00010000:00010000:2.0:1782759387.132304:0:136033:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759387.132328:0:136033:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759387.132345:0:136033:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759387.132364:0:136033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.132381:0:136033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777debad expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.132389:0:136033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.132423:0:136033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777debad expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.132436:0:136033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777debad expref: 18 pid: 5796 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759387.132451:0:136033:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:136033:1869355211899008:0@lo:104: 00000100:00100000:2.0:1782759387.132511:0:136033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.132564:0:136033:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b77719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759387.132566:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211899008 00000100:00100000:3.0:1782759387.132575:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211899008 00000100:00100000:3.0:1782759387.132641:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1782759387.132650:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:136033:x1869355211899008:12345-0@lo:104: 00010000:00010000:3.0:1782759387.132663:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759387.132731:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759387.132739:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:136033:x1869355211899008:12345-0@lo:104: Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.132753:0:136033:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:136033:1869355211899008:0@lo:104: 00000100:00100000:3.0:1782759387.132759:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00010000:00010000:2.0:1782759387.132774:0:136033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.132845:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759387.132853:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.132861:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759387.132865:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.132873:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759387.132880:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759387.132887:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759387.132917:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.132924:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759387.132957:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.132965:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777debad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777debb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.132978:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759387.132980:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759387.132982:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759387.132985:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759387.132996:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211899136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759387.133025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759387.133076:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211899136 00000100:00100000:0.0:1782759387.133085:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211899136 00010000:00010000:0.0:1782759387.133103:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777debad expref: 19 pid: 5796 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759387.133125:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1782759387.133130:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718904d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211899136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759387.133140:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759387.133145:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777debad expref: 19 pid: 5796 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133155:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777debad expref: 19 pid: 5796 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133165:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777debb4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777debad expref: 19 pid: 5796 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133176:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133181:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133191:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133195:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133199:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133203:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133212:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759387.133214:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133219:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133232:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759387.133238:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759387.133264:0:136033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.133275:0:136033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759387.133281:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718904d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211899136:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (252us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759387.133288:0:136033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777debbb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759387.133294:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1782759387.133301:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211899136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759387.756679:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759388.077019:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211899264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759388.077086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759388.077173:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211899264 00000100:00100000:1.0:1782759388.077181:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211899264 00000100:00080000:3.0:1782759388.077214:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759388.077238:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1782759388.077247:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211899264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759388.077283:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759388.077330:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211899264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759388.077337:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1782759388.077356:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211899264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759388.416747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.416820:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197207296 00000100:00100000:3.0:1782759388.416904:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197207296 00000100:00100000:3.0:1782759388.417037:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1836 00000100:00100000:3.0:1782759388.417050:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:96121:x1869355197207296:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759388.417071:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.417095:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777debc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c79 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.417157:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777debc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.417170:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777debc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.417183:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777debc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759388.417415:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782759388.417419:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759388.417523:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777debc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.417547:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777debc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c79 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.417592:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777debc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c79 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.417604:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759388.417608:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759388.417611:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcce00, rc 0) 00000100:00100000:3.0:1782759388.417675:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:96121:x1869355197207296:12345-192.168.204.31@tcp:101:touch.0 Request processed in 628us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759388.417682:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1836 00000100:00080000:1.0:1782759388.417713:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759388.419937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759388.420226:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197207424 00000100:00100000:2.0:1782759388.420237:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197207424 00000100:00100000:2.0:1782759388.420291:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1837 00000100:00100000:2.0:1782759388.420300:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:96121:x1869355197207424:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759388.420317:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759388.420343:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777debd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c80 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.420397:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.420410:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.420421:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.420435:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.420443:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.420451:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422163:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777debe5 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422179:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777debe5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422189:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777debe5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759388.422315:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759388.422319:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759388.422393:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777debe5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422411:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422418:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422425:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422431:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759388.422435:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422443:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422458:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782759388.422461:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759388.422466:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422473:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777debd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422484:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422491:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422496:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422507:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759388.422510:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422516:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422525:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1362df6 (ffff9171c08f6e00) 00010000:00010000:2.0:1782759388.422528:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759388.422530:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422536:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777debde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1362df6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422590:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777debd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c80 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422605:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777debe5 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c80 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.422613:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:2.0:1782759388.422615:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759388.422618:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65c00, rc 0) 00000100:00100000:2.0:1782759388.422703:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:96121:x1869355197207424:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2403us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.422712:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1837 00000100:00100000:2.0:1782759388.426140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.426285:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197207680 00000100:00100000:3.0:1782759388.426299:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197207680 00000100:00100000:3.0:1782759388.426383:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1838 00000100:00100000:3.0:1782759388.426399:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:96121:x1869355197207680:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759388.426430:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.426457:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777debec lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c87 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.427242:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.427269:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.427284:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.428700:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.428727:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.428740:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759388.430152:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e:0x0], index 1: 0 00010000:00010000:3.0:1782759388.430612:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dec01 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430627:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dec01 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430638:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dec01 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430679:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430687:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430693:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430699:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.430704:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430711:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430734:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:3.0:1782759388.430738:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.430743:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430748:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777debf3 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759388.430762:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001417e5ae reply state 00000000c48dd32b transno 4294967992 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759388.430771:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759388.430813:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777debec lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c87 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430877:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dec01 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c87 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.430886:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1300) 00010000:00010000:3.0:1782759388.430889:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759388.430894:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759388.430978:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96121:x1869355197207680:12345-192.168.204.31@tcp:101:touch.0 Request processed in 4583us (4853us total) trans 4294967992 rc 0/0 00000100:00100000:3.0:1782759388.430988:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1838 00010000:00010000:1.0:1782759388.435353:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.435396:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.435405:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.435411:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.435418:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.435429:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.435453:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171908a1000) 00010000:00010000:1.0:1782759388.435458:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759388.435463:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.435471:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777debfa lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.436250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.436311:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197207936 00000100:00100000:1.0:1782759388.436322:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197207936 00000100:00100000:1.0:1782759388.436376:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1839 00000100:00100000:1.0:1782759388.436384:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:96121:x1869355197207936:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782759388.436445:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759388.436465:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dec01 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c87 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.436488:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1300) 00010000:00010000:1.0:1782759388.436498:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759388.436570:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.436586:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.436598:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759388.436796:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000271e4700 reply state 00000000a7b583f9 transno 4294967993 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.436808:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759388.436980:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96121:x1869355197207936:12345-192.168.204.31@tcp:36:touch.0 Request processed in 592us (733us total) trans 4294967993 rc 0/0 00000100:00100000:1.0:1782759388.436988:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1839 00010000:00010000:2.0:1782759388.437981:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.437992:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.438000:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.438007:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759388.438012:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.438020:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.438034:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171889c5400) 00010000:00010000:2.0:1782759388.438038:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759388.438042:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 2/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.438049:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dec0f lrc: 0/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.438587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.438643:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197208064 00000100:00100000:3.0:1782759388.438652:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197208064 00000100:00100000:3.0:1782759388.438715:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1840 00000100:00100000:3.0:1782759388.438732:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:96121:x1869355197208064:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759388.438815:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.438884:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777dec16 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c8e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.438953:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777dec16 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c8e expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.438970:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777dec16 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c8e expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.438993:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.438996:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759388.438999:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759388.439058:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96121:x1869355197208064:12345-192.168.204.31@tcp:101:touch.0 Request processed in 333us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759388.439066:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1840 00000100:00100000:2.0:1782759388.442917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.443421:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197208192 00000100:00100000:3.0:1782759388.443434:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197208192 00000100:00080000:0.0:1782759388.443518:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759388.443527:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 942 00000100:00100000:3.0:1782759388.443539:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197208192:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:3.0:1782759388.444155:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197208192:12345-192.168.204.31@tcp:2:touch.0 Request processed in 618us (1249us total) trans 4294967386 rc 0/0 00000100:00100000:3.0:1782759388.444165:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 942 00000100:00100000:2.0:1782759388.446228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.446286:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197208448 00000100:00100000:3.0:1782759388.446297:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197208448 00000100:00100000:3.0:1782759388.446352:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 242 00000100:00100000:3.0:1782759388.446360:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96121:x1869355197208448:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759388.446980:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:96121:x1869355197208448:12345-192.168.204.31@tcp:35:touch.0 Request processed in 617us (759us total) trans 4294967994 rc 0/0 00000100:00100000:3.0:1782759388.446988:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 242 00000100:00100000:2.0:1782759388.463076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.463202:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197208576 00000100:00100000:3.0:1782759388.463217:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197208576 00000100:00100000:3.0:1782759388.463298:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1841 00000100:00100000:3.0:1782759388.463309:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:96124:x1869355197208576:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782759388.463344:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.463369:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec1d lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c95 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463448:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463472:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463488:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463505:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463514:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463519:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463639:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463661:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463667:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759388.463705:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759388.463708:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759388.463736:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463746:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463754:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463759:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463763:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463767:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.463770:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463775:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463786:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:3.0:1782759388.463788:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.463796:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463801:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec24 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463812:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463816:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463852:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463859:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.463863:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463869:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463877:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171908a1900) 00010000:00010000:3.0:1782759388.463879:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.463881:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463885:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec2b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463911:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec1d lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c95 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463931:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c95 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.463936:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.463938:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759388.463940:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759388.464012:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:96124:x1869355197208576:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 704us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759388.464020:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1841 00000100:00100000:2.0:1782759388.466248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.466314:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197208704 00000100:00100000:1.0:1782759388.466329:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197208704 00000100:00100000:1.0:1782759388.466387:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 943 00000100:00100000:1.0:1782759388.466396:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197208704:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759388.466415:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759388.466447:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66c9c expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759388.466478:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x6a42bfdb, atime: 0x6a42bfdb, ctime: 0x6a42bfdb, blocks: 0x1 00010000:00010000:1.0:1782759388.466496:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=3456s v=(0 0) 00010000:00010000:1.0:1782759388.466511:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759388.466520:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.466539:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.466550:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782759388.466617:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197208704:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 222us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759388.466623:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 943 00000100:00100000:2.0:1782759388.469536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.469606:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197208960 00000100:00100000:1.0:1782759388.469620:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197208960 00000100:00100000:1.0:1782759388.469676:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1842 00000100:00100000:1.0:1782759388.469685:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:96124:x1869355197208960:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782759388.469739:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759388.469765:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dec32 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c95 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.469784:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.469789:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759388.469812:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.469859:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.469870:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759388.470068:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002aa68a16 reply state 000000009ee91ae3 transno 4294967995 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.470078:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759388.470162:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96124:x1869355197208960:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 478us (636us total) trans 4294967995 rc 0/0 00000100:00100000:1.0:1782759388.470169:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1842 00010000:00010000:1.0:1782759388.471263:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.471274:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.471281:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.471287:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.471291:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.471299:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.471310:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.471313:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759388.471316:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.471322:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec40 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.471447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759388.471528:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197209088 00000100:00100000:0.0:1782759388.471537:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197209088 00000100:00100000:0.0:1782759388.471596:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 944 00000100:00100000:0.0:1782759388.471606:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197209088:12345-192.168.204.31@tcp:2:chmod.0 00002000:00010000:0.0:1782759388.471767:0:126932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759388.471771:0:126932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 1782759387 -> 1782759387 00002000:00010000:0.0:1782759388.471774:0:126932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb atime from disk: 1782759387 -> 1782759387 00002000:00010000:0.0:1782759388.471776:0:126932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 1782759387 -> 1782759387 00002000:00010000:0.0:1782759388.471779:0:126932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759388.471845:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197209088:12345-192.168.204.31@tcp:2:chmod.0 Request processed in 220us (382us total) trans 4294967387 rc 0/0 00000100:00100000:0.0:1782759388.471863:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 944 00000100:00100000:2.0:1782759388.484327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.484383:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197209216 00000100:00100000:3.0:1782759388.484393:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197209216 00000100:00100000:3.0:1782759388.484456:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1843 00000100:00100000:3.0:1782759388.484466:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:96125:x1869355197209216:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782759388.484491:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.484510:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec47 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ca3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484596:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484615:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484629:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484641:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484659:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484664:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484779:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484787:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484794:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759388.484867:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759388.484871:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759388.484897:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484910:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484918:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484926:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484932:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484947:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.484951:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484959:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484971:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:3.0:1782759388.484974:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.484979:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484985:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec4e lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.484998:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485005:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485011:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485016:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.485019:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485030:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485048:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171908a1900) 00010000:00010000:3.0:1782759388.485050:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.485053:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485059:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec55 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485089:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec47 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ca3 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485103:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ca3 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.485110:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.485112:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759388.485114:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759388.485170:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96125:x1869355197209216:12345-192.168.204.31@tcp:101:chown.0 Request processed in 705us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759388.485178:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1843 00000100:00100000:2.0:1782759388.488130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.488166:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197209344 00000100:00100000:3.0:1782759388.488175:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197209344 00000100:00100000:3.0:1782759388.488219:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1844 00000100:00100000:3.0:1782759388.488229:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96125:x1869355197209344:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:3.0:1782759388.488246:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.488262:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dec63 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66caa expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.488309:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.488319:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.488326:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.488396:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dec63 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.488409:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 14 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.488417:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.488420:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759388.488423:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759388.488478:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:96125:x1869355197209344:12345-192.168.204.31@tcp:101:chown.0 Request processed in 251us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759388.488485:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1844 00000100:00100000:2.0:1782759388.490253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.490473:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197209600 00000100:00100000:1.0:1782759388.490481:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197209600 00000100:00100000:1.0:1782759388.490534:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1845 00000100:00100000:1.0:1782759388.490543:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:96125:x1869355197209600:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782759388.490590:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759388.490609:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dec5c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ca3 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.490625:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.490627:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759388.490644:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.490652:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.490658:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759388.491356:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].42, 88 off10928 00000004:00080000:1.0:1782759388.491368:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3456894544678ns, next at 3457894542499ns, rc = 0 00000004:00010000:1.0:1782759388.491451:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040324e08 reply state 00000000538fe3f2 transno 4294967996 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.491460:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759388.491542:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:96125:x1869355197209600:12345-192.168.204.31@tcp:36:chown.0 Request processed in 1000us (1293us total) trans 4294967996 rc 0/0 00000100:00100000:1.0:1782759388.491548:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1845 00010000:00010000:3.0:1782759388.492453:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.492463:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.492470:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.492493:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.492498:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.492505:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.492518:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.492520:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759388.492523:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.492528:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dec71 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.492889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.492926:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197209728 00000100:00100000:3.0:1782759388.492933:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197209728 00000100:00100000:3.0:1782759388.492974:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 945 00000100:00100000:3.0:1782759388.492983:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197209728:12345-192.168.204.31@tcp:2:chown.0 00002000:00010000:3.0:1782759388.493190:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759388.493194:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 1782759387 -> 1782759387 00002000:00010000:3.0:1782759388.493196:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb atime from disk: 1782759387 -> 1782759387 00002000:00010000:3.0:1782759388.493198:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 1782759387 -> 1782759387 00002000:00010000:3.0:1782759388.493200:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782759388.493248:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197209728:12345-192.168.204.31@tcp:2:chown.0 Request processed in 265us (360us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1782759388.493256:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 945 00000100:00100000:2.0:1782759388.502167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.502266:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197209856 00000100:00100000:3.0:1782759388.502295:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197209856 00000100:00100000:3.0:1782759388.502368:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00100000:3.0:1782759388.502378:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:96126:x1869355197209856:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:3.0:1782759388.502415:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.502450:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dec78 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cb1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502541:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502575:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502588:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502605:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502612:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502619:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502755:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502765:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502781:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759388.502880:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759388.502886:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759388.502957:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502972:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502983:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502990:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.502997:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503004:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.503008:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503017:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503032:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:3.0:1782759388.503035:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.503041:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503048:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dec7f lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503073:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503080:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503086:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503104:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.503107:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503113:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503121:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171908a1900) 00010000:00010000:3.0:1782759388.503124:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759388.503127:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503132:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dec86 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503176:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dec78 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cb1 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503189:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cb1 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.503210:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.503213:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759388.503216:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:3.0:1782759388.503296:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:96126:x1869355197209856:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 920us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759388.503304:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00100000:2.0:1782759388.505765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.505859:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197210112 00000100:00100000:3.0:1782759388.505873:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197210112 00000100:00100000:3.0:1782759388.505965:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1847 00000100:00100000:3.0:1782759388.505978:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:96126:x1869355197210112:12345-192.168.204.31@tcp:36:chgrp.0 00010000:00010000:3.0:1782759388.506053:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759388.506084:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777dec8d lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cb1 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.506108:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.506114:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759388.506146:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.506160:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.506169:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759388.506535:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].43, 88 off11016 00000004:00010000:3.0:1782759388.506627:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e3f6a02 reply state 0000000062667683 transno 4294967997 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759388.506643:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759388.506741:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96126:x1869355197210112:12345-192.168.204.31@tcp:36:chgrp.0 Request processed in 765us (988us total) trans 4294967997 rc 0/0 00000100:00100000:3.0:1782759388.506748:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1847 00010000:00010000:1.0:1782759388.507682:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.507694:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.507702:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.507709:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.507714:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.507722:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.507734:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.507737:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759388.507741:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.507747:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dec94 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.508162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.508208:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197210240 00000100:00100000:1.0:1782759388.508214:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197210240 00000100:00100000:1.0:1782759388.508258:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 946 00000100:00100000:1.0:1782759388.508266:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2364:x1869355197210240:12345-192.168.204.31@tcp:2:chgrp.0 00002000:00010000:1.0:1782759388.508433:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782759388.508436:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 1782759387 -> 1782759387 00002000:00010000:1.0:1782759388.508438:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb atime from disk: 1782759387 -> 1782759387 00002000:00010000:1.0:1782759388.508446:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 1782759387 -> 1782759387 00002000:00010000:1.0:1782759388.508447:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782759388.508482:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2364:x1869355197210240:12345-192.168.204.31@tcp:2:chgrp.0 Request processed in 218us (322us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1782759388.508488:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 946 00000100:00100000:2.0:1782759388.564106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.564330:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197210368 00000100:00100000:1.0:1782759388.564339:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197210368 00000100:00100000:1.0:1782759388.564429:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1848 00000100:00100000:1.0:1782759388.564439:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:96127:x1869355197210368:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759388.564462:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759388.564483:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dec9b lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cb8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564532:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564543:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564550:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564573:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564584:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564590:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564701:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564710:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564717:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759388.564752:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782759388.564757:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759388.564776:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564787:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564794:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564800:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564806:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564811:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.564815:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564853:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564877:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:1.0:1782759388.564880:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759388.564885:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564892:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777deca2 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564906:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564912:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564917:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564923:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.564925:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564932:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564939:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5c00) 00010000:00010000:1.0:1782759388.564942:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759388.564944:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564948:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777deca9 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564979:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dec9b lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cb8 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564988:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cb8 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.564993:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.564994:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759388.564996:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759388.565041:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96127:x1869355197210368:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 603us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759388.565047:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1848 00000100:00100000:2.0:1782759388.568303:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.568357:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197210624 00000100:00100000:3.0:1782759388.568366:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197210624 00000100:00100000:3.0:1782759388.568418:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1849 00000100:00100000:3.0:1782759388.568428:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96127:x1869355197210624:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759388.568521:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759388.568539:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decb7 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cbf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.568668:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.568682:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.568694:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759388.568706:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782759388.568868:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decb7 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.568887:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.568924:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.568926:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759388.568930:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759388.568984:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96127:x1869355197210624:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 557us (690us total) trans 4294967998 rc 0/0 00000100:00100000:3.0:1782759388.568991:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1849 00000100:00100000:2.0:1782759388.570921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759388.571007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.571137:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197211008 00000100:00100000:3.0:1782759388.571153:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197211008 00000100:00100000:3.0:1782759388.571224:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1850 00000100:00100000:3.0:1782759388.571272:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96127:x1869355197211008:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759388.571345:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759388.571377:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777decb0 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cb8 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.571400:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.571405:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759388.571429:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.571445:0:7487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.571454:0:7487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.571463:0:7487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 5/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.571518:0:7487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.571529:0:7487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 17 pid: 5803 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759388.571541:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355211899392:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759388.571690:0:7487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759388.571696:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197210752 00010000:00010000:3.0:1782759388.571703:0:7487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759388.571709:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197210752 00000100:00100000:3.0:1782759388.571718:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355211899520:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759388.571758:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023f00 going to sleep for 11 seconds 00010000:00010000:0.0:1782759388.571775:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 5/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 18 pid: 5803 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759388.571849:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 562 00000100:00100000:0.0:1782759388.571861:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:2364:x1869355197210752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759388.571877:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759388.571885:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 5/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 18 pid: 5803 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759388.571897:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 18 pid: 5803 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759388.571924:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:0.0:1782759388.571930:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759388.571939:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759388.571945:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759388.571999:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:2364:x1869355197210752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 140us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759388.572007:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 562 00010000:00010000:3.0:1782759388.573316:0:7487:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@00000000eb1c6ed4 x1869355211899392) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 1/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 17 pid: 5803 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.573338:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decbe lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cbf expref: 17 pid: 5803 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759388.573403:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355211899392:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759388.573414:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355211899520:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759388.573433:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.573481:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.573489:0:7487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.573613:0:7487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.573662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.573765:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197211136 00000100:00100000:1.0:1782759388.573772:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197211136 00010000:00010000:1.0:1782759388.573800:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.573906:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 563 00000100:00100000:1.0:1782759388.573913:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:2362:x1869355197211136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759388.573927:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759388.573931:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.573940:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.573965:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dec6a lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66caa expref: 17 pid: 7487 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.573973:0:134476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.573976:0:134476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.573983:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.573988:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.574010:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759388.574024:0:7487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.574031:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.574056:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:2362:x1869355197211136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 142us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759388.574062:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 563 00000040:00080000:3.0:1782759388.574772:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].44, 88 off11104 00000004:00010000:3.0:1782759388.574894:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b77baa49 reply state 000000000b5756bd transno 4294967999 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759388.574901:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759388.574984:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96127:x1869355197211008:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 3718us (3977us total) trans 4294967999 rc 0/0 00000100:00100000:3.0:1782759388.574990:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1850 00010000:00010000:3.0:1782759388.576311:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.576322:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.576327:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.576344:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.576349:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.576358:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.576374:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.576378:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759388.576382:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 2/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.576389:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777deccc lrc: 0/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759388.576668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759388.576809:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197211392 00000100:00100000:0.0:1782759388.576997:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197211392 00000100:00100000:0.0:1782759388.577060:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 243 00000100:00100000:0.0:1782759388.577072:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96127:x1869355197211392:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759388.577453:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96127:x1869355197211392:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 383us (787us total) trans 4294968000 rc 0/0 00000100:00100000:0.0:1782759388.577462:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 243 00000100:00100000:2.0:1782759388.584983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759388.585091:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197211520 00000100:00100000:1.0:1782759388.585113:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197211520 00000100:00100000:1.0:1782759388.585211:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1851 00000100:00100000:1.0:1782759388.585221:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96128:x1869355197211520:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759388.585253:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759388.585273:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777decd3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cc6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585349:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585382:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585400:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585416:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585423:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585430:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585537:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585546:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585553:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759388.585599:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782759388.585603:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759388.585624:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585635:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585655:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585679:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585685:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585691:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.585695:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585702:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585715:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:1.0:1782759388.585718:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759388.585722:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585729:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777decda lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585741:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585747:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585753:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585778:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.585781:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585787:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585796:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5c00) 00010000:00010000:1.0:1782759388.585798:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759388.585801:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585807:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dece1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585866:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777decd3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cc6 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585883:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cc6 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.585891:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:1.0:1782759388.585893:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759388.585895:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782759388.585963:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96128:x1869355197211520:12345-192.168.204.31@tcp:101:rm.0 Request processed in 744us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759388.585970:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1851 00000100:00100000:2.0:1782759388.588642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759388.588683:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197211776 00000100:00100000:3.0:1782759388.588693:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197211776 00000100:00100000:3.0:1782759388.588750:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1852 00000100:00100000:3.0:1782759388.589478:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96128:x1869355197211776:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782759388.589526:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782759388.589550:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dece8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cc6 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589764:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777dec16 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c8e expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589776:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759388.589786:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759388.589817:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 3/0,1 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589872:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589882:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589898:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589905:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.589912:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590008:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 3/0,1 mode: --/EX res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590015:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590021:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759388.590584:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].45, 64 off11168 00010000:00010000:3.0:1782759388.590641:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590651:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590670:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590678:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590685:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590690:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590715:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759388.590737:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590743:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590749:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590756:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759388.590759:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590767:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590775:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759388.590778:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759388.590787:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 2/0,0 mode: --/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590795:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777decfd lrc: 0/0,0 mode: --/EX res: [0x200000418:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590803:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759388.590811:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590812:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590846:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590853:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590863:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759388.590865:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759388.590870:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590872:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590890:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590891:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590912:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x2:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759388.590913:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:2.0:1782759388.590917:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782759388.590919:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759388.590923:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 1/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590925:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759388.590936:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777decef lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759388.590953:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000201e4a0c reply state 00000000bf7f3b6f transno 4294968001 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590954:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777ded04 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.590980:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759388.590983:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759388.590985:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759388.590985:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759388.591064:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96128:x1869355197211776:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2305us (2425us total) trans 4294968001 rc 0/0 00000100:00100000:3.0:1782759388.591077:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1852 00010000:00010000:1.0:1782759388.593262:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.593295:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.593304:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.593310:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759388.593315:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.593323:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.593343:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171908a1900) 00010000:00010000:1.0:1782759388.593346:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759388.593350:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.593357:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777decf6 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759388.780278:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759388.958715:0:136229:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0f1e30d0 20000000:00000080:1.0:1782759388.958731:0:136229:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d2c00 uarg=0000000000000000 00010000:00010000:1.0:1782759388.959181:0:136229:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782759388.959212:0:136229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:1.0:1782759388.959216:0:136229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759388.959227:0:136229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777debc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c79 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959250:0:136229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:1.0:1782759388.959257:0:136229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759388.959261:0:136229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777debe5 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c80 expref: 15 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959276:0:136229:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 2 locks, left on hash table 0. 10000000:01000000:1.0:1782759388.959290:0:136229:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759388.959303:0:136229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959316:0:136229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959326:0:136229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959333:0:136229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959340:0:136229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959347:0:136229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959353:0:136229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759388.959357:0:136229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959364:0:136229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959373:0:136229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959385:0:136229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.959391:0:136229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777ded0b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759389.100103:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759389.100111:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759389.100116:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759389.100170:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759389.100183:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759389.100199:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759389.100226:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211899648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759389.100301:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759389.100383:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759389.100610:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211899648 00000100:00100000:1.0:1782759389.100617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211899648 00000100:00100000:1.0:1782759389.100669:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1782759389.100678:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211899648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759389.100701:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759389.100715:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777ded12 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759389.100736:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759389.100747:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759389.100755:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759389.100796:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211899648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759389.100804:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1782759389.100867:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211899648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759389.100882:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759389.100892:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759389.100912:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759389.100931:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759389.100938:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759389.805204:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759390.125047:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211899776:0@lo:400:kworker.0 00000100:00100000:3.0:1782759390.125131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759390.125188:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211900288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759390.125210:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211899904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759390.125219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759390.125251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759390.125263:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211899776 00000100:00100000:3.0:1782759390.125272:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211899776 00000100:00100000:2.0:1782759390.125282:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211900416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759390.125314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759390.125328:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:3.0:1782759390.125339:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211899776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759390.125353:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211900032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759390.125391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759390.125400:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211899776:12345-0@lo:400:kworker.0 Request processed in 62us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759390.125408:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1782759390.125415:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759390.125426:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211900160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759390.125445:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900288 00000100:00100000:3.0:1782759390.125449:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211899904 00000100:00100000:3.0:1782759390.125453:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211899904 00000100:00100000:2.0:1782759390.125457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759390.125457:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900288 00000100:00100000:3.0:1782759390.125488:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900032 00000100:00100000:3.0:1782759390.125491:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900032 00000100:00100000:1.0:1782759390.125507:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:1.0:1782759390.125606:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211899904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759390.125657:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211899904:12345-0@lo:400:kworker.0 Request processed in 55us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759390.125863:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1782759390.125873:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1782759390.125881:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1782759390.125886:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211900288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759390.125893:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211900032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759390.125933:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211900288:12345-0@lo:400:kworker.0 Request processed in 50us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759390.125944:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1782759390.125946:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211900032:12345-0@lo:400:kworker.0 Request processed in 54us (552us total) trans 0 rc 0/0 00000100:00080000:1.0:1782759390.125951:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759390.125955:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:1.0:1782759390.125996:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900416 00000100:00100000:1.0:1782759390.126002:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900416 00000100:00100000:3.0:1782759390.126015:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211900288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759390.126016:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211900032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759390.126035:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211899776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759390.126048:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900160 00000100:00100000:1.0:1782759390.126053:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900160 00000100:00100000:2.0:1782759390.126078:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211899904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759390.126088:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:1.0:1782759390.126097:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1782759390.126100:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211900416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759390.126110:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211900160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759390.126145:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211900416:12345-0@lo:400:kworker.0 Request processed in 48us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759390.126152:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1782759390.126157:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211900416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759390.126171:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211900160:12345-0@lo:400:kworker.0 Request processed in 64us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759390.126181:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1782759390.126194:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211900160:0@lo:400:kworker.0 00000100:00080000:1.0:1782759390.126202:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759390.126207:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759390.194938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.195032:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197212032 00000100:00100000:1.0:1782759390.195042:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197212032 00000100:00080000:2.0:1782759390.195113:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759390.195125:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1853 00000100:00100000:1.0:1782759390.195139:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:96201:x1869355197212032:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759390.195164:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759390.195184:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777ded20 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ccd expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.195389:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.195404:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.195428:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.195443:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.195451:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.195458:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759390.196040:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f:0x0], index 0: 0 00010000:00010000:1.0:1782759390.196205:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777ded35 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196217:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777ded35 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196226:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777ded35 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196258:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196266:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196273:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196279:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.196290:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196298:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196311:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759390.196315:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759390.196319:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196327:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded27 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759390.196339:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab0e446a reply state 00000000ceb42ed6 transno 4294968002 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759390.196348:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759390.196375:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777ded20 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ccd expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196396:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777ded35 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ccd expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.196404:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759390.196407:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759390.196409:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759390.196485:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96201:x1869355197212032:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1348us (1551us total) trans 4294968002 rc 0/0 00000100:00100000:1.0:1782759390.196493:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1853 00010000:00010000:0.0:1782759390.197532:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.197542:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.197549:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.197555:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759390.197559:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.197566:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.197578:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5000) 00010000:00010000:0.0:1782759390.197581:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759390.197584:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.197591:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777ded2e lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759390.198160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759390.198213:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197212288 00000100:00100000:0.0:1782759390.198221:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197212288 00000100:00100000:0.0:1782759390.198276:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1854 00000100:00100000:0.0:1782759390.198289:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96201:x1869355197212288:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782759390.198330:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759390.198345:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777ded35 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ccd expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.198370:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:0.0:1782759390.198379:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759390.198411:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.198421:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.198430:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759390.198545:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060a1f3e6 reply state 000000001e3aa858 transno 4294968003 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759390.198553:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759390.198615:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96201:x1869355197212288:12345-192.168.204.31@tcp:36:touch.0 Request processed in 330us (458us total) trans 4294968003 rc 0/0 00000100:00100000:0.0:1782759390.198625:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1854 00010000:00010000:1.0:1782759390.200300:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.200311:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.200318:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.200324:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.200331:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759390.200332:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1782759390.200343:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.200359:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759390.200362:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759390.200368:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.200374:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777ded43 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759390.200383:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197212416 00000100:00100000:0.0:1782759390.200390:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197212416 00000100:00100000:0.0:1782759390.200439:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1855 00000100:00100000:0.0:1782759390.200448:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96201:x1869355197212416:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759390.200468:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759390.200484:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777ded4a lrc: 2/0,0 mode: --/CR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cd4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.200536:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777ded4a lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cd4 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.200547:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777ded4a lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cd4 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.200561:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759390.200563:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759390.200565:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759390.200605:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96201:x1869355197212416:12345-192.168.204.31@tcp:101:touch.0 Request processed in 158us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759390.200613:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1855 00000100:00100000:2.0:1782759390.202169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759390.202609:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197212544 00000100:00100000:3.0:1782759390.202617:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197212544 00000100:00080000:2.0:1782759390.202679:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759390.202683:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 947 00000100:00100000:3.0:1782759390.202694:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197212544:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:3.0:1782759390.203290:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197212544:12345-192.168.204.31@tcp:2:touch.0 Request processed in 597us (1123us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1782759390.203300:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 947 00000100:00100000:2.0:1782759390.205263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759390.205304:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197212800 00000100:00100000:3.0:1782759390.205314:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197212800 00000100:00100000:3.0:1782759390.205353:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 244 00000100:00100000:3.0:1782759390.205361:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96201:x1869355197212800:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759390.205719:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96201:x1869355197212800:12345-192.168.204.31@tcp:35:touch.0 Request processed in 357us (459us total) trans 4294968004 rc 0/0 00000100:00100000:3.0:1782759390.205729:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 244 00000100:00100000:0.0:1782759390.212871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759390.212940:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197212928 00000100:00100000:2.0:1782759390.212951:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197212928 00000100:00100000:2.0:1782759390.213005:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1856 00000100:00100000:2.0:1782759390.213016:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96202:x1869355197212928:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759390.213041:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759390.213064:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777ded51 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cdb expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213121:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213134:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213146:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213160:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213166:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213172:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213269:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213287:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213295:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759390.213329:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:2.0:1782759390.213334:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759390.213354:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213363:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213369:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213374:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213378:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213381:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759390.213384:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213389:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213397:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:2.0:1782759390.213399:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759390.213408:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213412:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777ded58 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213420:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213423:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213427:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213431:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759390.213433:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213439:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213447:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171c08f6d00) 00010000:00010000:2.0:1782759390.213449:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759390.213452:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213458:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777ded5f lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213488:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777ded51 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cdb expref: 21 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213517:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cdb expref: 20 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.213539:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:2.0:1782759390.213542:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759390.213544:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64e00, rc 0) 00000100:00100000:2.0:1782759390.213620:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96202:x1869355197212928:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 605us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759390.213628:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1856 00000100:00100000:2.0:1782759390.215645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759390.216592:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197213056 00000100:00100000:0.0:1782759390.216602:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197213056 00000100:00100000:0.0:1782759390.216664:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 948 00000100:00100000:0.0:1782759390.216678:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197213056:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759390.216699:0:126932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759390.216721:0:126932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ce2 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759390.216763:0:126932:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x6a42bfdd, atime: 0x6a42bfdd, ctime: 0x6a42bfdd, blocks: 0x1 00010000:00010000:0.0:1782759390.216783:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=3458s v=(0 0) 00010000:00010000:0.0:1782759390.216788:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759390.216798:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.216815:0:126932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.216863:0:126932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99a00, rc 0) 00000100:00100000:0.0:1782759390.216924:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197213056:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 250us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759390.216933:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 948 00000100:00100000:3.0:1782759390.218989:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759390.219092:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197213312 00000100:00100000:0.0:1782759390.219104:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197213312 00000100:00100000:0.0:1782759390.219165:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1857 00000100:00100000:0.0:1782759390.219175:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96202:x1869355197213312:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782759390.219232:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759390.219254:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777ded66 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cdb expref: 20 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219270:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759390.219274:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759390.219303:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219329:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219338:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219370:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219377:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219384:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219390:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759390.219394:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219400:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219406:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759390.219408:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759390.219410:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.219414:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded74 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759390.219483:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96202:x1869355197213312:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 309us (511us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759390.219495:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1857 00000100:00100000:1.0:1782759390.226972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759390.227211:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197213440 00000100:00100000:0.0:1782759390.227221:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197213440 00000100:00100000:0.0:1782759390.227298:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1858 00000100:00100000:0.0:1782759390.227310:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96203:x1869355197213440:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782759390.227332:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759390.227355:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded7b lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ce9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227417:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227432:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227443:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227458:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227465:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227471:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227579:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227601:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227609:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759390.227643:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:0.0:1782759390.227648:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759390.227667:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227678:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227686:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227692:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227697:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227703:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759390.227706:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227713:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227724:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759390.227727:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759390.227738:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227744:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777ded82 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227757:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227762:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227767:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227772:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759390.227774:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227779:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227787:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70700) 00010000:00010000:0.0:1782759390.227789:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759390.227792:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227796:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777ded89 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227876:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777ded7b lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce9 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227910:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce9 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.227918:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759390.227920:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759390.227923:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759390.227987:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96203:x1869355197213440:12345-192.168.204.31@tcp:101:chown.0 Request processed in 680us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759390.227995:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1858 00000100:00100000:2.0:1782759390.230277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.230332:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197213568 00000100:00100000:1.0:1782759390.230342:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197213568 00000100:00100000:1.0:1782759390.230392:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1859 00000100:00100000:1.0:1782759390.230401:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96203:x1869355197213568:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782759390.230421:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759390.230437:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded97 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cf0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.230478:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.230490:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.230500:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.230599:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777ded97 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 22 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.230615:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 21 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.230624:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.230627:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759390.230630:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4000, rc 0) 00000100:00100000:1.0:1782759390.230685:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96203:x1869355197213568:12345-192.168.204.31@tcp:101:chown.0 Request processed in 285us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759390.230692:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1859 00000100:00100000:3.0:1782759390.231911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.232022:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197213824 00000100:00100000:1.0:1782759390.232038:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197213824 00000100:00100000:1.0:1782759390.232082:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1860 00000100:00100000:1.0:1782759390.232092:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96203:x1869355197213824:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782759390.232132:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759390.232155:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777ded90 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce9 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232178:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.232182:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759390.232202:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232214:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232221:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232324:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232331:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232337:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232343:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.232348:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232355:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232366:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.232369:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759390.232373:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.232385:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777deda5 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759390.232439:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96203:x1869355197213824:12345-192.168.204.31@tcp:36:chown.0 Request processed in 349us (530us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759390.232444:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1860 00000100:00100000:0.0:1782759390.239116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.239257:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197213952 00000100:00100000:1.0:1782759390.239266:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197213952 00000100:00100000:1.0:1782759390.239325:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1861 00000100:00100000:1.0:1782759390.239336:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96204:x1869355197213952:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:1.0:1782759390.239357:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759390.239376:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dedac lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cf7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239424:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239434:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239442:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239450:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239455:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239474:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239568:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239573:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239578:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759390.239604:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:1.0:1782759390.239607:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759390.239623:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239631:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239637:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239641:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239645:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239648:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.239650:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239661:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239671:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759390.239674:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759390.239678:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239684:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dedb3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239703:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239710:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239716:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239721:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.239724:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239730:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239738:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5e00) 00010000:00010000:1.0:1782759390.239740:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759390.239743:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239758:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dedba lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239783:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dedac lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf7 expref: 22 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239793:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf7 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.239798:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.239799:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759390.239801:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759390.239888:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96204:x1869355197213952:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 555us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759390.239895:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1861 00000100:00100000:2.0:1782759390.241800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.241909:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197214208 00000100:00100000:1.0:1782759390.241921:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197214208 00000100:00100000:1.0:1782759390.241977:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00100000:1.0:1782759390.241988:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96204:x1869355197214208:12345-192.168.204.31@tcp:36:chgrp.0 00010000:00010000:1.0:1782759390.242032:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759390.242053:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dedc1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf7 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242069:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.242073:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759390.242095:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242113:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242119:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242143:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242148:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242152:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242156:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.242160:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242167:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242174:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.242176:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759390.242180:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.242186:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777dedc8 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759390.242256:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96204:x1869355197214208:12345-192.168.204.31@tcp:36:chgrp.0 Request processed in 270us (468us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759390.242269:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00100000:2.0:1782759390.251937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.251996:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197214336 00000100:00100000:1.0:1782759390.252005:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197214336 00000100:00100000:1.0:1782759390.252062:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1863 00000100:00100000:1.0:1782759390.252072:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96205:x1869355197214336:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759390.252092:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759390.252114:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dedcf lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66cfe expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252173:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252186:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252197:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252207:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252214:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252220:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252307:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252330:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252337:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759390.252368:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:1.0:1782759390.252372:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759390.252390:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252401:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252409:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252415:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252421:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252426:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.252430:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252436:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252447:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759390.252450:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759390.252460:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252467:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dedd6 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252480:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252486:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252492:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252497:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.252499:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252505:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252512:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5900) 00010000:00010000:1.0:1782759390.252515:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759390.252517:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252537:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777deddd lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252567:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dedcf lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cfe expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252595:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cfe expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.252602:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.252604:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759390.252606:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782759390.252665:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96205:x1869355197214336:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 595us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759390.252672:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1863 00000100:00100000:0.0:1782759390.256038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.256084:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197214592 00000100:00100000:1.0:1782759390.256092:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197214592 00000100:00100000:1.0:1782759390.256143:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1864 00000100:00100000:1.0:1782759390.256153:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96205:x1869355197214592:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759390.256174:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759390.256196:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dedeb lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d05 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.256290:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777dedf2 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.256304:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777dedf2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.256314:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777dedf2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759390.256323:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00010000:00010000:1.0:1782759390.256454:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dedeb lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d05 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.256478:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777dedf2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d05 expref: 23 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.256484:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.256486:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782759390.256488:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759390.256551:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+23:96205:x1869355197214592:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 399us (517us total) trans 4294968005 rc 0/0 00000100:00100000:1.0:1782759390.256558:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1864 00000100:00100000:2.0:1782759390.258442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759390.258572:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197214848 00000100:00100000:1.0:1782759390.258580:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197214848 00000100:00100000:1.0:1782759390.258631:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1865 00000100:00100000:1.0:1782759390.258640:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+23:96205:x1869355197214848:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759390.258689:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759390.258712:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dede4 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cfe expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.258730:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.258734:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759390.258754:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.258766:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 22 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.258792:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 4/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.258848:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 22 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.258860:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 22 pid: 5801 timeout: 3558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759390.258874:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211900544:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759390.258965:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759390.260491:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211900544:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759390.260519:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759390.260799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759390.260943:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197214976 00000100:00100000:3.0:1782759390.260949:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197214976 00010000:00010000:3.0:1782759390.260983:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 23 pid: 5801 timeout: 3558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759390.261026:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 564 00000100:00100000:3.0:1782759390.261035:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+23:2362:x1869355197214976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759390.261050:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759390.261057:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 23 pid: 5801 timeout: 3558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.261066:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 23 pid: 5801 timeout: 3558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.261080:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777ded9e lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cf0 expref: 23 pid: 5801 timeout: 3558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.261090:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:3.0:1782759390.261093:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.261099:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.261105:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.261122:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759390.261142:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261151:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759390.261160:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:2362:x1869355197214976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759390.261166:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 564 00010000:00010000:1.0:1782759390.261194:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261200:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261204:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261214:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759390.261217:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261229:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261237:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:1.0:1782759390.261239:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782759390.261242:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.261246:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee00 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759390.261304:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96205:x1869355197214848:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 2664us (2867us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759390.261312:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1865 00000004:00080000:2.0:1782759390.635992:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3459039166747ns, next at 3460039163927ns, rc = 0 00000100:00100000:1.0:1782759390.635994:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759390.636020:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211900672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759390.636087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759390.636135:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900672 00000100:00100000:2.0:1782759390.636144:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900672 00000100:00100000:2.0:1782759390.636201:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1782759390.636214:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211900672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759390.636251:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759390.636311:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211900672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759390.636319:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1782759390.636337:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211900672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759390.828464:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759390.991989:0:136473:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdde0123f0 20000000:00000080:3.0:1782759390.992006:0:136473:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a1c00 uarg=0000000000000000 00010000:00010000:3.0:1782759390.994093:0:136473:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782759390.994131:0:136473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:3.0:1782759390.994135:0:136473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782759390.994146:0:136473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777dedf2 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d05 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.994164:0:136473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70c00) 00010000:00010000:3.0:1782759390.994166:0:136473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759390.994170:0:136473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777ded4a lrc: 0/0,0 mode: --/CR res: [0x200000418:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66cd4 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.994186:0:136473:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 2 locks, left on hash table 0. 10000000:01000000:3.0:1782759390.994228:0:136473:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759390.994242:0:136473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.994253:0:136473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.994261:0:136473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.994295:0:136473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759390.994324:0:136473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 18 pid: 5796 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759390.994340:0:136473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:136473:1869355211900800:0@lo:104: 00000100:00100000:3.0:1782759390.994400:0:136473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759390.994439:0:136473:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b77710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759390.994534:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900800 00000100:00100000:0.0:1782759390.994541:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900800 00000100:00100000:0.0:1782759390.994580:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1782759390.994587:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:136473:x1869355211900800:12345-0@lo:104: 00010000:00010000:0.0:1782759390.994598:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.994673:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759390.994679:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:136473:x1869355211900800:12345-0@lo:104: Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759390.994686:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00010000:00010000:2.0:1782759390.994703:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759390.994717:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.994724:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759390.994728:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.994736:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759390.994766:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759390.994772:0:136473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:136473:1869355211900800:0@lo:104: 10000000:01000000:2.0:1782759390.994774:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759390.994794:0:136473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.994818:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.994842:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759390.994869:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.994875:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777ded12 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777ded19 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.994887:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759390.994889:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759390.994890:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759390.994900:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211900928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759390.994937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759390.994986:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211900928 00000100:00100000:0.0:1782759390.994990:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211900928 00010000:00010000:0.0:1782759390.995008:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 19 pid: 5796 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759390.995044:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1782759390.995052:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211900928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759390.995062:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759390.995067:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 19 pid: 5796 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995076:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 19 pid: 5796 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995087:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777ded19 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777ded12 expref: 19 pid: 5796 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995097:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995102:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995111:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995115:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995119:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995123:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995133:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759390.995136:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995140:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995153:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759390.995163:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759390.995181:0:136473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759390.995189:0:136473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759390.995194:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211900928:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (257us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759390.995196:0:136473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777dee07 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759390.995201:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1782759390.995226:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211900928:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1782759391.367737:0:136521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcefba3c10 20000000:00000080:2.0:1782759391.367755:0:136521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b3400 uarg=0000000000000000 00010000:00010000:2.0:1782759391.368096:0:136521:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759391.368112:0:136521:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759391.368129:0:136521:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759391.368149:0:136521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368165:0:136521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368176:0:136521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368182:0:136521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368190:0:136521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368197:0:136521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368203:0:136521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759391.368208:0:136521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368216:0:136521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368231:0:136521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368239:0:136521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.368252:0:136521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777dee0e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759391.764648:0:136569:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9c54d9f0 20000000:00000080:3.0:1782759391.764667:0:136569:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d7c00 uarg=0000000000000000 00010000:00010000:3.0:1782759391.764934:0:136569:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759391.764950:0:136569:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759391.764966:0:136569:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759391.764987:0:136569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765003:0:136569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765012:0:136569:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765019:0:136569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765026:0:136569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765033:0:136569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765040:0:136569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759391.765051:0:136569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765059:0:136569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765072:0:136569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765081:0:136569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759391.765087:0:136569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee15 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.851959:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759391.923950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759391.924000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759391.924042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759391.924055:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215104 00000100:00100000:2.0:1782759391.924090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759391.924131:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215360 00000100:00100000:2.0:1782759391.924139:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215360 00000100:00100000:3.0:1782759391.924157:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215488 00000100:00100000:0.0:1782759391.924160:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215232 00000100:00100000:3.0:1782759391.924166:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215488 00000100:00100000:0.0:1782759391.924175:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215232 00000100:00100000:2.0:1782759391.924217:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00100000:1.0:1782759391.924225:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215104 00000100:00100000:3.0:1782759391.924228:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1931 00000100:00100000:2.0:1782759391.924233:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197215360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759391.924243:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2363:x1869355197215488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759391.924270:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2602 00000100:00100000:1.0:1782759391.924282:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197215104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759391.924326:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2477 00000100:00100000:2.0:1782759391.924345:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197215360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759391.924352:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197215104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 60us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759391.924354:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:2363:x1869355197215232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759391.924357:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2363:x1869355197215488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759391.924387:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00100000:1.0:1782759391.924388:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2602 00000100:00100000:3.0:1782759391.924397:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1931 00000100:00080000:3.0:1782759391.924429:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759391.924449:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:2363:x1869355197215232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 108us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759391.924459:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2477 00000020:00000080:0.0:1782759392.159247:0:136617:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2bcd8680 20000000:00000080:0.0:1782759392.159265:0:136617:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbe000 uarg=0000000000000000 00010000:00010000:0.0:1782759392.159514:0:136617:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759392.159530:0:136617:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759392.159546:0:136617:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759392.159567:0:136617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159589:0:136617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159600:0:136617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159607:0:136617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159614:0:136617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159621:0:136617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159628:0:136617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759392.159633:0:136617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159640:0:136617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159653:0:136617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159660:0:136617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.159666:0:136617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dee1c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759392.707194:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967387 is committed 00000001:00080000:2.0:1782759392.707302:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967389 is committed 00000001:00080000:2.0:1782759392.708415:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968003 is committed 00000001:00080000:2.0:1782759392.708439:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968005 is committed 00000004:00080000:2.0:1782759392.708464:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 117 committed 00000004:00080000:2.0:1782759392.708517:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 118 committed 00000100:00100000:2.0:1782759392.708709:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211901056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759392.708856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759392.709065:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901056 00000100:00100000:0.0:1782759392.709075:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901056 00000100:00100000:0.0:1782759392.709142:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1782759392.709155:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211901056:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1782759392.709307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1782759392.709527:0:126932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759392.709532:0:126932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 1782759387 -> 1782759387 00002000:00010000:0.0:1782759392.709535:0:126932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb atime from disk: 1782759387 -> 1782759387 00002000:00010000:0.0:1782759392.709538:0:126932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 1782759387 -> 1782759387 00002000:00010000:0.0:1782759392.709540:0:126932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759392.709624:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211901056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 472us (805us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1782759392.709633:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000004:00080000:2.0:1782759392.709770:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7d08700/2, rc 0, transno 4294967390 00000100:00100000:2.0:1782759392.709790:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211901056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759392.709902:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759392.709968:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211901184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759392.710068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759392.710174:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901184 00000100:00100000:3.0:1782759392.710179:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901184 00000100:00100000:3.0:1782759392.710312:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1782759392.710320:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211901184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1782759392.710401:0:9120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759392.710410:0:9120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 1782759387 -> 1782759387 00002000:00010000:3.0:1782759392.710413:0:9120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb atime from disk: 1782759387 -> 1782759387 00002000:00010000:3.0:1782759392.710415:0:9120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 1782759387 -> 1782759387 00002000:00010000:3.0:1782759392.710418:0:9120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782759392.710460:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1869355211901184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (392us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1782759392.710467:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000004:00080000:2.0:1782759392.710532:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170826b8000/2, rc 0, transno 4294967391 00000100:00100000:2.0:1782759392.710546:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211901184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759392.710636:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211901312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759392.710672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759392.710702:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901312 00000100:00100000:2.0:1782759392.710706:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901312 00000100:00100000:2.0:1782759392.710728:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:2.0:1782759392.710735:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1869355211901312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1782759392.710809:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759392.710812:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 1782759387 -> 1782759387 00002000:00010000:2.0:1782759392.710815:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb atime from disk: 1782759387 -> 1782759387 00002000:00010000:2.0:1782759392.710817:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 1782759387 -> 1782759387 00002000:00010000:2.0:1782759392.710820:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759392.710880:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1869355211901312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (219us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1782759392.710888:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000004:00080000:2.0:1782759392.710915:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b2322a00/2, rc 0, transno 4294967392 00000100:00100000:2.0:1782759392.710928:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211901312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782759392.711158:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211901440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782759392.711204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759392.711268:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901440 00000100:00100000:1.0:1782759392.711273:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901440 00000100:00100000:1.0:1782759392.711313:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1782759392.711322:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1869355211901440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782759392.711336:0:126932:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:46 count 1 00010000:00010000:1.0:1782759392.711352:0:126932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.711372:0:126932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 5 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.711393:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782759392.711398:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759392.711402:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.711425:0:126932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 5 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.711434:0:126932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 5 pid: 6599 timeout: 3561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759392.711443:0:126932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:126932:1869355211901568:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759392.711510:0:126932:0:(client.c:2701:ptlrpc_set_wait()) set ffff917186999300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759392.714233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759392.714350:0:126932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:126932:1869355211901568:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759392.714368:0:126932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759392.715407:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215616 00000100:00100000:3.0:1782759392.715606:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215616 00010000:00010000:3.0:1782759392.715650:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 6 pid: 6599 timeout: 3561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759392.715890:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 566 00000100:00100000:3.0:1782759392.715901:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197215616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759392.715916:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759392.715923:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 6 pid: 6599 timeout: 3561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759392.715939:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 6 pid: 6599 timeout: 3561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759392.715965:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490c61f2/0xdd99f5c4777dec39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c9c expref: 6 pid: 6599 timeout: 3561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759392.715983:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759392.715987:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759392.716021:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759392.716032:0:134476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759392.716066:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759392.716119:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197215616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 219us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759392.716129:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 566 00010000:00010000:1.0:1782759392.716142:0:126932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.716153:0:126932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.716163:0:126932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.716177:0:126932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.716251:0:126932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782759392.716842:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3306:x1869355211901440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5500us (5615us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1782759392.716851:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000004:00080000:2.0:1782759392.717119:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171bb963100/2, rc 0, transno 4294967393 00000100:00100000:2.0:1782759392.717126:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211901440:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782759392.717181:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759392.717189:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.717198:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759392.717202:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.717212:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.717236:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.717243:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f724d6cd/0xdd99f5c4777dee23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759392.717261:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759392.717263:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759392.717264:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759392.875901:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759393.003907:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759393.003914:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759393.003920:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759393.003973:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759393.003986:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759393.003999:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759393.004026:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211901696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759393.004095:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759393.004151:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759393.004324:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901696 00000100:00100000:3.0:1782759393.004333:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901696 00000100:00100000:3.0:1782759393.004392:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1782759393.004402:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211901696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759393.004415:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759393.004430:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dee2a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.004454:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.004465:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.004489:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759393.004539:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211901696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759393.004547:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1782759393.004558:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211901696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759393.004585:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.004595:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759393.004616:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759393.004622:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.004631:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759393.196647:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211901824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759393.196750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759393.196789:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901824 00000100:00100000:2.0:1782759393.196800:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901824 00000100:00100000:2.0:1782759393.196888:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00080000:3.0:1782759393.196896:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759393.196898:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211901824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759393.196931:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759393.196984:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211901824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759393.196991:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1782759393.197047:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211901824:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1782759393.216778:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967395 is committed 00000020:00000080:2.0:1782759393.848762:0:136817:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc7c13280 20000000:00000080:2.0:1782759393.848775:0:136817:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082d65800 uarg=0000000000000000 10000000:01000000:2.0:1782759393.849134:0:136817:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759393.849149:0:136817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.849162:0:136817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.849179:0:136817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.849216:0:136817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.849293:0:136817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 18 pid: 5794 timeout: 3562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759393.849306:0:136817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:136817:1869355211901952:0@lo:104: 00000100:00100000:2.0:1782759393.849367:0:136817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759393.849420:0:136817:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759393.849423:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759393.849438:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211901952 00000100:00100000:1.0:1782759393.849445:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211901952 00000100:00100000:1.0:1782759393.849509:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1782759393.849520:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:136817:x1869355211901952:12345-0@lo:104: 00010000:00010000:1.0:1782759393.849534:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759393.849596:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759393.849603:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:136817:x1869355211901952:12345-0@lo:104: Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759393.849610:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:3.0:1782759393.849624:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759393.849628:0:136817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:136817:1869355211901952:0@lo:104: 00010000:00010000:3.0:1782759393.849634:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849644:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759393.849649:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.849653:0:136817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849660:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759393.849669:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759393.849675:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759393.849704:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849711:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759393.849733:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849740:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777dee2a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759393.849755:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211902080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759393.849757:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759393.849777:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759393.849780:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759393.849786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759393.849884:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902080 00000100:00100000:3.0:1782759393.849889:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902080 00010000:00010000:3.0:1782759393.849908:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 19 pid: 5794 timeout: 3562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759393.849933:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1782759393.849941:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211902080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759393.849951:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759393.849956:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 19 pid: 5794 timeout: 3562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849967:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 19 pid: 5794 timeout: 3562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849977:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dee31 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dee2a expref: 19 pid: 5794 timeout: 3562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849988:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.849996:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850009:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850015:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850021:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850038:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850042:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759393.850046:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850065:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850079:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759393.850090:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759393.850091:0:136817:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.850098:0:136817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.850102:0:136817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee38 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759393.850138:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211902080:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759393.850148:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1782759393.850161:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211902080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759393.902667:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759394.208427:0:136865:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6f10fd60 20000000:00000080:1.0:1782759394.208458:0:136865:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082734800 uarg=0000000000000000 10000000:01000000:1.0:1782759394.208665:0:136865:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759394.208689:0:136865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208709:0:136865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208721:0:136865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208728:0:136865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208734:0:136865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208742:0:136865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208749:0:136865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759394.208754:0:136865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208761:0:136865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208774:0:136865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208781:0:136865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759394.208797:0:136865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031000/0xdd99f5c4777dee3f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759394.570175:0:136913:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcec63ec10 20000000:00000080:2.0:1782759394.570193:0:136913:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b1800 uarg=0000000000000000 00010000:00010000:2.0:1782759394.570397:0:136913:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759394.570411:0:136913:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759394.570432:0:136913:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759394.570463:0:136913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570478:0:136913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570487:0:136913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570494:0:136913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570501:0:136913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570508:0:136913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570514:0:136913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759394.570518:0:136913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570526:0:136913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570538:0:136913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570546:0:136913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.570559:0:136913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dee46 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 136913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759394.924943:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759395.244105:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211902592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.244131:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211902208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.244217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.244219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.244300:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211902720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759395.244305:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759395.244331:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211902464:0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.244341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.244383:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782759395.244392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.244397:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211902336:0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.244454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.244458:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902592 00000100:00100000:0.0:1782759395.244469:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902592 00000100:00100000:3.0:1782759395.244487:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211902848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.244536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.244566:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902848 00000100:00100000:0.0:1782759395.244572:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902848 00000100:00100000:0.0:1782759395.244628:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1782759395.244632:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902208 00000100:00100000:3.0:1782759395.244642:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902208 00000100:00100000:0.0:1782759395.244642:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211902592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.244700:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1782759395.244713:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211902208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759395.244736:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211902592:12345-0@lo:400:kworker.0 Request processed in 95us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.244751:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1782759395.244790:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211902208:12345-0@lo:400:kworker.0 Request processed in 78us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.244793:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1782759395.244809:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:0.0:1782759395.244814:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3305:x1869355211902848:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759395.244889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759395.244898:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759395.244915:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3305:x1869355211902848:12345-0@lo:400:kworker.0 Request processed in 101us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.244926:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1782759395.244956:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902720 00000100:00100000:3.0:1782759395.244957:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211902848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759395.244965:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902720 00000100:00100000:0.0:1782759395.244966:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902464 00000100:00100000:0.0:1782759395.244974:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902464 00000100:00100000:3.0:1782759395.244979:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211902208:0@lo:400:kworker.0 00000100:00100000:1.0:1782759395.245050:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902336 00000100:00100000:1.0:1782759395.245054:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902336 00000100:00100000:0.0:1782759395.245070:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1782759395.245093:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1782759395.245093:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211902720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759395.245113:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211902464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759395.245166:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211902720:12345-0@lo:400:kworker.0 Request processed in 83us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.245180:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1782759395.245206:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211902464:12345-0@lo:400:kworker.0 Request processed in 96us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.245221:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1782759395.245229:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:0.0:1782759395.245241:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211902336:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759395.245262:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759395.245292:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211902336:12345-0@lo:400:kworker.0 Request processed in 53us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.245310:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:0.0:1782759395.245389:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211902464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759395.245401:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211902592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759395.245456:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211902336:0@lo:400:kworker.0 00000100:00100000:0.0:1782759395.245478:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211902720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759395.756120:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211902976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759395.756233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.756287:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211902976 00000100:00100000:2.0:1782759395.756298:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211902976 00000100:00100000:2.0:1782759395.756357:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1782759395.756370:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3307:x1869355211902976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759395.756410:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759395.756521:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3307:x1869355211902976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.756529:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1782759395.756629:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211902976:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1782759395.883904:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759395.883913:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759395.883919:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759395.883971:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.883984:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.883995:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.884021:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211903104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759395.884079:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.884139:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.884154:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211903104 00000100:00100000:3.0:1782759395.884162:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211903104 00000100:00100000:3.0:1782759395.884220:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1782759395.884229:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211903104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759395.884242:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.884254:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dee4d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.884276:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.884284:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.884305:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd800, rc 0) 00000100:00100000:3.0:1782759395.884339:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211903104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.884344:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1782759395.884377:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211903104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759395.884396:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.884402:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759395.884429:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759395.884433:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.884439:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.948042:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759396.524387:0:137156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe68060570 20000000:00000080:2.0:1782759396.524420:0:137156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082d66400 uarg=0000000000000000 00010000:00010000:2.0:1782759396.524774:0:137156:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759396.524887:0:137156:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759396.524907:0:137156:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759396.524928:0:137156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.524944:0:137156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.524953:0:137156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.524993:0:137156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.525024:0:137156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 18 pid: 5794 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.525047:0:137156:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137156:1869355211903232:0@lo:104: 00000100:00100000:2.0:1782759396.525117:0:137156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.525170:0:137156:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759396.525245:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211903232 00000100:00100000:3.0:1782759396.525254:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211903232 00000100:00100000:3.0:1782759396.525321:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1782759396.525331:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137156:x1869355211903232:12345-0@lo:104: 00010000:00010000:3.0:1782759396.525342:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.525426:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759396.525433:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137156:x1869355211903232:12345-0@lo:104: Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.525441:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1782759396.525455:0:137156:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137156:1869355211903232:0@lo:104: 00010000:00010000:0.0:1782759396.525464:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.525475:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.525480:0:137156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525488:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759396.525495:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525504:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759396.525512:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759396.525518:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759396.525553:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525562:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759396.525586:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525605:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777dee4d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee54 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.525616:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782759396.525622:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.525626:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.525628:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759396.525630:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211903360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759396.525663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.525702:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211903360 00000100:00100000:0.0:1782759396.525707:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211903360 00010000:00010000:0.0:1782759396.525732:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 19 pid: 5794 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.525766:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1782759396.525774:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718904e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211903360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.525785:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.525790:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 19 pid: 5794 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525800:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 19 pid: 5794 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525813:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777dee54 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dee4d expref: 19 pid: 5794 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525844:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525853:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525878:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525886:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525893:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525899:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525906:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759396.525911:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525918:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525936:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.525947:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759396.525983:0:137156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.525993:0:137156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.526001:0:137156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777dee5b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.526003:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718904e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211903360:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.526020:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1782759396.526467:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211903360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759396.973110:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759397.045526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759397.045582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759397.045623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759397.045717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759397.045726:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215744 00000100:00100000:3.0:1782759397.045737:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215744 00000100:00100000:2.0:1782759397.045769:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197216128 00000100:00100000:2.0:1782759397.045776:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197216128 00000100:00100000:3.0:1782759397.045796:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2606 00000100:00100000:2.0:1782759397.045853:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197216000 00000100:00100000:2.0:1782759397.045858:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197216000 00000100:00100000:2.0:1782759397.045885:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00100000:2.0:1782759397.045908:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197216128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759397.045933:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197215744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759397.045992:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197215744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 185us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.046010:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2606 00000100:00100000:1.0:1782759397.046021:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197215872 00000100:00100000:1.0:1782759397.046028:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197215872 00000100:00100000:1.0:1782759397.046066:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2481 00000100:00100000:1.0:1782759397.046076:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197215872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759397.046141:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197216128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 235us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.046148:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00100000:2.0:1782759397.046163:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1935 00000100:00100000:2.0:1782759397.046170:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197216000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759397.046197:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197216000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.046204:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1935 00000100:00080000:2.0:1782759397.046239:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759397.046245:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759397.046248:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759397.046384:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197215872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 309us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.046403:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2481 00000001:00080000:3.0:1782759397.840397:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967390 is committed 00000001:00080000:3.0:1782759397.840415:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967393 is committed 00000100:00100000:3.0:1782759397.914494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759397.918770:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197216384 00000100:00100000:1.0:1782759397.918784:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197216384 00000100:00100000:1.0:1782759397.918863:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1866 00000100:00100000:1.0:1782759397.918874:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:96487:x1869355197216384:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759397.918895:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.918930:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777dee62 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d0c expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919594:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919609:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919622:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919635:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919642:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919649:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919890:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777dee77 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919899:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777dee77 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.919960:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777dee77 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759397.919974:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00010000:00010000:1.0:1782759397.920099:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920108:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920121:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920127:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759397.920132:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920140:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920151:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759397.920154:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.920158:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920165:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777dee69 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920182:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920188:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920194:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920199:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759397.920341:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920358:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920367:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5000) 00010000:00010000:1.0:1782759397.920370:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.920383:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920390:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777dee70 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920434:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777dee62 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d0c expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920455:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777dee77 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d0c expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.920462:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759397.920464:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759397.920467:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031800, rc 0) 00000100:00100000:1.0:1782759397.920533:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:96487:x1869355197216384:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1661us (6048us total) trans 4294968006 rc 0/0 00000100:00100000:1.0:1782759397.920542:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1866 00000100:00100000:0.0:1782759397.923356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759397.923536:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197216640 00000100:00100000:1.0:1782759397.923545:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197216640 00000100:00100000:1.0:1782759397.923588:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1867 00000100:00100000:1.0:1782759397.923596:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:96487:x1869355197216640:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782759397.923646:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759397.923668:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777dee77 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d0c expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.923682:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759397.923691:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759397.923728:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.923739:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.923749:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759397.923921:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057e763d2 reply state 00000000e2a82ee1 transno 4294968007 ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.923931:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759397.924251:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:96487:x1869355197216640:12345-192.168.204.31@tcp:36:touch.0 Request processed in 655us (901us total) trans 4294968007 rc 0/0 00000100:00100000:1.0:1782759397.924258:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1867 00010000:00010000:0.0:1782759397.926224:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926247:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926255:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926262:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759397.926267:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926275:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926291:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171889c5500) 00010000:00010000:0.0:1782759397.926295:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.926299:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926305:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777dee85 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.926568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759397.926743:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197216768 00000100:00100000:3.0:1782759397.926751:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197216768 00000100:00100000:3.0:1782759397.926797:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 953 00000100:00100000:3.0:1782759397.926806:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197216768:12345-192.168.204.31@tcp:2:touch.0 00002000:00010000:3.0:1782759397.927111:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759397.927115:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759389 -> 1782759397 00002000:00010000:3.0:1782759397.927118:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759389 -> 1782759397 00002000:00010000:3.0:1782759397.927120:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759389 -> 1782759397 00002000:00010000:3.0:1782759397.927123:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782759397.927175:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197216768:12345-192.168.204.31@tcp:2:touch.0 Request processed in 370us (609us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1782759397.927185:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 953 00000100:00100000:3.0:1782759397.929543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759397.929573:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197217024 00000100:00100000:3.0:1782759397.929579:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197217024 00000100:00100000:3.0:1782759397.929618:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 245 00000100:00100000:3.0:1782759397.929628:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:96487:x1869355197217024:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759397.929984:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:96487:x1869355197217024:12345-192.168.204.31@tcp:35:touch.0 Request processed in 358us (446us total) trans 4294968008 rc 0/0 00000100:00100000:3.0:1782759397.929990:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 245 10000000:01000000:3.0:1782759397.933466:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759397.933481:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759397.933487:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759397.933534:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.933560:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.933573:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.933600:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211903488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759397.933665:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.933879:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211903488 00000100:00100000:2.0:1782759397.933888:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211903488 00000100:00100000:2.0:1782759397.933942:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1782759397.933952:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211903488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759397.933966:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759397.933983:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dee8c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.934010:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.934021:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.934042:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65000, rc 0) 00000100:00100000:2.0:1782759397.934556:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211903488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 603us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.934563:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759397.934564:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:3.0:1782759397.934591:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211903488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759397.934607:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.934616:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759397.934634:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759397.934640:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.934647:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.938465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759397.938535:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197217152 00000100:00100000:2.0:1782759397.938545:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197217152 00000100:00100000:2.0:1782759397.938993:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1868 00000100:00100000:2.0:1782759397.939005:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:96488:x1869355197217152:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759397.939031:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759397.939171:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777dee9a lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d13 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939231:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939244:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939254:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939265:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939272:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939278:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939638:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939648:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939655:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759397.939689:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:2.0:1782759397.939693:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759397.939713:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939723:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939732:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939738:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939745:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939751:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759397.939755:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939762:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941081:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759397.941088:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.941094:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941102:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777deea1 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941116:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941123:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941130:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941135:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759397.941138:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941145:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941153:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171c08f6300) 00010000:00010000:2.0:1782759397.941156:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.941158:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941164:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777deea8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941217:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777dee9a lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d13 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941232:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d13 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.941239:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759397.941241:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759397.941243:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64c00, rc 0) 00000100:00100000:2.0:1782759397.941318:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:96488:x1869355197217152:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2315us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.941327:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1868 00000100:00100000:2.0:1782759397.944790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759397.944877:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197217408 00000100:00100000:3.0:1782759397.944888:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197217408 00000100:00100000:3.0:1782759397.944946:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 246 00000100:00100000:3.0:1782759397.944957:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:96488:x1869355197217408:12345-192.168.204.31@tcp:35:chmod.0 00000100:00100000:3.0:1782759397.945190:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96488:x1869355197217408:12345-192.168.204.31@tcp:35:chmod.0 Request processed in 234us (406us total) trans 4294968009 rc 0/0 00000100:00100000:3.0:1782759397.945199:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 246 00000100:00100000:2.0:1782759397.946327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759397.946406:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197217664 00000100:00100000:1.0:1782759397.946412:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197217664 00000100:00100000:1.0:1782759397.946460:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1869 00000100:00100000:1.0:1782759397.946471:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96488:x1869355197217664:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782759397.946513:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759397.946542:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777deeaf lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d13 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.946566:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777dedf2) 00010000:00010000:1.0:1782759397.946570:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:1.0:1782759397.946590:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759397.946626:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.946639:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.946650:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759397.946872:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e871082 reply state 00000000e7c33920 transno 4294968010 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.946883:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759397.946956:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:96488:x1869355197217664:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 487us (628us total) trans 4294968010 rc 0/0 00000100:00100000:1.0:1782759397.946964:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1869 00010000:00010000:1.0:1782759397.948256:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.948307:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.948315:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.948322:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759397.948338:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.948347:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.948360:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759397.948364:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759397.948368:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.948386:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deeb6 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.948737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759397.948778:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197217792 00000100:00100000:0.0:1782759397.948784:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197217792 00000100:00100000:0.0:1782759397.948911:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 954 00000100:00100000:0.0:1782759397.948922:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197217792:12345-192.168.204.31@tcp:2:chmod.0 00002000:00010000:0.0:1782759397.949169:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759397.949173:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759397 -> 1782759397 00002000:00010000:0.0:1782759397.949177:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759397 -> 1782759397 00002000:00010000:0.0:1782759397.949180:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759397 -> 1782759397 00002000:00010000:0.0:1782759397.949188:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759397.949277:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197217792:12345-192.168.204.31@tcp:2:chmod.0 Request processed in 355us (542us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1782759397.949285:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 954 00000100:00100000:2.0:1782759397.958985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759397.959059:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197217920 00000100:00100000:0.0:1782759397.959069:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197217920 00000100:00100000:0.0:1782759397.959136:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1870 00000100:00100000:0.0:1782759397.959146:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:96489:x1869355197217920:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782759397.959169:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.959191:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777deebd lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d1a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959255:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959267:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959278:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959289:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959296:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959301:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959633:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959646:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959654:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759397.959701:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:0.0:1782759397.959706:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759397.959728:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959740:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959749:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959765:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959772:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959778:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759397.959783:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959798:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959810:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759397.959814:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.959843:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959850:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deec4 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959866:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959871:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959877:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959882:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759397.959885:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959890:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959897:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70d00) 00010000:00010000:0.0:1782759397.959899:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.959902:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959907:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deecb lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.959935:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777deebd lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d1a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.960129:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d1a expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.960137:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759397.960140:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759397.960142:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759397.960215:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:96489:x1869355197217920:12345-192.168.204.31@tcp:101:chown.0 Request processed in 1070us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.960222:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1870 00000100:00100000:2.0:1782759397.964943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759397.965022:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197218048 00000100:00100000:1.0:1782759397.965041:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197218048 00000100:00100000:1.0:1782759397.965095:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1871 00000100:00100000:1.0:1782759397.965105:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:96489:x1869355197218048:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782759397.965125:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.965146:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deed9 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d21 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.965181:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.965195:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.965206:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.965301:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777deed9 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.965327:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.965337:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759397.965340:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759397.965344:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031000, rc 0) 00000100:00100000:1.0:1782759397.965421:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:96489:x1869355197218048:12345-192.168.204.31@tcp:101:chown.0 Request processed in 317us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.965428:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1871 00000100:00100000:2.0:1782759397.969252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759397.969793:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197218304 00000100:00100000:1.0:1782759397.969803:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197218304 00000100:00100000:1.0:1782759397.970471:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1872 00000100:00100000:1.0:1782759397.970483:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:96489:x1869355197218304:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:1.0:1782759397.970534:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759397.970559:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777deed2 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d1a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.970584:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759397.970588:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759397.970616:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.970629:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.970638:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759397.972559:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].47, 88 off11272 00000004:00080000:1.0:1782759397.972575:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3466375751287ns, next at 3467375748004ns, rc = 0 00000004:00010000:1.0:1782759397.972664:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ae3e06f reply state 00000000fdfa7114 transno 4294968011 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.972677:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759397.972795:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96489:x1869355197218304:12345-192.168.204.31@tcp:36:chown.0 Request processed in 2312us (3547us total) trans 4294968011 rc 0/0 00000100:00100000:1.0:1782759397.972803:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1872 00000100:00100000:3.0:1782759397.975217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782759397.975246:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.975257:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.975265:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.975271:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759397.975275:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.975307:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.975324:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00000100:00100000:1.0:1782759397.975326:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197218432 00010000:00010000:0.0:1782759397.975329:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759397.975334:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.975336:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197218432 00010000:00010000:0.0:1782759397.975363:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777deee7 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.975398:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 955 00000100:00100000:1.0:1782759397.975407:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197218432:12345-192.168.204.31@tcp:2:chown.0 00002000:00010000:1.0:1782759397.975575:0:126932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782759397.975578:0:126932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759397 -> 1782759397 00002000:00010000:1.0:1782759397.975579:0:126932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759397 -> 1782759397 00002000:00010000:1.0:1782759397.975581:0:126932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759397 -> 1782759397 00002000:00010000:1.0:1782759397.975583:0:126932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782759397.975624:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2362:x1869355197218432:12345-192.168.204.31@tcp:2:chown.0 Request processed in 219us (412us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1782759397.975629:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 955 00000100:00100000:2.0:1782759397.987808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759397.988432:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197218560 00000100:00100000:0.0:1782759397.988443:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197218560 00000100:00100000:0.0:1782759397.988514:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1873 00000100:00100000:0.0:1782759397.988526:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:96490:x1869355197218560:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:0.0:1782759397.988552:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.988573:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777deeee lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d28 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.988639:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.988655:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.988668:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.988682:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.988689:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.988695:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989269:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989284:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989290:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759397.989327:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:0.0:1782759397.989331:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759397.989355:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989367:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989388:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989394:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989400:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989407:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759397.989412:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989419:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989436:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759397.989440:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.989451:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989458:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deef5 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989475:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989481:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989487:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989493:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759397.989496:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989501:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989510:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70d00) 00010000:00010000:0.0:1782759397.989512:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.989515:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989521:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777deefc lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989553:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777deeee lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d28 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989579:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d28 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.989585:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759397.989587:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759397.989589:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99c00, rc 0) 00000100:00100000:0.0:1782759397.989665:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96490:x1869355197218560:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 1141us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.989671:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1873 00000100:00100000:2.0:1782759397.994064:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759397.994214:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197218816 00000100:00100000:0.0:1782759397.994224:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197218816 00000100:00100000:0.0:1782759397.994278:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1874 00000100:00100000:0.0:1782759397.994287:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96490:x1869355197218816:12345-192.168.204.31@tcp:36:chgrp.0 00010000:00010000:0.0:1782759397.994334:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759397.994363:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def03 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d28 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.994393:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759397.994399:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759397.994482:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.994495:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.994505:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759397.995012:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].48, 88 off11360 00000004:00010000:0.0:1782759397.995133:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b239e5eb reply state 00000000aa804ff6 transno 4294968012 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759397.995142:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759397.995273:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:96490:x1869355197218816:12345-192.168.204.31@tcp:36:chgrp.0 Request processed in 985us (1217us total) trans 4294968012 rc 0/0 00000100:00100000:0.0:1782759397.995280:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1874 00010000:00010000:0.0:1782759397.995932:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759397.997060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1782759397.997060:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.997072:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.997104:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759397.997104:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197218944 00000100:00100000:0.0:1782759397.997112:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197218944 00010000:00010000:1.0:1782759397.997114:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759397.997120:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.997128:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.997143:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759397.997146:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759397.997151:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759397.997158:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 956 00010000:00010000:1.0:1782759397.997159:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777def0a lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759397.997167:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197218944:12345-192.168.204.31@tcp:2:chgrp.0 00002000:00010000:0.0:1782759397.997341:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759397.997345:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759397 -> 1782759397 00002000:00010000:0.0:1782759397.997348:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759397 -> 1782759397 00002000:00010000:0.0:1782759397.997350:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759397 -> 1782759397 00002000:00010000:0.0:1782759397.997352:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759397.997416:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2361:x1869355197218944:12345-192.168.204.31@tcp:2:chgrp.0 Request processed in 251us (359us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1782759397.997422:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 956 00000100:00100000:2.0:1782759398.005694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759398.006181:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197219072 00000100:00100000:1.0:1782759398.006190:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197219072 00000100:00100000:1.0:1782759398.006250:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1875 00000100:00100000:1.0:1782759398.006260:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:96491:x1869355197219072:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759398.006283:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759398.006310:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def11 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d2f expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.006366:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.006393:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.006415:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.006429:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.006435:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.006441:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007484:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007495:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007503:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759398.007540:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:1.0:1782759398.007544:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759398.007563:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007574:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007583:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007599:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007606:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007611:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759398.007615:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007623:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007634:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759398.007637:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759398.007642:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007647:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def18 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007660:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007665:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007671:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007676:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759398.007683:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007690:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007698:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5400) 00010000:00010000:1.0:1782759398.007700:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759398.007703:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007709:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def1f lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007754:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def11 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d2f expref: 15 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007770:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d2f expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.007778:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759398.007781:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759398.007783:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030200, rc 0) 00000100:00100000:1.0:1782759398.007874:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:96491:x1869355197219072:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1602us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759398.007887:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1875 00000100:00100000:2.0:1782759398.011451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759398.011613:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197219328 00000100:00100000:0.0:1782759398.011623:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197219328 00000100:00100000:0.0:1782759398.011678:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1876 00000100:00100000:0.0:1782759398.011690:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:96491:x1869355197219328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759398.011713:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759398.011743:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def2d lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d36 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.011936:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def34 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.011956:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def34 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.011967:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def34 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759398.011979:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00010000:00010000:0.0:1782759398.012109:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def2d lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d36 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.012127:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def34 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d36 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.012133:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759398.012135:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782759398.012137:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759398.012182:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96491:x1869355197219328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 496us (740us total) trans 4294968013 rc 0/0 00000100:00100000:0.0:1782759398.012189:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1876 00000100:00100000:3.0:1782759398.014074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759398.014120:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197219584 00000100:00100000:0.0:1782759398.014127:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197219584 00000100:00100000:0.0:1782759398.014163:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1877 00000100:00100000:0.0:1782759398.014172:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96491:x1869355197219584:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759398.014231:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759398.014246:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777def26 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d2f expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.014257:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759398.014259:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759398.014270:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.014277:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.014282:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 4/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.014315:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.014328:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 15 pid: 5802 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759398.014342:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211903616:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759398.014430:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c8600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759398.015729:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211903616:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759398.015748:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759398.015939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759398.016078:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197219712 00000100:00100000:1.0:1782759398.016084:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197219712 00010000:00010000:1.0:1782759398.016109:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 16 pid: 5802 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759398.016151:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 569 00000100:00100000:1.0:1782759398.016160:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:2362:x1869355197219712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759398.016172:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759398.016178:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 16 pid: 5802 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.016188:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 16 pid: 5802 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.016203:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777deee0 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d21 expref: 16 pid: 5802 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.016215:0:134476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759398.016219:0:134476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.016227:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.016234:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.016253:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759398.016277:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759398.016296:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2362:x1869355197219712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 137us (357us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759398.016307:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759398.016311:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 569 00000040:00080000:0.0:1782759398.016674:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].49, 88 off11448 00000004:00010000:0.0:1782759398.016761:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de23a8e4 reply state 000000001292e7d5 transno 4294968014 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759398.016771:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759398.016876:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96491:x1869355197219584:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 2704us (2805us total) trans 4294968014 rc 0/0 00000100:00100000:0.0:1782759398.016883:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1877 00010000:00010000:0.0:1782759398.017568:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.017578:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.017585:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.017591:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759398.017596:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.017603:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.017614:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759398.017617:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759398.017621:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.017635:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def42 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759398.024633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759398.024768:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197219840 00000100:00100000:1.0:1782759398.024800:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197219840 00000100:00100000:1.0:1782759398.024896:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1878 00000100:00100000:1.0:1782759398.024908:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:96492:x1869355197219840:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759398.024932:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759398.024954:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777def49 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d3d expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025014:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025026:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025035:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025044:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025048:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025052:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025411:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 3/1,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025420:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025427:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759398.025467:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x3:0x0]: returning size 0 00000004:00200000:1.0:1782759398.025472:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759398.025493:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025504:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025513:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025519:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025526:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025532:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759398.025537:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025543:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025555:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759398.025558:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759398.025563:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025569:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777def50 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025593:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025599:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025605:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025610:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759398.025613:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025619:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025626:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171889c5400) 00010000:00010000:1.0:1782759398.025629:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759398.025632:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025638:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777def57 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025664:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777def49 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d3d expref: 17 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025679:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d3d expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.025697:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759398.025699:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759398.025702:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759398.025766:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96492:x1869355197219840:12345-192.168.204.31@tcp:101:rm.0 Request processed in 860us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759398.025774:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1878 00000100:00100000:3.0:1782759398.027952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759398.028006:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197220096 00000100:00100000:0.0:1782759398.028024:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197220096 00000100:00100000:0.0:1782759398.028078:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 247 00000100:00100000:0.0:1782759398.028091:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96492:x1869355197220096:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1782759398.028280:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96492:x1869355197220096:12345-192.168.204.31@tcp:35:rm.0 Request processed in 194us (332us total) trans 4294968015 rc 0/0 00000100:00100000:0.0:1782759398.028289:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 247 00000100:00100000:2.0:1782759398.029876:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759398.030243:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197220352 00000100:00100000:0.0:1782759398.030251:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197220352 00000100:00100000:0.0:1782759398.030300:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1879 00000100:00100000:0.0:1782759398.030312:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96492:x1869355197220352:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782759398.030364:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782759398.030401:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777def5e lrc: 0/0,0 mode: --/PR res: [0x200000418:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d3d expref: 17 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030422:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def34 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d36 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030434:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777ded4a) 00010000:00010000:0.0:1782759398.030438:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759398.030448:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759398.030473:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030514:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030525:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030544:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030551:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030558:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030970:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030980:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.030988:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759398.031953:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].50, 64 off11512 00010000:00010000:0.0:1782759398.032013:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 3/0,1 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032023:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032031:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032045:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032051:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032058:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032088:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759398.032110:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032117:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032121:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759398.032123:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032129:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032132:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759398.032139:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032141:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759398.032147:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032151:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032157:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032165:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70b00) 00010000:00010000:0.0:1782759398.032169:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759398.032173:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032177:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x3:0x0].0x0 (ffff917183a70b00) 00010000:00010000:3.0:1782759398.032182:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782759398.032186:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 1/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032203:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98c00/0xdd99f5c4777def7a lrc: 0/0,0 mode: --/PW res: [0x200000418:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032203:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777def73 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032228:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759398.032237:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759398.032237:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.032239:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759398.032246:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032253:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032259:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759398.032262:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032267:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032275:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759398.032277:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759398.032280:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.032286:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777def65 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759398.032297:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6c6b0ce reply state 00000000127b1ebb transno 4294968016 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759398.032305:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759398.032392:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:96492:x1869355197220352:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2082us (2518us total) trans 4294968016 rc 0/0 00000100:00100000:0.0:1782759398.032404:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1879 00010000:00010000:1.0:1782759398.034459:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.034472:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.034478:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.034484:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759398.034488:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.034495:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.034507:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70d00) 00010000:00010000:1.0:1782759398.034510:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759398.034513:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.034518:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777def6c lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759398.316027:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211903744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759398.316102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759398.316229:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211903744 00000100:00100000:2.0:1782759398.316237:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211903744 00000100:00080000:0.0:1782759398.316307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759398.316311:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1782759398.316319:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211903744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759398.316349:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759398.316413:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211903744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759398.316420:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1782759398.316468:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211903744:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1782759398.331238:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967399 is committed 00000020:00000080:0.0:1782759398.396992:0:137356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce67c3100 20000000:00000080:0.0:1782759398.397008:0:137356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917191997c00 uarg=0000000000000000 00010000:00010000:0.0:1782759398.397469:0:137356:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759398.397483:0:137356:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759398.397497:0:137356:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759398.397513:0:137356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.397528:0:137356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.397537:0:137356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.397576:0:137356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.397585:0:137356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 18 pid: 5794 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759398.397597:0:137356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137356:1869355211903872:0@lo:104: 00000100:00100000:0.0:1782759398.397648:0:137356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759398.397698:0:137356:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759398.397724:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211903872 00000100:00100000:1.0:1782759398.397738:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211903872 00000100:00100000:1.0:1782759398.397814:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1782759398.397861:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137356:x1869355211903872:12345-0@lo:104: 00010000:00010000:1.0:1782759398.397880:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759398.397988:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759398.397997:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137356:x1869355211903872:12345-0@lo:104: Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759398.398009:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00010000:00010000:3.0:1782759398.398046:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759398.398058:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398070:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759398.398075:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759398.398087:0:137356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137356:1869355211903872:0@lo:104: 00010000:00010000:3.0:1782759398.398103:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759398.398114:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.398119:0:137356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759398.398124:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759398.398185:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398194:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759398.398228:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398233:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777dee8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dee93 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398247:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759398.398249:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759398.398250:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759398.398259:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759398.398277:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211904000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759398.398316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759398.398454:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904000 00000100:00100000:3.0:1782759398.398469:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904000 00010000:00010000:3.0:1782759398.398492:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 19 pid: 5794 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759398.398522:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1782759398.398531:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211904000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759398.398545:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759398.398551:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 19 pid: 5794 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398561:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 19 pid: 5794 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398578:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777dee93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dee8c expref: 19 pid: 5794 timeout: 3566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398592:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398601:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398618:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398627:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398635:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398642:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398654:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759398.398658:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398666:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398685:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.398696:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759398.398712:0:137356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.398723:0:137356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759398.398731:0:137356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777def81 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759398.398762:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211904000:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759398.398772:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1782759398.398895:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211904000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759399.020196:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759399.669306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.669369:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197220608 00000100:00100000:0.0:1782759399.669381:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197220608 00000100:00080000:1.0:1782759399.669448:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759399.669454:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1880 00000100:00100000:0.0:1782759399.669469:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:96565:x1869355197220608:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759399.669500:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.669526:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777def88 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.669652:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 3/0,1 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.669667:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.669679:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.669692:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.669705:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.669712:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759399.670370:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f:0x0], index 1: 0 00010000:00010000:0.0:1782759399.670554:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def9d lrc: 3/1,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670566:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def9d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670574:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def9d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670609:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670618:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670625:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670631:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.670636:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670643:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670668:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759399.670671:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.670676:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670682:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777def8f lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759399.670698:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000baab1a7a reply state 0000000009554e54 transno 4294968017 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759399.670707:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759399.670738:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777def88 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d44 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670758:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def9d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d44 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.670765:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70000) 00010000:00010000:0.0:1782759399.670767:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759399.670769:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759399.670860:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96565:x1869355197220608:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1395us (1602us total) trans 4294968017 rc 0/0 00000100:00100000:0.0:1782759399.670868:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1880 00010000:00010000:0.0:1782759399.671815:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.671853:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.671872:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.671878:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.671883:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.671891:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.671901:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70500) 00010000:00010000:0.0:1782759399.671903:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.671906:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.671910:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777def96 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759399.673039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759399.673164:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197220864 00000100:00100000:1.0:1782759399.673186:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197220864 00000100:00100000:1.0:1782759399.673246:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1881 00000100:00100000:1.0:1782759399.673259:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96565:x1869355197220864:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782759399.673322:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759399.673355:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777def9d lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d44 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.673374:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70000) 00010000:00010000:1.0:1782759399.673395:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759399.673444:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.673455:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.673462:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759399.673588:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002f56c92 reply state 0000000039609a0d transno 4294968018 ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759399.673595:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759399.673675:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96565:x1869355197220864:12345-192.168.204.31@tcp:36:touch.0 Request processed in 418us (647us total) trans 4294968018 rc 0/0 00000100:00100000:1.0:1782759399.673686:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1881 00010000:00010000:1.0:1782759399.674728:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.674735:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.674740:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.674743:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759399.674746:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.674751:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.674772:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759399.674775:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759399.674779:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 2/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.674785:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777defab lrc: 0/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759399.675364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.675433:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197220992 00000100:00100000:0.0:1782759399.675444:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197220992 00000100:00100000:0.0:1782759399.675516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1882 00000100:00100000:0.0:1782759399.675531:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:96565:x1869355197220992:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759399.675561:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.675581:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777defb2 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d4b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.675630:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777defb2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d4b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.675654:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777defb2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d4b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.675687:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.675690:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759399.675693:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99400, rc 0) 00000100:00100000:0.0:1782759399.675746:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96565:x1869355197220992:12345-192.168.204.31@tcp:101:touch.0 Request processed in 221us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759399.675752:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1882 00000100:00100000:3.0:1782759399.677144:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.677468:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197221120 00000100:00100000:0.0:1782759399.677483:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197221120 00000100:00100000:0.0:1782759399.677586:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 957 00000100:00100000:0.0:1782759399.677602:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197221120:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:3.0:1782759399.677636:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759399.678237:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197221120:12345-192.168.204.31@tcp:2:touch.0 Request processed in 636us (1095us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1782759399.678244:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 957 00000100:00100000:3.0:1782759399.679731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759399.679772:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197221376 00000100:00100000:3.0:1782759399.679782:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197221376 00000100:00100000:3.0:1782759399.679893:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 248 00000100:00100000:3.0:1782759399.679907:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:96565:x1869355197221376:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759399.680378:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96565:x1869355197221376:12345-192.168.204.31@tcp:35:touch.0 Request processed in 472us (651us total) trans 4294968019 rc 0/0 00000100:00100000:3.0:1782759399.680390:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 248 00000100:00100000:2.0:1782759399.685973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.686043:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197221504 00000100:00100000:0.0:1782759399.686057:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197221504 00000100:00100000:0.0:1782759399.686119:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1883 00000100:00100000:0.0:1782759399.686131:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96566:x1869355197221504:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759399.686158:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.686186:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777defb9 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686247:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686268:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686277:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686289:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686293:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686298:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686413:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 3/1,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686420:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686427:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759399.686463:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x5:0x0]: returning size 0 00000004:00200000:0.0:1782759399.686467:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759399.686487:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686496:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686510:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686514:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686518:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686522:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.686525:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686529:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686538:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70500) 00010000:00010000:0.0:1782759399.686540:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.686543:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686546:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777defc0 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686557:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686561:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686564:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686570:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.686572:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686576:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686581:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70400) 00010000:00010000:0.0:1782759399.686583:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.686584:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686589:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defc7 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686610:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777defb9 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d52 expref: 22 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686622:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d52 expref: 21 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.686627:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.686629:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759399.686631:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99c00, rc 0) 00000100:00100000:0.0:1782759399.686690:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96566:x1869355197221504:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 560us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759399.686698:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1883 00000100:00100000:3.0:1782759399.688523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.688563:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197221632 00000100:00100000:0.0:1782759399.688579:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197221632 00000100:00100000:0.0:1782759399.688625:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 958 00000100:00100000:0.0:1782759399.688636:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197221632:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759399.688654:0:126932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.688669:0:126932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ea4872d/0xdd99f5c4777defd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d59 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759399.688685:0:126932:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x6a42bfe6, atime: 0x6a42bfe6, ctime: 0x6a42bfe6, blocks: 0x1 00010000:00010000:0.0:1782759399.688700:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=3468s v=(0 0) 00010000:00010000:0.0:1782759399.688704:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759399.688713:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ea4872d/0xdd99f5c4777defd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d59 expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.688730:0:126932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ea4872d/0xdd99f5c4777defd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d59 expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.688741:0:126932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98c00, rc 0) 00000100:00100000:0.0:1782759399.688781:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197221632:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759399.688788:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 958 00000100:00100000:3.0:1782759399.690467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759399.690533:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197221888 00000100:00100000:2.0:1782759399.690543:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197221888 00000100:00100000:2.0:1782759399.690597:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1884 00000100:00100000:2.0:1782759399.690607:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96566:x1869355197221888:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782759399.690672:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759399.690702:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777defce lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d52 expref: 21 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690728:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759399.690732:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759399.690765:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690778:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690796:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690891:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690899:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690904:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690908:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759399.690912:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690917:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690924:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759399.690926:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759399.690929:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 2/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.690933:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777defdc lrc: 0/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759399.691055:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96566:x1869355197221888:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 445us (590us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759399.691065:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1884 00000100:00100000:2.0:1782759399.698977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.699019:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197222016 00000100:00100000:0.0:1782759399.699031:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197222016 00000100:00100000:0.0:1782759399.699098:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1885 00000100:00100000:0.0:1782759399.699112:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:96567:x1869355197222016:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782759399.699140:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.699166:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777defe3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d60 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699257:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699273:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699286:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699301:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699308:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699316:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699438:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699445:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699449:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759399.699485:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x5:0x0]: returning size 0 00000004:00200000:0.0:1782759399.699490:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759399.699516:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699539:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699547:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699553:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699560:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699566:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.699571:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699579:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699592:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70500) 00010000:00010000:0.0:1782759399.699595:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.699599:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699604:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777defea lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699620:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699626:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699639:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699645:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.699658:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699666:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699674:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70400) 00010000:00010000:0.0:1782759399.699677:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.699680:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699685:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777deff1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699716:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777defe3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d60 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699732:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d60 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.699740:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.699742:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759399.699744:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98e00, rc 0) 00000100:00100000:0.0:1782759399.699801:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96567:x1869355197222016:12345-192.168.204.31@tcp:101:chown.0 Request processed in 692us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759399.699818:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1885 00000100:00100000:3.0:1782759399.702243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.702301:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197222144 00000100:00100000:0.0:1782759399.702309:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197222144 00000100:00100000:0.0:1782759399.702369:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1886 00000100:00100000:0.0:1782759399.702380:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96567:x1869355197222144:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782759399.702400:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.702417:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777defff lrc: 2/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d67 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.702454:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.702469:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.702480:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.702570:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777defff lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 23 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.702589:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 22 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.702597:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.702600:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759399.702603:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759399.702653:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96567:x1869355197222144:12345-192.168.204.31@tcp:101:chown.0 Request processed in 276us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759399.702665:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1886 00000100:00100000:3.0:1782759399.704145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759399.704244:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197222400 00000100:00100000:2.0:1782759399.704251:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197222400 00000100:00100000:2.0:1782759399.704312:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1887 00000100:00100000:2.0:1782759399.704320:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96567:x1869355197222400:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:2.0:1782759399.704383:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759399.704407:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777deff8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d60 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704437:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759399.704441:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759399.704468:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704481:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704490:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704525:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704533:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704540:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704546:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759399.704550:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704557:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704574:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759399.704577:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759399.704581:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 2/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.704587:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df00d lrc: 0/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759399.704670:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96567:x1869355197222400:12345-192.168.204.31@tcp:36:chown.0 Request processed in 350us (529us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759399.704677:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1887 00000100:00100000:2.0:1782759399.711531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.711588:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197222528 00000100:00100000:0.0:1782759399.711599:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197222528 00000100:00100000:0.0:1782759399.711666:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1888 00000100:00100000:0.0:1782759399.711679:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96568:x1869355197222528:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:0.0:1782759399.711709:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.711729:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777df014 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d6e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711789:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711803:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711815:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711860:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711866:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711870:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711960:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711990:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.711999:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759399.712044:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x5:0x0]: returning size 0 00000004:00200000:0.0:1782759399.712050:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759399.712075:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712085:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712093:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712099:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712107:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712113:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.712117:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712126:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712140:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff917183a70500) 00010000:00010000:0.0:1782759399.712144:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.712154:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712159:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df01b lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712177:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712183:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712200:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712206:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.712210:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712216:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712225:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff917183a70400) 00010000:00010000:0.0:1782759399.712227:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759399.712231:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712235:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df022 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712259:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777df014 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d6e expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712281:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d6e expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.712285:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.712287:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759399.712290:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99800, rc 0) 00000100:00100000:0.0:1782759399.712365:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96568:x1869355197222528:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 690us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759399.712370:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1888 00000100:00100000:3.0:1782759399.714518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.714585:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197222784 00000100:00100000:0.0:1782759399.714597:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197222784 00000100:00100000:0.0:1782759399.714665:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1889 00000100:00100000:0.0:1782759399.714678:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96568:x1869355197222784:12345-192.168.204.31@tcp:36:chgrp.0 00010000:00010000:0.0:1782759399.714748:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759399.714784:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df029 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d6e expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714814:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.714819:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759399.714880:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714896:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714908:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714972:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714981:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714988:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.714996:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.715001:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.715011:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.715020:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.715023:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759399.715027:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.715034:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df030 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759399.715130:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96568:x1869355197222784:12345-192.168.204.31@tcp:36:chgrp.0 Request processed in 453us (619us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759399.715138:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1889 00000100:00100000:3.0:1782759399.724532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759399.724633:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197222912 00000100:00100000:2.0:1782759399.724668:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197222912 00000100:00100000:2.0:1782759399.724754:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1890 00000100:00100000:2.0:1782759399.724765:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:96569:x1869355197222912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759399.724787:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759399.724813:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df037 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d75 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.724914:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.724931:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.724947:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.724978:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.724986:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.724999:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725123:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725132:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725139:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759399.725182:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x5:0x0]: returning size 0 00000004:00200000:2.0:1782759399.725187:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759399.725212:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725222:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725230:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725236:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725250:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725256:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759399.725261:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725268:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725287:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759399.725290:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759399.725295:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725302:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64600/0xdd99f5c4777df03e lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725314:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725321:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725326:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725331:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759399.725334:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725360:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725368:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0xdbe7f83a (ffff9171c08f6c00) 00010000:00010000:2.0:1782759399.725370:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759399.725382:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725388:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df045 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0xdbe7f83a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725416:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df037 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d75 expref: 23 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725435:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d75 expref: 22 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.725441:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759399.725443:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759399.725446:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65400, rc 0) 00000100:00100000:2.0:1782759399.725526:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96569:x1869355197222912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 762us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759399.725535:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1890 00000100:00100000:2.0:1782759399.728428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.728485:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197223168 00000100:00100000:0.0:1782759399.728503:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197223168 00000100:00100000:0.0:1782759399.728579:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1891 00000100:00100000:0.0:1782759399.728631:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96569:x1869355197223168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759399.728660:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759399.728690:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777df053 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d7c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.728899:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df05a lrc: 3/1,0 mode: --/CR res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.728917:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df05a lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x5:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.728930:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df05a lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x5:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759399.728949:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x5:0x0]: returning size 0 00010000:00010000:0.0:1782759399.729128:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777df053 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d7c expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.729159:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df05a lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x5:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d7c expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.729168:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.729171:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782759399.729175:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98400, rc 0) 00000100:00100000:0.0:1782759399.729253:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+24:96569:x1869355197223168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 628us (837us total) trans 4294968020 rc 0/0 00000100:00100000:0.0:1782759399.729261:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1891 00000100:00100000:3.0:1782759399.731014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759399.731059:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197223424 00000100:00100000:0.0:1782759399.731068:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197223424 00000100:00100000:0.0:1782759399.731153:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1892 00000100:00100000:0.0:1782759399.731165:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+24:96569:x1869355197223424:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759399.731231:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759399.731259:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df04c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d75 expref: 24 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.731281:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.731286:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759399.731310:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.731325:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 23 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.731335:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 4/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.731526:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 23 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.731543:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 23 pid: 5801 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759399.731560:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211904128:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759399.731717:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a0fd0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759399.732915:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211904128:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759399.732945:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759399.733154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759399.733249:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197223552 00000100:00100000:1.0:1782759399.733255:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197223552 00010000:00010000:1.0:1782759399.733290:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 24 pid: 5801 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759399.733325:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 571 00000100:00100000:1.0:1782759399.733347:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+24:2362:x1869355197223552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759399.733365:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759399.733372:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 24 pid: 5801 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.733384:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 24 pid: 5801 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.733409:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df006 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d67 expref: 24 pid: 5801 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.733433:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:1.0:1782759399.733438:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.733457:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.733466:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759399.733493:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759399.733519:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733530:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759399.733545:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+23:2362:x1869355197223552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 209us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759399.733559:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 571 00010000:00010000:0.0:1782759399.733583:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733593:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733601:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733608:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759399.733614:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733623:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733636:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759399.733640:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759399.733644:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759399.733650:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df068 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759399.733713:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:96569:x1869355197223424:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 2552us (2706us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759399.733725:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1892 10000000:01000000:2.0:1782759399.980133:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759399.980150:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759399.980154:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759399.980206:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.980229:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.980238:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759399.980259:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211904256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759399.980318:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759399.980393:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904256 00000100:00100000:2.0:1782759399.980393:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759399.980402:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904256 00000100:00100000:3.0:1782759399.980450:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:3.0:1782759399.980459:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211904256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759399.980472:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759399.980485:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df06f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759399.980506:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759399.980517:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759399.980525:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759399.980565:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211904256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759399.980572:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1782759399.980589:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211904256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759399.980604:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.980610:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759399.980625:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759399.980628:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759399.980633:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.044047:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759400.365138:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211904384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759400.365149:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759400.365165:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211904768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759400.365207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759400.365212:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211904512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759400.365248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759400.365265:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211904640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759400.365271:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904768 00000100:00100000:1.0:1782759400.365273:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759400.365280:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904768 00000100:00100000:1.0:1782759400.365280:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211904896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759400.365290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759400.365312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759400.365358:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904512 00000100:00100000:1.0:1782759400.365362:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904512 00000100:00100000:3.0:1782759400.365366:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1782759400.365386:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211904768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759400.365392:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1782759400.365399:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211904512:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759400.365425:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759400.365440:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211904512:12345-0@lo:400:kworker.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759400.365445:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:3.0:1782759400.365455:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211904768:12345-0@lo:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759400.365463:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1782759400.366053:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211904768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759400.366345:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904640 00000100:00100000:0.0:1782759400.366350:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904640 00000100:00100000:1.0:1782759400.366359:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904896 00000100:00100000:1.0:1782759400.366364:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904896 00000100:00080000:3.0:1782759400.366390:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759400.366396:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:1.0:1782759400.366403:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211904896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759400.366439:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211904896:12345-0@lo:400:kworker.0 Request processed in 36us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759400.366445:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1782759400.366451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759400.366476:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211904384 00000100:00100000:1.0:1782759400.366479:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211904384 00000100:00100000:1.0:1782759400.366505:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1782759400.366513:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211904384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759400.366520:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967393 gen 2 00000004:00080000:3.0:1782759400.366527:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7d08700, transno 4294967390 00000004:00080000:3.0:1782759400.366539:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170826b8000, transno 4294967391 00000004:00080000:3.0:1782759400.366543:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b2322a00, transno 4294967392 00000004:00080000:3.0:1782759400.366547:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171bb963100, transno 4294967393 00000100:00100000:3.0:1782759400.366554:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211904896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759400.366558:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:1.0:1782759400.366563:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211904384:12345-0@lo:400:kworker.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759400.366571:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211904640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759400.366572:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211904512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759400.366575:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:0.0:1782759400.366614:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211904640:12345-0@lo:400:kworker.0 Request processed in 48us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759400.366619:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00080000:0.0:1782759400.366640:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759400.366657:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211904640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759400.366689:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211904384:0@lo:400:kworker.0 00000004:00080000:1.0:1782759400.367024:0:7940:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1782759400.875991:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211905024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759400.876062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759400.876111:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905024 00000100:00100000:0.0:1782759400.876120:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905024 00000100:00100000:0.0:1782759400.876173:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1782759400.876183:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211905024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759400.876218:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759400.876273:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211905024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759400.876282:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1782759400.876303:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211905024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759401.070390:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759402.092142:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759402.163781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759402.163856:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197223680 00000100:00100000:1.0:1782759402.163867:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197223680 00000100:00100000:3.0:1782759402.163872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759402.163897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759402.163928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759402.163930:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2609 00000100:00100000:1.0:1782759402.163943:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197223680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759402.163953:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197223808 00000100:00100000:2.0:1782759402.163960:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197223808 00000100:00100000:2.0:1782759402.164014:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2485 00000100:00100000:2.0:1782759402.164025:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:2363:x1869355197223808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759402.164030:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197223680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759402.164040:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2609 00000100:00100000:2.0:1782759402.164093:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:2363:x1869355197223808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.164103:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2485 00000100:00100000:1.0:1782759402.164125:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224064 00000100:00100000:1.0:1782759402.164130:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224064 00000100:00080000:2.0:1782759402.164132:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759402.164157:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759402.164172:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197223936 00000100:00100000:1.0:1782759402.164176:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197223936 00000100:00100000:3.0:1782759402.164182:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00100000:3.0:1782759402.164194:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197224064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782759402.164206:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759402.164230:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1939 00000100:00100000:1.0:1782759402.164241:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197223936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759402.164259:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197224064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759402.164275:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197223936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.164277:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00100000:1.0:1782759402.164313:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1939 00000020:00000080:0.0:1782759402.317519:0:137697:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb0ebdd00 20000000:00000080:0.0:1782759402.317536:0:137697:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb93e000 uarg=0000000000000000 00010000:00010000:0.0:1782759402.317759:0:137697:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782759402.317792:0:137697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759402.317795:0:137697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782759402.317807:0:137697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df05a lrc: 0/0,0 mode: --/CR res: [0x200000418:0x5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d7c expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.318006:0:137697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x5:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759402.318009:0:137697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759402.318014:0:137697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777defb2 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d4b expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.318035:0:137697:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 2 locks, left on hash table 0. 10000000:01000000:0.0:1782759402.318058:0:137697:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759402.318072:0:137697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.318084:0:137697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.318092:0:137697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.318129:0:137697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.318144:0:137697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 18 pid: 5793 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759402.318166:0:137697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137697:1869355211905152:0@lo:104: 00000100:00100000:0.0:1782759402.318225:0:137697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759402.318269:0:137697:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171918069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759402.318340:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905152 00000100:00100000:3.0:1782759402.318347:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905152 00000100:00100000:3.0:1782759402.318395:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1782759402.318405:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137697:x1869355211905152:12345-0@lo:104: 00010000:00010000:3.0:1782759402.318417:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759402.318482:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759402.318488:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137697:x1869355211905152:12345-0@lo:104: Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.318495:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00010000:00010000:3.0:1782759402.318516:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759402.318521:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759402.318527:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759402.318531:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759402.318539:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759402.318546:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759402.318552:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759402.318578:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759402.318590:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759402.318609:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759402.318616:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777df06f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759402.318628:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759402.318630:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759402.318632:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759402.318645:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759402.318656:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211905280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759402.318686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759402.318741:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905280 00000100:00100000:2.0:1782759402.318743:0:137697:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137697:1869355211905152:0@lo:104: 00000100:00100000:1.0:1782759402.318747:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905280 00010000:00010000:1.0:1782759402.318773:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 19 pid: 5793 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759402.318774:0:137697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759402.318812:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1782759402.318820:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211905280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759402.318853:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759402.318859:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 19 pid: 5793 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318871:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 19 pid: 5793 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318883:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df076 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df06f expref: 19 pid: 5793 timeout: 3570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318895:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318903:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318915:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318922:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318939:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318945:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318950:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759402.318953:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318961:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318977:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.318986:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759402.319003:0:137697:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759402.319014:0:137697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759402.319021:0:137697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98000/0xdd99f5c4777df07d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759402.319027:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211905280:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759402.319036:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1782759402.319092:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211905280:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1782759402.943488:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968020 is committed 00000004:00080000:2.0:1782759402.943531:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 118 committed 00000001:00080000:2.0:1782759402.943594:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967394 is committed 00000100:00100000:3.0:1782759402.943682:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211905408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782759402.943749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759402.943791:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905408 00000100:00100000:2.0:1782759402.943799:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905408 00000100:00080000:3.0:1782759402.943851:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759402.943884:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1782759402.943894:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211905408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782759402.944097:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759402.944100:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759402.944103:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759402.944111:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759402.944113:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759402.944159:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211905408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 266us (410us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1782759402.944167:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000004:00080000:3.0:1782759402.944201:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917084c42300/2, rc 0, transno 4294967400 00000100:00100000:3.0:1782759402.944217:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211905408:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1782759403.116065:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782759403.437187:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3471840360161ns, next at 3472840355596ns, rc = 0 00000100:00100000:3.0:1782759403.437485:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759403.437521:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211905536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759403.437651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759403.437739:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905536 00000100:00100000:2.0:1782759403.437751:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905536 00000100:00100000:2.0:1782759403.437864:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1782759403.437878:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211905536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759403.437927:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759403.438025:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211905536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759403.438036:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1782759403.438094:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211905536:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782759403.456743:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967400 is committed 10000000:01000000:2.0:1782759403.948884:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759403.948890:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759403.948895:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759403.948932:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759403.948941:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759403.948949:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759403.948972:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211905664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759403.949038:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759403.949086:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905664 00000100:00100000:3.0:1782759403.949100:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905664 00000100:00100000:2.0:1782759403.949104:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759403.949155:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:3.0:1782759403.949166:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211905664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759403.949179:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759403.949193:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df084 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.949215:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.949226:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.949246:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759403.949302:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211905664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759403.949310:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1782759403.949335:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211905664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759403.949362:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759403.949371:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759403.949388:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759403.949393:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759403.949399:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.140384:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759404.375838:0:137944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8aa56590 20000000:00000080:3.0:1782759404.375855:0:137944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca1800 uarg=0000000000000000 00010000:00010000:3.0:1782759404.376406:0:137944:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759404.376417:0:137944:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759404.376429:0:137944:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759404.376444:0:137944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759404.376457:0:137944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759404.376465:0:137944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759404.376510:0:137944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759404.376523:0:137944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 18 pid: 5793 timeout: 3572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759404.376537:0:137944:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137944:1869355211905792:0@lo:104: 00000100:00100000:3.0:1782759404.376596:0:137944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759404.376683:0:137944:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759404.376722:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905792 00000100:00100000:2.0:1782759404.376729:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905792 00000100:00100000:2.0:1782759404.376801:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1782759404.376808:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137944:x1869355211905792:12345-0@lo:104: 00010000:00010000:2.0:1782759404.376819:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.376890:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759404.376895:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:137944:x1869355211905792:12345-0@lo:104: Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759404.376899:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00010000:00010000:1.0:1782759404.377007:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759404.377013:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.377019:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759404.377023:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.377037:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759404.377041:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759404.377045:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759404.377070:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.377076:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759404.377096:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.377102:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64800/0xdd99f5c4777df084 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df08b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.377120:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759404.377123:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759404.377125:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759404.377138:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211905920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759404.377154:0:137944:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137944:1869355211905792:0@lo:104: 00010000:00010000:0.0:1782759404.377170:0:137944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759404.377172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759404.377205:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211905920 00000100:00100000:0.0:1782759404.377209:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211905920 00010000:00010000:0.0:1782759404.377226:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 19 pid: 5793 timeout: 3572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759404.377262:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1782759404.377270:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211905920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759404.377281:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759404.377286:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 19 pid: 5793 timeout: 3572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377294:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 19 pid: 5793 timeout: 3572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377302:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df08b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df084 expref: 19 pid: 5793 timeout: 3572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377310:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377324:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377333:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377337:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377341:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377345:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377348:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759404.377351:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377355:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377368:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759404.377374:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759404.377398:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211905920:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759404.377403:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1782759404.377491:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211905920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759404.377492:0:137944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.377503:0:137944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.377516:0:137944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df092 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759404.758764:0:137993:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe511af450 20000000:00000080:2.0:1782759404.758785:0:137993:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e4c00 uarg=0000000000000000 00010000:00010000:2.0:1782759404.759191:0:137993:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759404.759205:0:137993:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759404.759218:0:137993:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759404.759236:0:137993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759263:0:137993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759272:0:137993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759277:0:137993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759283:0:137993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759289:0:137993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759294:0:137993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759404.759298:0:137993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759317:0:137993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759330:0:137993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759337:0:137993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.759343:0:137993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df099 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759405.140692:0:138041:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd9a2b9b0 20000000:00000080:3.0:1782759405.140707:0:138041:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca1c00 uarg=0000000000000000 00010000:00010000:3.0:1782759405.141025:0:138041:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759405.141039:0:138041:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759405.141054:0:138041:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759405.141141:0:138041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141218:0:138041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141239:0:138041:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141247:0:138041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141255:0:138041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141263:0:138041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141276:0:138041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759405.141281:0:138041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141289:0:138041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141302:0:138041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141309:0:138041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.141316:0:138041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df0a0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.164398:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759405.484330:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211906048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759405.484392:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211906432:0@lo:400:kworker.0 00000100:00100000:2.0:1782759405.484409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759405.484474:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211906176:0@lo:400:kworker.0 00000100:00100000:3.0:1782759405.485134:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906048 00000100:00100000:3.0:1782759405.485143:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906048 00000100:00100000:3.0:1782759405.485189:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:3.0:1782759405.485199:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211906048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759405.485222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759405.485255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759405.485278:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211906048:12345-0@lo:400:kworker.0 Request processed in 78us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759405.485286:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1782759405.485294:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759405.485295:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211906688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759405.485307:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211906048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759405.485311:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211906304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759405.485336:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211906560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759405.485336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759405.485339:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906432 00000100:00100000:3.0:1782759405.485345:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906432 00000100:00100000:1.0:1782759405.485348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759405.485385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759405.485390:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906688 00000100:00100000:3.0:1782759405.485395:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906688 00000100:00100000:1.0:1782759405.485395:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:1.0:1782759405.485405:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211906432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759405.485406:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906176 00000100:00100000:0.0:1782759405.485414:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906176 00000100:00100000:3.0:1782759405.485426:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1782759405.485432:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906304 00000100:00100000:2.0:1782759405.485438:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906304 00000100:00100000:3.0:1782759405.485439:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211906688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759405.485452:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211906432:12345-0@lo:400:kworker.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759405.485457:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906560 00000100:00100000:1.0:1782759405.485461:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1782759405.485462:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906560 00000100:00100000:2.0:1782759405.485480:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:3.0:1782759405.485487:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211906688:12345-0@lo:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759405.485491:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1782759405.485495:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211906176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759405.485497:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1782759405.485501:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1782759405.485505:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211906304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759405.485516:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211906560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759405.485521:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759405.485528:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759405.485530:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759405.485556:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211906176:12345-0@lo:400:kworker.0 Request processed in 66us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759405.485566:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211906304:12345-0@lo:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759405.485567:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1782759405.485577:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211906560:12345-0@lo:400:kworker.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759405.485581:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:0.0:1782759405.485591:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1782759405.485613:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211906560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759405.485637:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170826b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211906176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759405.485650:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211906688:0@lo:400:kworker.0 00000100:00100000:1.0:1782759405.485692:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211906304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759405.485702:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967400 gen 2 00000004:00080000:1.0:1782759405.485708:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917084c42300, transno 4294967400 00000100:00100000:1.0:1782759405.485722:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211906432:0@lo:400:kworker.0 10000000:01000000:1.0:1782759405.547913:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759405.547920:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759405.547925:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759405.547969:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.547982:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.547993:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759405.548030:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211906816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759405.548100:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759405.548146:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759405.548169:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906816 00000100:00100000:1.0:1782759405.548176:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906816 00000100:00100000:1.0:1782759405.548221:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1782759405.548242:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211906816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759405.548255:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759405.548270:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df0a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.548295:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.548306:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.548316:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031a00, rc 0) 00000100:00100000:1.0:1782759405.548354:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211906816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759405.548361:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1782759405.548416:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211906816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759405.548431:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.548439:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759405.548468:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759405.548473:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.548480:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759405.996996:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759405.997028:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211906944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759405.997178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759405.997322:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211906944 00000100:00100000:0.0:1782759405.997338:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211906944 00000100:00100000:0.0:1782759405.997434:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1782759405.997449:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211906944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759405.997491:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759405.997582:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211906944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759405.997592:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1782759405.997728:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211906944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759406.188083:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759407.212494:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759407.249779:0:138237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64b: Nodemap enforces dne_ops RBAC roles ========================================================== 14:56:45 (1782759405) 00000100:00100000:3.0:1782759407.283963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759407.284013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759407.284049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759407.284080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759407.284111:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224320 00000100:00100000:3.0:1782759407.284122:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224320 00000100:00100000:3.0:1782759407.284201:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2489 00000100:00100000:3.0:1782759407.284214:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197224320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759407.284226:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224448 00000100:00100000:0.0:1782759407.284231:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224448 00000100:00100000:0.0:1782759407.284268:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224576 00000100:00100000:0.0:1782759407.284278:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224576 00000100:00100000:3.0:1782759407.284298:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197224320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.284306:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2489 00000100:00100000:0.0:1782759407.284312:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00100000:0.0:1782759407.284326:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197224448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759407.284332:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759407.284337:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759407.284340:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759407.284356:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1943 00000100:00100000:0.0:1782759407.284362:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197224448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.284369:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197224576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759407.284376:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00100000:3.0:1782759407.284401:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197224576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.284409:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1943 00000100:00100000:1.0:1782759407.284508:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224192 00000100:00100000:1.0:1782759407.284512:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224192 00000100:00100000:1.0:1782759407.284550:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2613 00000100:00100000:1.0:1782759407.284557:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197224192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759407.284586:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197224192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759407.284593:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2613 00000001:02000400:1.0:1782759408.059764:0:138286:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_64b mdt count 1, skipping dne_ops role 00000004:00080000:0.0:1782759408.066162:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 119 committed 00000100:00100000:0.0:1782759408.066279:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759408.066298:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211907072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782759408.066365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759408.066388:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907072 00000100:00100000:2.0:1782759408.066406:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907072 00000100:00100000:2.0:1782759408.066486:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1782759408.066495:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211907072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782759408.066721:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759408.066725:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759408.066728:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759408.066730:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759408.066732:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759408.066780:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211907072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (415us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782759408.066788:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000004:00080000:2.0:1782759408.066857:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b2321500/2, rc 0, transno 4294967401 00000100:00100000:2.0:1782759408.066870:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211907072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782759408.066913:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211907200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782759408.066937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759408.066974:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907200 00000100:00100000:2.0:1782759408.066978:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907200 00000100:00100000:2.0:1782759408.067001:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1782759408.067008:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211907200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782759408.067091:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759408.067095:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759408.067097:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb atime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759408.067100:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 1782759397 -> 1782759397 00002000:00010000:2.0:1782759408.067102:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1782759408.067114:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759408.067131:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1869355211907200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (192us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1782759408.067147:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000004:00080000:2.0:1782759408.067187:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b76f2d80/2, rc 0, transno 4294967402 00000100:00100000:2.0:1782759408.067203:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211907200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782759408.067301:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759408.067308:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211907328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782759408.067332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759408.067426:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907328 00000100:00100000:3.0:1782759408.067432:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907328 00000100:00100000:3.0:1782759408.067470:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1782759408.067478:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1869355211907328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782759408.067493:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:47 count 1 00010000:00010000:3.0:1782759408.067511:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759408.067533:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 5 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759408.067548:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=18s v=(0 0) 00010000:00010000:3.0:1782759408.067563:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759408.067569:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759408.067599:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 5 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759408.067614:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 5 pid: 126932 timeout: 3576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759408.067626:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211907456:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759408.067689:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759408.071403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759408.071484:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211907456:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759408.071514:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.072311:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224704 00000100:00100000:2.0:1782759408.072318:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224704 00010000:00010000:2.0:1782759408.072356:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 6 pid: 126932 timeout: 3576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.072486:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 574 00000100:00100000:2.0:1782759408.072507:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197224704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759408.072519:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759408.072524:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 6 pid: 126932 timeout: 3576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.072534:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 6 pid: 126932 timeout: 3576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.072553:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a57647b2/0xdd99f5c4777ded6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ce2 expref: 6 pid: 126932 timeout: 3576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.072564:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759408.072567:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759408.072570:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.072593:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.072623:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759408.072654:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.072667:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197224704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 160us (1268us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759408.072677:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.072683:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 574 00010000:00010000:1.0:1782759408.072694:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.072703:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.072723:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782759408.073412:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1869355211907328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5934us (6077us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1782759408.073421:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00010000:00010000:1.0:1782759408.073450:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759408.073457:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.073467:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759408.073472:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759408.073479:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7765f80/2, rc 0, transno 4294967403 00010000:00010000:1.0:1782759408.073482:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.073489:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211907328:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782759408.073499:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.073515:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbf1756f/0xdd99f5c4777df0b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.073536:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759408.073539:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759408.073541:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759408.237220:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759408.558605:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211907584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759408.558675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759408.558978:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907584 00000100:00100000:3.0:1782759408.558987:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907584 00000100:00100000:2.0:1782759408.559218:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1782759408.559231:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1869355211907584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759408.559266:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759408.559316:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1869355211907584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759408.559324:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1782759408.560701:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211907584:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782759408.588586:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967403 is committed 00000001:02000400:1.0:1782759408.966081:0:138336:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64c: Nodemap enforces quota related RBAC roles ========================================================== 14:56:47 (1782759407) 00000100:00100000:0.0:1782759409.070687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759409.070745:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197224960 00000100:00100000:3.0:1782759409.070756:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197224960 00000100:00080000:0.0:1782759409.070813:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759409.070868:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1893 00000100:00100000:2.0:1782759409.070882:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97620:x1869355197224960:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759409.070933:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759409.070938:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777debc9) 00010000:00010000:2.0:1782759409.070940:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759409.071274:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.071290:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.071312:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.071325:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.071332:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.071339:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759409.072416:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x6:0x0]: returning size 512 00010000:00010000:2.0:1782759409.072429:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.072438:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.072445:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.072451:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759409.072455:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.072462:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.072475:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759409.072478:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759409.072489:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.072495:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65000/0xdd99f5c4777df0bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759409.072512:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f4885ae reply state 0000000036934292 transno 4294968021 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759409.072520:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759409.072599:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:97620:x1869355197224960:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1718us (1930us total) trans 4294968021 rc 0/0 00000100:00100000:2.0:1782759409.072608:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1893 00010000:00010000:0.0:1782759409.073465:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759409.073475:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759409.073482:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759409.073487:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759409.073504:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759409.073511:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759409.073521:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f98a5d6 (ffff9171c08f6c00) 00010000:00010000:0.0:1782759409.073523:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759409.073526:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759409.073532:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df0c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.259983:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759410.284011:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759410.605037:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211907712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759410.605315:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211908224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759410.605372:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759410.605373:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908224 00000100:00100000:2.0:1782759410.605378:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211908096:0@lo:400:kworker.0 00000100:00100000:1.0:1782759410.605380:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908224 00000100:00100000:2.0:1782759410.605402:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759410.605428:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211907840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759410.605430:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1782759410.605439:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211908224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759410.605468:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211908352:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759410.605489:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211908224:12345-0@lo:400:kworker.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759410.605495:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1782759410.605502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759410.605506:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211907968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759410.605511:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907840 00000100:00100000:1.0:1782759410.605514:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907840 00000100:00100000:2.0:1782759410.605523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759410.605530:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907968 00000100:00100000:1.0:1782759410.605533:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907968 00000100:00100000:1.0:1782759410.605547:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1782759410.605549:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211907712 00000100:00100000:1.0:1782759410.605552:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211907840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605557:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211907712 00000100:00100000:2.0:1782759410.605582:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1782759410.605582:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211907840:12345-0@lo:400:kworker.0 Request processed in 29us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759410.605588:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211907712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759410.605592:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1782759410.605604:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:2.0:1782759410.605612:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211907712:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759410.605616:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211907968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605618:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1782759410.605640:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211907968:12345-0@lo:400:kworker.0 Request processed in 30us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759410.605645:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908096 00000100:00100000:1.0:1782759410.605646:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:2.0:1782759410.605648:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908096 00000100:00080000:1.0:1782759410.605661:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759410.605665:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759410.605669:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908352 00000100:00100000:2.0:1782759410.605672:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908352 00000100:00100000:2.0:1782759410.605697:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1782759410.605704:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211908096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605733:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211908096:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759410.605739:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1782759410.605750:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1782759410.605756:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211908352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605780:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211908352:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759410.605786:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00080000:2.0:1782759410.605814:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759410.605918:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211907968:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605929:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211907840:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.605937:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211908352:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.606227:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967403 gen 2 00000004:00080000:2.0:1782759410.606234:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b2321500, transno 4294967401 00000004:00080000:2.0:1782759410.606252:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b76f2d80, transno 4294967402 00000004:00080000:2.0:1782759410.606256:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7765f80, transno 4294967403 00000100:00100000:2.0:1782759410.606263:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211908096:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.606279:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211907712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759410.606293:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211908224:0@lo:400:kworker.0 00000004:00080000:2.0:1782759410.606918:0:6789:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000020:00000080:1.0:1782759410.679567:0:138531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb15fc8c0 20000000:00000080:1.0:1782759410.679584:0:138531:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082737c00 uarg=0000000000000000 10000000:01000000:0.0:1782759410.680189:0:138531:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759410.680220:0:138531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.680241:0:138531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.680251:0:138531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.680300:0:138531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.680320:0:138531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 18 pid: 5793 timeout: 3579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759410.680656:0:138531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138531:1869355211908480:0@lo:104: 00000100:00100000:0.0:1782759410.680738:0:138531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759410.680839:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908480 00000100:00100000:3.0:1782759410.680850:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908480 00000100:00100000:0.0:1782759410.680858:0:138531:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c09906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759410.680904:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1782759410.680914:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:138531:x1869355211908480:12345-0@lo:104: 00010000:00010000:3.0:1782759410.680932:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759410.681026:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759410.681034:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:138531:x1869355211908480:12345-0@lo:104: Request processed in 120us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759410.681042:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1782759410.681071:0:138531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138531:1869355211908480:0@lo:104: 00010000:00010000:0.0:1782759410.681102:0:138531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.681157:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759410.681165:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.681175:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759410.681179:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.681189:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759410.681197:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759410.681204:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759410.681247:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.681254:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759410.681300:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.681307:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777df0a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759410.681319:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211908608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759410.681328:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759410.681332:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759410.681337:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759410.681368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759410.682310:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908608 00000100:00100000:1.0:1782759410.682316:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908608 00010000:00010000:1.0:1782759410.682341:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 19 pid: 5793 timeout: 3579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759410.682453:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1782759410.682470:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211908608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759410.682482:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759410.682488:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 19 pid: 5793 timeout: 3579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682502:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 19 pid: 5793 timeout: 3579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682520:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031a00/0xdd99f5c4777df0ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df0a7 expref: 19 pid: 5793 timeout: 3579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682534:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682543:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682566:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682573:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682579:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682585:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682590:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759410.682593:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682600:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682623:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759410.682634:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759410.682687:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211908608:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759410.682694:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00010000:00010000:3.0:1782759410.682957:0:138531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759410.682966:0:138531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759410.682972:0:138531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98200/0xdd99f5c4777df0ca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759410.683741:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211908608:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1782759411.075957:0:138579:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec3c2fde0 20000000:00000080:2.0:1782759411.075975:0:138579:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc2c00 uarg=0000000000000000 10000000:01000000:2.0:1782759411.076183:0:138579:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759411.076200:0:138579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076212:0:138579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076219:0:138579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076224:0:138579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076228:0:138579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076232:0:138579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076240:0:138579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759411.076244:0:138579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076249:0:138579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076258:0:138579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076262:0:138579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.076266:0:138579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df0d1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759411.115979:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759411.116000:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211908736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759411.116078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759411.116159:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908736 00000100:00100000:1.0:1782759411.116166:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908736 00000100:00100000:1.0:1782759411.116222:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1782759411.116231:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211908736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759411.116264:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759411.116319:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211908736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759411.116327:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1782759411.116387:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211908736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759411.308570:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759411.884869:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759411.884877:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759411.884884:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759411.884934:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.884945:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.884956:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759411.884985:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211908864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759411.885061:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759411.885136:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198924780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759411.885157:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908864 00000100:00100000:3.0:1782759411.885168:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908864 00000100:00100000:3.0:1782759411.885233:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1782759411.885245:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211908864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759411.885262:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759411.885280:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df0d8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.885325:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.885337:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.885348:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759411.885405:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211908864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759411.885414:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1782759411.885437:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211908864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759411.885452:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.885459:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759411.885476:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759411.885480:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.885493:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759412.332393:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759412.403753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759412.403799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759412.403849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759412.403883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759412.403915:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225216 00000100:00100000:0.0:1782759412.403925:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225216 00000100:00100000:3.0:1782759412.403934:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225472 00000100:00100000:3.0:1782759412.403940:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225472 00000100:00100000:0.0:1782759412.403994:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2493 00000100:00100000:3.0:1782759412.403998:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225344 00000100:00100000:3.0:1782759412.404004:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225344 00000100:00100000:0.0:1782759412.404009:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197225216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759412.404031:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00100000:3.0:1782759412.404042:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197225472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759412.404061:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1947 00000100:00100000:1.0:1782759412.404074:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197225344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759412.404088:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197225216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759412.404109:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2493 00000100:00100000:2.0:1782759412.404134:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225088 00000100:00080000:0.0:1782759412.404136:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759412.404141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759412.404142:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225088 00000100:00080000:0.0:1782759412.404145:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759412.404176:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2616 00000100:00100000:2.0:1782759412.404185:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197225088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759412.404749:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197225472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 707us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759412.404750:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197225344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 678us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.404765:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00100000:1.0:1782759412.404772:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1947 00000100:00100000:2.0:1782759412.405567:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197225088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1379us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759412.405578:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2616 00000020:00000080:1.0:1782759412.506221:0:138727:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3fc931f0 20000000:00000080:1.0:1782759412.506239:0:138727:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a1c00 uarg=0000000000000000 10000000:01000000:1.0:1782759412.506579:0:138727:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759412.506598:0:138727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759412.506612:0:138727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759412.506618:0:138727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759412.506649:0:138727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759412.506664:0:138727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 18 pid: 5793 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759412.506675:0:138727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138727:1869355211908992:0@lo:104: 00000100:00100000:1.0:1782759412.506732:0:138727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759412.506885:0:138727:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759412.506947:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211908992 00000100:00100000:2.0:1782759412.506954:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211908992 00000100:00100000:2.0:1782759412.507002:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1782759412.507011:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:138727:x1869355211908992:12345-0@lo:104: 00010000:00010000:2.0:1782759412.507032:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.507144:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759412.507150:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:138727:x1869355211908992:12345-0@lo:104: Request processed in 141us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759412.507158:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1782759412.507214:0:138727:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138727:1869355211908992:0@lo:104: 00010000:00010000:1.0:1782759412.507233:0:138727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759412.507288:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759412.507296:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759412.507305:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759412.507309:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759412.507317:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759412.507331:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759412.507337:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759412.507369:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759412.507376:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759412.507401:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759412.507406:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211909120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759412.507412:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98e00/0xdd99f5c4777df0d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df0df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759412.507437:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759412.507439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759412.507441:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759412.507444:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759412.507521:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909120 00000100:00100000:3.0:1782759412.507527:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909120 00010000:00010000:3.0:1782759412.507551:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 19 pid: 5793 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759412.507587:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1782759412.507595:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211909120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759412.507606:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759412.507619:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 19 pid: 5793 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507630:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 19 pid: 5793 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507642:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df0d8 expref: 19 pid: 5793 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507653:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507660:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507673:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507679:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507685:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507691:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507696:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759412.507701:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507708:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507729:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.507739:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759412.507755:0:138727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759412.507764:0:138727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759412.507771:0:138727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777df0e6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759412.507787:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211909120:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.507797:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1782759412.507881:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211909120:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1782759412.897377:0:138775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdeed0210 20000000:00000080:2.0:1782759412.897393:0:138775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc2800 uarg=0000000000000000 10000000:01000000:2.0:1782759412.897649:0:138775:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759412.897669:0:138775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897685:0:138775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897695:0:138775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897702:0:138775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897709:0:138775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897715:0:138775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897721:0:138775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759412.897724:0:138775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897741:0:138775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897753:0:138775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897760:0:138775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.897766:0:138775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df0ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759413.183744:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968021 is committed 00000020:00000080:1.0:1782759413.265024:0:138826:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffecfb1d700 20000000:00000080:1.0:1782759413.265041:0:138826:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a1800 uarg=0000000000000000 10000000:01000000:1.0:1782759413.265596:0:138826:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759413.265616:0:138826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265632:0:138826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265648:0:138826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265656:0:138826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265662:0:138826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265669:0:138826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265676:0:138826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759413.265680:0:138826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265688:0:138826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265700:0:138826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265707:0:138826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.265713:0:138826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031800/0xdd99f5c4777df0f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759413.356477:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759413.672915:0:138874:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbde46d50 20000000:00000080:3.0:1782759413.672938:0:138874:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081117c00 uarg=0000000000000000 10000000:01000000:3.0:1782759413.673225:0:138874:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759413.673253:0:138874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673274:0:138874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673287:0:138874:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673294:0:138874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673302:0:138874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673309:0:138874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673316:0:138874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759413.673321:0:138874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673338:0:138874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673354:0:138874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673363:0:138874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759413.673370:0:138874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df0fb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759413.675996:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211909248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759413.676126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759413.676182:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909248 00000100:00100000:3.0:1782759413.676194:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909248 00000100:00080000:2.0:1782759413.676251:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759413.676278:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1782759413.676294:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211909248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759413.676341:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759413.676412:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211909248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759413.676421:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1782759413.676464:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211909248:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782759414.056795:0:138923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1fd25400 20000000:00000080:2.0:1782759414.056818:0:138923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc1000 uarg=0000000000000000 00010000:00010000:2.0:1782759414.057117:0:138923:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759414.057128:0:138923:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759414.057140:0:138923:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759414.057160:0:138923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057176:0:138923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057185:0:138923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057196:0:138923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057201:0:138923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057206:0:138923:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057210:0:138923:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759414.057214:0:138923:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057219:0:138923:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057230:0:138923:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057235:0:138923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.057240:0:138923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df102 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759414.124815:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759414.124993:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759414.124999:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759414.125039:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125049:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125070:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759414.125101:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211909376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759414.125170:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759414.125220:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759414.125244:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909376 00000100:00100000:1.0:1782759414.125251:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909376 00000100:00100000:1.0:1782759414.125307:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:1.0:1782759414.125316:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211909376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759414.125330:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759414.125344:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df109 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125366:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125378:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125388:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759414.125426:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211909376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759414.125439:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:1.0:1782759414.125493:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211909376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759414.125506:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125515:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759414.125533:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759414.125537:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.125545:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759414.380096:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759415.405394:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759415.724976:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211909504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759415.725105:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211909760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725119:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211910016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759415.725150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759415.725159:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909504 00000100:00100000:1.0:1782759415.725165:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909504 00000100:00100000:0.0:1782759415.725192:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782759415.725202:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211909632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725205:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:1.0:1782759415.725215:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211909504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759415.725230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759415.725269:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211910144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725278:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211909504:12345-0@lo:400:kworker.0 Request processed in 63us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759415.725289:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:3.0:1782759415.725308:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211909888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759415.725317:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759415.725355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759415.725355:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909760 00000100:00100000:0.0:1782759415.725361:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909632 00000100:00100000:0.0:1782759415.725366:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909632 00000100:00100000:1.0:1782759415.725376:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909760 00000100:00100000:3.0:1782759415.725408:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211910144 00000100:00100000:0.0:1782759415.725413:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:3.0:1782759415.725415:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211910144 00000100:00100000:1.0:1782759415.725425:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1782759415.725426:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211909632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725439:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211909760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759415.725453:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211909888 00000100:00100000:3.0:1782759415.725458:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211909888 00000100:00100000:0.0:1782759415.725485:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211909632:12345-0@lo:400:kworker.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759415.725489:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1782759415.725493:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211909760:12345-0@lo:400:kworker.0 Request processed in 56us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759415.725502:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211910144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759415.725503:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:1.0:1782759415.725511:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:0.0:1782759415.725534:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00080000:1.0:1782759415.725541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759415.725546:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759415.725547:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211909888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759415.725552:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211910144:12345-0@lo:400:kworker.0 Request processed in 52us (237us total) trans 0 rc 0/0 00000100:00080000:1.0:1782759415.725552:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759415.725562:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1782759415.725578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759415.725602:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211909888:12345-0@lo:400:kworker.0 Request processed in 58us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759415.725607:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211910016 00000100:00100000:3.0:1782759415.725613:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211910016 00000100:00100000:0.0:1782759415.725613:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1782759415.725626:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211909504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759415.725653:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00080000:1.0:1782759415.725656:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759415.725686:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211909888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725710:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211909632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725719:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211910144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725728:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211909760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759415.725849:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211910016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759415.725990:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211910016:12345-0@lo:400:kworker.0 Request processed in 327us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759415.725997:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:0.0:1782759415.726018:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211910016:0@lo:400:kworker.0 00000020:00000080:3.0:1782759415.940267:0:139118:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffee00df40 20000000:00000080:3.0:1782759415.940287:0:139118:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081114800 uarg=0000000000000000 00010000:00010000:3.0:1782759415.940597:0:139118:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759415.940613:0:139118:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759415.940628:0:139118:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759415.940650:0:139118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759415.940668:0:139118:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759415.940678:0:139118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759415.940717:0:139118:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759415.940730:0:139118:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 18 pid: 5793 timeout: 3584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759415.940747:0:139118:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139118:1869355211910272:0@lo:104: 00000100:00100000:3.0:1782759415.940814:0:139118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759415.940985:0:139118:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759415.941072:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759415.941085:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211910272 00000100:00100000:2.0:1782759415.941091:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211910272 00000100:00100000:2.0:1782759415.941171:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1782759415.941181:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082735450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139118:x1869355211910272:12345-0@lo:104: 00010000:00010000:2.0:1782759415.941200:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759415.941268:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759415.941275:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082735450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139118:x1869355211910272:12345-0@lo:104: Request processed in 96us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759415.941284:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00010000:00010000:0.0:1782759415.941291:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759415.941301:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941310:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759415.941315:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941325:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759415.941344:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759415.941351:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1782759415.941383:0:139118:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139118:1869355211910272:0@lo:104: 00010000:00010000:0.0:1782759415.941389:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941397:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759415.941404:0:139118:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941422:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941431:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030200/0xdd99f5c4777df109 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df110 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759415.941447:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211910400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759415.941449:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759415.941454:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759415.941455:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759415.941485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759415.941583:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211910400 00000100:00100000:0.0:1782759415.941589:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211910400 00010000:00010000:0.0:1782759415.941611:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 19 pid: 5793 timeout: 3584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759415.941636:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1782759415.941644:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211910400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759415.941655:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759415.941659:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 19 pid: 5793 timeout: 3584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941671:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 19 pid: 5793 timeout: 3584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941691:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777df110 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df109 expref: 19 pid: 5793 timeout: 3584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941703:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941711:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941723:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941801:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941808:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941814:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941819:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759415.941850:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941858:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941879:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759415.941900:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759415.941928:0:139118:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.941937:0:139118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.941944:0:139118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc200/0xdd99f5c4777df117 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759415.943051:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211910400:12345-0@lo:103:ldlm_bl.0 Request processed in 1402us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759415.943065:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1782759415.944278:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211910400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759416.236107:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211910528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759416.236172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759416.236244:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211910528 00000100:00100000:3.0:1782759416.236259:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211910528 00000100:00100000:3.0:1782759416.236338:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1782759416.236350:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211910528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759416.236397:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759416.236478:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211910528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759416.236486:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1782759416.236633:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211910528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759416.428919:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759417.131910:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759417.131920:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759417.131925:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759417.131974:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.131987:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.132011:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759417.132039:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211910656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.132112:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.132155:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211910656 00000100:00100000:1.0:1782759417.132164:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211910656 00000100:00100000:0.0:1782759417.132178:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.132246:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:1.0:1782759417.132254:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211910656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759417.132265:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759417.132276:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df11e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.132293:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.132301:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.132308:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031000, rc 0) 00000100:00100000:1.0:1782759417.132342:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211910656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.132347:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1782759417.132386:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211910656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759417.132402:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.132413:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759417.132432:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759417.132450:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.132458:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759417.254004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759417.254323:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225600 00000100:00100000:1.0:1782759417.254334:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225600 00000100:00080000:3.0:1782759417.254408:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759417.254430:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1894 00000100:00100000:1.0:1782759417.254447:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97925:x1869355197225600:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759417.254471:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759417.254502:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777df12c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d83 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.254586:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df133 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.254605:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.254620:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759417.254895:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759417.254900:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759417.254982:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.255022:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777df12c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d83 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.255042:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df133 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d83 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.255052:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759417.255055:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759417.255061:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031800, rc 0) 00000100:00100000:1.0:1782759417.255140:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97925:x1869355197225600:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 695us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.255157:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1894 00000100:00100000:3.0:1782759417.257500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759417.257561:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225728 00000100:00100000:1.0:1782759417.257571:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225728 00000100:00100000:1.0:1782759417.257626:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1895 00000100:00100000:1.0:1782759417.257640:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97925:x1869355197225728:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759417.319241:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97925:x1869355197225728:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 61587us (61730us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.319259:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1895 00000100:00100000:3.0:1782759417.333027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759417.333107:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225856 00000100:00100000:1.0:1782759417.333120:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225856 00000100:00100000:1.0:1782759417.333195:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1896 00000100:00100000:1.0:1782759417.333209:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97926:x1869355197225856:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759417.361488:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97926:x1869355197225856:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 28271us (28462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.361505:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1896 00000100:00100000:2.0:1782759417.373601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759417.373685:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197225984 00000100:00100000:1.0:1782759417.373699:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197225984 00000100:00100000:1.0:1782759417.373793:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1897 00000100:00100000:1.0:1782759417.373806:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97927:x1869355197225984:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759417.429256:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97927:x1869355197225984:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 55445us (55658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.429268:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1897 00000100:00100000:3.0:1782759417.441069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759417.441182:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226112 00000100:00100000:0.0:1782759417.441191:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226112 00000100:00100000:0.0:1782759417.441479:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1898 00000100:00100000:0.0:1782759417.441491:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97928:x1869355197226112:12345-192.168.204.31@tcp:48:lfs.0 00010000:00010000:0.0:1782759417.451960:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759417.472613:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97928:x1869355197226112:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 31114us (31541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.472628:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1898 00000100:00100000:3.0:1782759417.482896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759417.482968:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226240 00000100:00100000:0.0:1782759417.482978:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226240 00000100:00100000:0.0:1782759417.483053:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1899 00000100:00100000:0.0:1782759417.483064:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97929:x1869355197226240:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759417.524553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759417.524606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759417.524717:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226496 00000100:00100000:2.0:1782759417.524727:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226496 00000100:00100000:3.0:1782759417.524740:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226368 00000100:00100000:3.0:1782759417.524747:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226368 00000100:00100000:2.0:1782759417.524791:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1950 00000100:00100000:3.0:1782759417.524796:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2620 00000100:00100000:2.0:1782759417.524801:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197226496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759417.524810:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197226368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782759417.524855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759417.524885:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197226368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.524893:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2620 00000100:00100000:2.0:1782759417.525011:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197226496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 210us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.525019:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1950 00000100:00100000:3.0:1782759417.525579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759417.525619:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226624 00000100:00100000:0.0:1782759417.525623:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226624 00000100:00080000:3.0:1782759417.525670:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759417.525670:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1951 00000100:00100000:0.0:1782759417.525687:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197226624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759417.525737:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197226624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.525744:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1951 00000100:00100000:0.0:1782759417.547196:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97929:x1869355197226240:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 64126us (64300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.547208:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1899 00000100:00100000:3.0:1782759417.556671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759417.557579:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226752 00000100:00100000:2.0:1782759417.557591:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226752 00000100:00100000:2.0:1782759417.557657:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1900 00000100:00100000:2.0:1782759417.557678:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97930:x1869355197226752:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759417.588975:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97930:x1869355197226752:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 31298us (32302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.589000:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1900 00000020:00000080:2.0:1782759417.997757:0:139313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffeebf07990 20000000:00000080:2.0:1782759417.997774:0:139313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff917082bc1400 uarg=0000000000000000 00000040:00100000:2.0:1782759417.998736:0:139313:0:(llog.c:1067:llog_reverse_process()) index 41 : idx 1 00000040:00080000:2.0:1782759417.999028:0:139313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 224 off15448 20000000:01000000:2.0:1782759417.999047:0:139313:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool64c (null) (null) 00000040:00080000:2.0:1782759417.999080:0:139313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 104 off15552 00000040:00080000:2.0:1782759417.999113:0:139313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15776 00000040:00080000:2.0:1782759417.999451:0:139313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 224 off14712 20000000:01000000:2.0:1782759417.999462:0:139313:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool64c (null) (null) 00000040:00080000:2.0:1782759417.999491:0:139313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 112 off14824 00000040:00080000:2.0:1782759417.999534:0:139313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off15048 10000000:01000000:2.0:1782759417.999547:0:139313:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782759417.999564:0:139313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999581:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999589:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999596:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999614:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999621:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999628:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999635:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999646:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999654:0:139313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999662:0:139313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999697:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999711:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 9 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.999726:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211910784:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759417.999853:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999867:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 9 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.999877:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211910912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759417.999915:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.999923:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 18 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.999932:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911040:0@lo:104: 00000100:00100000:2.0:1782759417.999969:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.000614:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911040 00000100:00100000:1.0:1782759418.000622:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911040 00010000:00010000:2.0:1782759418.000630:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.000638:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 18 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.000645:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911168:0@lo:104: 00000100:00100000:2.0:1782759418.000665:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.000665:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1782759418.000674:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911040:12345-0@lo:104: 00010000:00010000:1.0:1782759418.000687:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.000689:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911168 00000100:00100000:2.0:1782759418.000692:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911168 00000100:00100000:2.0:1782759418.000708:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1782759418.000713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139313:x1869355211911168:12345-0@lo:104: 00010000:00010000:2.0:1782759418.000720:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.000732:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759418.000738:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139313:x1869355211911040:12345-0@lo:104: Request processed in 66us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759418.000745:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00010000:00010000:2.0:1782759418.000746:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759418.000756:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139313:x1869355211911168:12345-0@lo:104: Request processed in 43us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.000761:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00010000:00010000:2.0:1782759418.000784:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.000792:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 18 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.000800:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911296:0@lo:104: 00000100:00100000:2.0:1782759418.000841:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759418.000864:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.000872:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 18 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.000880:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911424:0@lo:104: 00000100:00100000:2.0:1782759418.000901:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.000920:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911296 00000100:00100000:2.0:1782759418.000923:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911296 00000100:00100000:2.0:1782759418.000938:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911424 00000100:00100000:2.0:1782759418.000941:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911424 00000100:00100000:2.0:1782759418.000952:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1782759418.000956:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139313:x1869355211911296:12345-0@lo:104: 00010000:00010000:2.0:1782759418.000963:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001005:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782759418.001010:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139313:x1869355211911296:12345-0@lo:104: Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.001023:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1782759418.001034:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1782759418.001040:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911424:12345-0@lo:104: 00010000:00010000:2.0:1782759418.001047:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001072:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782759418.001077:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911424:12345-0@lo:104: Request processed in 38us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.001082:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00010000:00010000:2.0:1782759418.001107:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001116:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 18 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.001124:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911552:0@lo:104: 00000100:00100000:2.0:1782759418.001144:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.001161:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911552 00000100:00100000:2.0:1782759418.001165:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911552 00000100:00100000:2.0:1782759418.001179:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1782759418.001184:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911552:12345-0@lo:104: 00010000:00010000:2.0:1782759418.001191:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001215:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1782759418.001219:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911552:12345-0@lo:104: Request processed in 36us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.001230:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00010000:00010000:2.0:1782759418.001254:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001262:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 18 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.001271:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911680:0@lo:104: 00000100:00100000:2.0:1782759418.001290:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.001307:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911680 00000100:00100000:2.0:1782759418.001310:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911680 00000100:00100000:2.0:1782759418.001325:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1782759418.001330:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911680:12345-0@lo:104: 00010000:00010000:2.0:1782759418.001337:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001361:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1782759418.001366:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911680:12345-0@lo:104: Request processed in 36us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.001371:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00010000:00010000:2.0:1782759418.001394:0:139313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001402:0:139313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 18 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.001409:0:139313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911808:0@lo:104: 00000100:00100000:2.0:1782759418.001432:0:139313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.001459:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759418.001467:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911808 00000100:00100000:2.0:1782759418.001470:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911808 00000100:00100000:2.0:1782759418.001484:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1782759418.001489:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911808:12345-0@lo:104: 00010000:00010000:2.0:1782759418.001496:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001519:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1782759418.001523:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139313:x1869355211911808:12345-0@lo:104: Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.001528:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1782759418.001556:0:139313:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191f1d840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759418.001576:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911040:0@lo:104: 00000100:00100000:2.0:1782759418.001584:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911168:0@lo:104: 00000100:00100000:2.0:1782759418.001590:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911296:0@lo:104: 00000100:00100000:2.0:1782759418.001596:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911424:0@lo:104: 00000100:00100000:2.0:1782759418.001602:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911552:0@lo:104: 00000100:00100000:2.0:1782759418.001608:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911680:0@lo:104: 00000100:00100000:2.0:1782759418.001614:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211911808:0@lo:104: 00010000:00010000:2.0:1782759418.001647:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1782759418.001653:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001660:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181694e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759418.001664:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001681:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.001689:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.001694:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.001717:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001724:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759418.001739:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001746:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181694e00/0xdd99f5c4777d5cf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cff expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001757:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1782759418.001761:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001766:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759418.001769:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001775:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.001781:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.001791:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.001804:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001810:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759418.001846:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.001854:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782759418.001855:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4a00/0xdd99f5c4777d5cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cf1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.001859:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001868:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782759418.001874:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171814a8600 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:2.0:1782759418.001875:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.001878:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001893:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:1.0:1782759418.001894:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.001899:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.001901:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759418.001916:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.001918:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.001926:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.001931:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759418.001932:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.001937:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759418.001943:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001948:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.001948:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171814a8600/0xdd99f5c4777d5cdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5ce3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001967:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759418.001971:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782759418.001974:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.001996:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002004:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030800/0xdd99f5c4777d5cce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cd5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002014:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782759418.002016:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:2.0:1782759418.002019:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.002021:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002037:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171814a8e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759418.002040:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002061:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.002063:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.002070:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.002076:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.002088:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002093:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759418.002097:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002103:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171814a8e00/0xdd99f5c4777d5cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cb9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002114:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759418.002122:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002137:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917181695000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759418.002141:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.002141:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759418.002160:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.002161:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.002170:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.002175:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759418.002178:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.002185:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759418.002192:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002194:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.002204:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777d5cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cc7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002206:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759418.002215:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.002219:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759418.002222:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759418.002224:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.002227:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917181695000/0xdd99f5c4777d5ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777d5cab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.002242:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.002245:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.002248:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759418.002253:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211911936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759418.002257:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759418.002269:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211912320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.002285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.002304:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211912192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.002389:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211912448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759418.002391:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211911936 00000100:00100000:2.0:1782759418.002396:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211911936 00000100:00100000:1.0:1782759418.002416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.002443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.002459:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211912064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.002472:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211912704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.002487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.002511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.002514:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211912576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.002547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.002550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.002583:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912448 00000100:00100000:0.0:1782759418.002587:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912448 00000100:00100000:1.0:1782759418.002598:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912192 00000100:00100000:1.0:1782759418.002603:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912192 00000100:00100000:3.0:1782759418.002734:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912064 00000100:00100000:3.0:1782759418.002738:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912064 00010000:00010000:2.0:1782759418.002773:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 22 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.002787:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912704 00000100:00100000:2.0:1782759418.002789:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912704 00010000:00010000:0.0:1782759418.003029:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 23 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.003031:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 23 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.003056:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912576 00000100:00100000:0.0:1782759418.003060:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912576 00000100:00100000:1.0:1782759418.003063:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912320 00010000:00010000:0.0:1782759418.003074:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 24 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.003087:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1782759418.003092:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3306:x1869355211911936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.003101:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.003105:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 24 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759418.003120:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 24 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003124:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 24 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.003128:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912320 00000100:00100000:3.0:1782759418.003137:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00010000:00010000:0.0:1782759418.003137:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3690a00/0xdd99f5c4777d5cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5cf8 expref: 25 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.003145:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3306:x1869355211912448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.003148:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 24 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003149:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759418.003160:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759418.003167:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 24 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.003174:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00010000:00010000:3.0:1782759418.003179:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 24 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.003182:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3306:x1869355211911936:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759418.003187:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3308:x1869355211912192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759418.003194:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030a00/0xdd99f5c4777d5cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5cb2 expref: 24 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.003194:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00010000:00010000:1.0:1782759418.003198:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759418.003202:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759418.003205:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 22 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.003212:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00010000:00010000:1.0:1782759418.003222:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 22 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.003224:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3307:x1869355211912576:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759418.003228:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3306:x1869355211912448:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (811us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759418.003236:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782759418.003242:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00010000:00010000:0.0:1782759418.003242:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 22 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.003247:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171814a8400/0xdd99f5c4777d5ce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5cdc expref: 22 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.003256:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00010000:00010000:0.0:1782759418.003256:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 21 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.003264:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3307:x1869355211912064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.003265:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759418.003271:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.003271:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031400/0xdd99f5c4777d5cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5cc0 expref: 20 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759418.003276:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 20 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003281:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759418.003284:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 19 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759418.003292:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777d5cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5cea expref: 19 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759418.003300:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.003310:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211912576:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759418.003316:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211912064:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.003317:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1782759418.003328:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1782759418.003333:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3305:x1869355211912320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.003345:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759418.003349:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 17 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003349:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 17 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003358:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 17 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003367:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777d5cd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5cce expref: 17 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.003375:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759418.003379:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1782759418.003401:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3305:x1869355211912320:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.003408:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1782759418.003418:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211912320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.003433:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211912064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759418.003438:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211911936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.003440:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211912576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759418.003445:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211912448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759418.003498:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1782759418.003507:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3308:x1869355211912704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759418.003515:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759418.003520:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 14 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.003524:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3308:x1869355211912192:12345-0@lo:103:ldlm_bl.0 Request processed in 339us (1077us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759418.003536:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 14 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.003536:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00010000:00010000:2.0:1782759418.003552:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b3691000/0xdd99f5c4777d5cab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777d5ca4 expref: 13 pid: 5794 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.003562:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.003574:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211912192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759418.003587:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:3308:x1869355211912704:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.003587:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211912704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759418.003593:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1782759418.004741:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211910784:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759418.004747:0:139313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139313:1869355211910912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759418.004772:0:139313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.005392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759418.005419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759418.005436:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227008 00000100:00100000:0.0:1782759418.005442:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227008 00010000:00010000:0.0:1782759418.005462:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 10 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.005483:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197226880 00000100:00100000:0.0:1782759418.005485:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197226880 00010000:00010000:0.0:1782759418.005493:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 11 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.005520:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:0.0:1782759418.005528:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197227008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.005539:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.005544:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 11 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005552:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 11 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005565:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777deb21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c10 expref: 11 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005574:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.005613:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197227008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.005619:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 585 00000100:00100000:0.0:1782759418.005630:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 586 00000100:00100000:0.0:1782759418.005635:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2362:x1869355197226880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.005645:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.005649:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 9 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005658:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 9 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005667:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777deb28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c17 expref: 9 pid: 5793 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005681:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005688:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005700:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005711:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005717:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005724:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005729:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759418.005733:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005740:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005751:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.005760:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.005777:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2362:x1869355197226880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.005793:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 586 00010000:00010000:2.0:1782759418.005975:0:139313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.005993:0:139313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.006000:0:139313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df13a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.476065:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759418.796215:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759418.796237:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211912832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759418.796312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.796387:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912832 00000100:00100000:0.0:1782759418.796395:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912832 00000100:00080000:3.0:1782759418.796490:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759418.796860:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1782759418.796875:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211912832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759418.796912:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759418.796982:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211912832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.796989:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:1.0:1782759418.797088:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211912832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759419.252450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759419.252541:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227136 00000100:00100000:1.0:1782759419.252552:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227136 00000100:00100000:1.0:1782759419.252667:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2621 00000100:00100000:1.0:1782759419.252678:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197227136:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759419.252696:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759419.252717:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d8a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.252746:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.252758:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.252767:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030600, rc 0) 00000100:00100000:1.0:1782759419.252846:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197227136:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 170us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.252853:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2621 00000100:00100000:0.0:1782759419.254619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759419.254756:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227264 00000100:00100000:3.0:1782759419.254764:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227264 00000100:00100000:3.0:1782759419.254807:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2622 00000100:00100000:3.0:1782759419.254816:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197227264:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759419.255140:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197227264:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 325us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759419.255146:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2622 00000100:00100000:0.0:1782759419.259928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759419.260000:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227392 00000100:00100000:1.0:1782759419.260009:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227392 00000100:00100000:1.0:1782759419.260059:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2623 00000100:00100000:1.0:1782759419.260071:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197227392:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759419.260287:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197227392:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 218us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.260296:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2623 00000100:00100000:0.0:1782759419.262298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759419.262352:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227520 00000100:00100000:3.0:1782759419.262359:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227520 00000100:00100000:3.0:1782759419.262457:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2624 00000100:00100000:3.0:1782759419.262467:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97942:x1869355197227520:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759419.262718:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97942:x1869355197227520:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 251us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759419.262737:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2624 00000100:00100000:0.0:1782759419.265555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759419.265626:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227648 00000100:00100000:1.0:1782759419.265635:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227648 00000100:00100000:1.0:1782759419.265735:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2625 00000100:00100000:1.0:1782759419.265746:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97942:x1869355197227648:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759419.266306:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97942:x1869355197227648:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 560us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.266315:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2625 00000100:00100000:0.0:1782759419.269728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759419.269973:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227776 00000100:00100000:1.0:1782759419.269986:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227776 00000100:00100000:1.0:1782759419.270051:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2626 00000100:00100000:1.0:1782759419.270062:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197227776:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759419.270078:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759419.270095:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d91 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.270124:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.270135:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.270144:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030a00, rc 0) 00000100:00100000:1.0:1782759419.270213:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197227776:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 153us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.270220:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2626 00000100:00100000:0.0:1782759419.273853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759419.274067:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197227904 00000100:00100000:1.0:1782759419.274076:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197227904 00000100:00100000:1.0:1782759419.274225:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2627 00000100:00100000:1.0:1782759419.274236:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197227904:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759419.274911:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197227904:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 676us (1095us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759419.274927:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2627 00010000:00010000:2.0:1782759419.500004:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759420.012135:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759420.012142:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 42 10000000:01000000:2.0:1782759420.012146:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759420.012213:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.012226:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.012238:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.012266:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211912960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.012343:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.012400:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.012460:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211912960 00000100:00100000:1.0:1782759420.012467:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211912960 00000100:00100000:1.0:1782759420.012575:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:1.0:1782759420.012587:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355211912960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.012601:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759420.012614:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df14f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.012638:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.012648:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.012657:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759420.012776:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211912960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.012784:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1782759420.012855:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211912960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.012884:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.013070:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.013116:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.013134:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.013156:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.013170:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913088 00000100:00100000:1.0:1782759420.013174:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913088 00000100:00100000:1.0:1782759420.013206:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:1.0:1782759420.013212:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211913088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.013482:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211913088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.013489:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1782759420.013510:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.013538:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.013574:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.013592:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.013675:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913216 00000100:00100000:1.0:1782759420.013685:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913216 00000100:00100000:1.0:1782759420.013712:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1782759420.013719:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211913216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.013873:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211913216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.013880:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1782759420.013968:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.014266:0:139315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139315:1869355211913344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.014298:0:139315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.014323:0:139315:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.014349:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913344 00000100:00100000:3.0:1782759420.014361:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913344 00000100:00100000:3.0:1782759420.014388:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1782759420.014395:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139315:x1869355211913344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.014547:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139315:x1869355211913344:12345-0@lo:502:llog_process_th.0 Request processed in 151us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.014554:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1782759420.014585:0:139315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139315:1869355211913344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.014625:0:139315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139315:1869355211913472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.014654:0:139315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.014678:0:139315:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.014727:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913472 00000100:00100000:1.0:1782759420.014731:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913472 00000100:00100000:1.0:1782759420.014790:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1782759420.014798:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139315:x1869355211913472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.014915:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139315:x1869355211913472:12345-0@lo:502:llog_process_th.0 Request processed in 118us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.014920:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1782759420.014965:0:139315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139315:1869355211913472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759420.014988:0:139315:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:1.0:1782759420.015071:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:1.0:1782759420.015095:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759420.015107:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.015118:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759420.015128:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1782759420.015131:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1782759420.015134:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782759420.015154:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.015163:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.015179:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.015193:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.015219:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.015249:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.015305:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913600 00000100:00100000:3.0:1782759420.015309:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913600 00000100:00100000:2.0:1782759420.015367:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1782759420.015375:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211913600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.015384:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759420.015394:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df15d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.015417:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.015424:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.015430:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64a00, rc 0) 00000100:00100000:2.0:1782759420.015487:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211913600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.015492:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1782759420.015532:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.015541:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.015547:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.015575:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.015593:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.015608:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.015635:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913728 00000100:00100000:3.0:1782759420.015639:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913728 00000100:00100000:3.0:1782759420.015667:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:3.0:1782759420.015674:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211913728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.015909:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211913728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.015916:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:1.0:1782759420.015938:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.015976:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.016009:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.016073:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.016107:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913856 00000100:00100000:2.0:1782759420.016111:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913856 00000100:00100000:2.0:1782759420.016139:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1782759420.016146:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211913856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.016404:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211913856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.016411:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1782759420.016440:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759420.018513:0:139316:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:2.0:1782759420.018596:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1782759420.018625:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782759420.018637:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.018660:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759420.018670:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759420.018673:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 42 10000000:01000000:2.0:1782759420.018696:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759420.018742:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.018751:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.018767:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.018792:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.018894:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.018937:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.019034:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211913984 00000100:00100000:3.0:1782759420.019041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211913984 00000100:00100000:3.0:1782759420.019086:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:3.0:1782759420.019096:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211913984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.019110:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759420.019120:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df16b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.019137:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.019153:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.019159:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd800, rc 0) 00000100:00100000:3.0:1782759420.019193:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211913984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.019198:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:1.0:1782759420.019227:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211913984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.019243:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.019259:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.019304:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.019330:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.019348:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.019369:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914112 00000100:00100000:2.0:1782759420.019374:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914112 00000100:00100000:2.0:1782759420.019401:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:2.0:1782759420.019406:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211914112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.019598:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211914112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.019603:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:1.0:1782759420.019630:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.019658:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.019694:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.019711:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.019722:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914240 00000100:00100000:2.0:1782759420.019726:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914240 00000100:00100000:2.0:1782759420.019742:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:2.0:1782759420.019747:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211914240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.019891:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211914240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.019897:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1782759420.019909:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.020210:0:139317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139317:1869355211914368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.020234:0:139317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.020250:0:139317:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.020265:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914368 00000100:00100000:3.0:1782759420.020270:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914368 00000100:00100000:3.0:1782759420.020295:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:3.0:1782759420.020304:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139317:x1869355211914368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.020466:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139317:x1869355211914368:12345-0@lo:502:llog_process_th.0 Request processed in 164us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.020474:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1782759420.020484:0:139317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139317:1869355211914368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.020527:0:139317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139317:1869355211914496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.020557:0:139317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.020574:0:139317:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.020597:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914496 00000100:00100000:2.0:1782759420.020607:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914496 00000100:00100000:2.0:1782759420.020636:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1782759420.020641:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139317:x1869355211914496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.020776:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139317:x1869355211914496:12345-0@lo:502:llog_process_th.0 Request processed in 134us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.020783:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1782759420.020802:0:139317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139317:1869355211914496:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759420.020844:0:139317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:2.0:1782759420.021062:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:2.0:1782759420.021082:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759420.021090:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.021099:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759420.021107:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759420.021109:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1782759420.021112:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759420.021135:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.021142:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.021164:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.021178:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.021205:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.021230:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.021238:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914624 00000100:00100000:1.0:1782759420.021243:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914624 00000100:00100000:1.0:1782759420.021285:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:1.0:1782759420.021293:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211914624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.021301:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759420.021312:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df179 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.021329:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.021339:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.021346:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030800, rc 0) 00000100:00100000:1.0:1782759420.021432:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211914624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.021439:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:3.0:1782759420.021490:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.021502:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.021510:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.021548:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.021576:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.021604:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.021616:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914752 00000100:00100000:2.0:1782759420.021621:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914752 00000100:00100000:2.0:1782759420.021843:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:2.0:1782759420.021853:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211914752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.022066:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211914752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.022073:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:3.0:1782759420.022095:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.022133:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.022169:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.022233:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211914880 00000100:00100000:2.0:1782759420.022237:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211914880 00000100:00100000:3.0:1782759420.022248:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.022272:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:2.0:1782759420.022278:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211914880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.022565:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211914880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 287us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.022569:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:3.0:1782759420.023608:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211914880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759420.024489:0:139318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:3.0:1782759420.024621:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1782759420.024642:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759420.024652:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.024663:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759420.024674:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759420.024677:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 42 10000000:01000000:3.0:1782759420.024680:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759420.024712:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.024869:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.024881:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.024906:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.024975:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.025012:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.027452:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915008 00000100:00100000:1.0:1782759420.027465:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915008 00000100:00100000:1.0:1782759420.027524:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:1.0:1782759420.027534:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211915008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.027550:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759420.027566:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df187 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.027592:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.027603:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.027628:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759420.027698:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211915008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.027705:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1782759420.027738:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.027765:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.027895:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.028209:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.028244:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.028271:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.029011:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915136 00000100:00100000:2.0:1782759420.029020:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915136 00000100:00100000:2.0:1782759420.029073:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:2.0:1782759420.029084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211915136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.029404:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211915136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.029413:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1782759420.029427:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.029463:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.029496:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.029516:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915264 00000100:00100000:1.0:1782759420.029522:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915264 00000100:00100000:3.0:1782759420.029523:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.029556:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:1.0:1782759420.029563:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211915264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.029726:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211915264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.029733:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:3.0:1782759420.029888:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.030192:0:139319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139319:1869355211915392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.030219:0:139319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.030238:0:139319:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.030257:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915392 00000100:00100000:0.0:1782759420.030263:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915392 00000100:00100000:0.0:1782759420.030295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:0.0:1782759420.030315:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139319:x1869355211915392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.030480:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139319:x1869355211915392:12345-0@lo:502:llog_process_th.0 Request processed in 177us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.030488:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1782759420.030526:0:139319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139319:1869355211915392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.030563:0:139319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139319:1869355211915520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.030594:0:139319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.030619:0:139319:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.030853:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915520 00000100:00100000:2.0:1782759420.030858:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915520 00000100:00100000:2.0:1782759420.030887:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:2.0:1782759420.030895:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139319:x1869355211915520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.031044:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139319:x1869355211915520:12345-0@lo:502:llog_process_th.0 Request processed in 150us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.031057:0:139319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139319:1869355211915520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.031059:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000040:00080000:1.0:1782759420.031086:0:139319:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:3.0:1782759420.031155:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:3.0:1782759420.031174:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759420.031184:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.031194:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759420.031203:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759420.031206:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:3.0:1782759420.031209:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759420.031230:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.031248:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.031258:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.031270:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.031295:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.031323:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.031368:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915648 00000100:00100000:0.0:1782759420.031372:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915648 00000100:00100000:0.0:1782759420.031395:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:0.0:1782759420.031402:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211915648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759420.031410:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759420.031420:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df195 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.031441:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.031450:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.031463:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759420.031529:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211915648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.031535:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:3.0:1782759420.031579:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.031591:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.031610:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.031653:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.031677:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.031698:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.031989:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915776 00000100:00100000:2.0:1782759420.031994:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915776 00000100:00100000:2.0:1782759420.032023:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:2.0:1782759420.032031:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211915776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.032249:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211915776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.032256:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1782759420.032300:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.032329:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.032364:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.032389:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.032409:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211915904 00000100:00100000:0.0:1782759420.032415:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211915904 00000100:00100000:0.0:1782759420.032447:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1782759420.032454:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211915904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.032579:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211915904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.032584:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1782759420.032636:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211915904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.033259:0:139320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139320:1869355211916032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.033301:0:139320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.033373:0:139320:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.033406:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916032 00000100:00100000:2.0:1782759420.033409:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916032 00000100:00100000:2.0:1782759420.033468:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:2.0:1782759420.033477:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139320:x1869355211916032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.033789:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139320:x1869355211916032:12345-0@lo:502:llog_process_th.0 Request processed in 313us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.033797:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:3.0:1782759420.034048:0:139320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139320:1869355211916032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759420.034163:0:139320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759420.034177:0:139320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759420.034179:0:139320:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-MDT0000-m new lustre.pool64c 00000020:00000080:3.0:1782759420.034185:0:139320:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1782759420.034237:0:139320:0:(lod_pool.c:475:lod_pool_new()) pool64c is pool #1 00080000:10000000:3.0:1782759420.035616:0:139320:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00080000:10000000:0.0:1782759420.057060:0:139320:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00080000:10000000:0.0:1782759420.073524:0:139320:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000100:00100000:0.0:1782759420.089336:0:139320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139320:1869355211916160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.089434:0:139320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.089502:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916160 00000100:00100000:0.0:1782759420.089510:0:139320:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.089511:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916160 00000100:00100000:1.0:1782759420.089564:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:1.0:1782759420.089575:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139320:x1869355211916160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.090000:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139320:x1869355211916160:12345-0@lo:502:llog_process_th.0 Request processed in 427us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.090009:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:0.0:1782759420.090037:0:139320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139320:1869355211916160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759420.090072:0:139320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759420.090081:0:139320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759420.090084:0:139320:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-MDT0000-m new lustre.pool64c 00000040:00080000:0.0:1782759420.090088:0:139320:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000020:01000000:3.0:1782759420.090194:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-39 (rc=0) 10000000:01000000:3.0:1782759420.090217:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782759420.090230:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.090334:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759420.090344:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782759420.090346:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759420.090348:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782759420.090377:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.090385:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.090394:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.090409:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211916288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.090439:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.090480:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.090497:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916288 00000100:00100000:2.0:1782759420.090503:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916288 00000100:00100000:2.0:1782759420.090538:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:2.0:1782759420.090545:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211916288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.090556:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759420.090570:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1a3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.090593:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.090605:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.090622:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64600, rc 0) 00000100:00100000:2.0:1782759420.090660:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211916288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.090669:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:3.0:1782759420.090692:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211916288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.090713:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.090723:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.090771:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211916416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.090795:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.090815:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.090853:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916416 00000100:00100000:1.0:1782759420.090970:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916416 00000100:00100000:1.0:1782759420.090998:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1782759420.091003:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211916416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.091147:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211916416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (350us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759420.091155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:3.0:1782759420.091179:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211916416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759420.091206:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759420.091212:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.091219:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.524022:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759420.844116:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211916672:0@lo:400:kworker.0 00000100:00100000:1.0:1782759420.844154:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211916544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.844201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.844201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.844256:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211916928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.844274:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211917184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759420.844297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.844325:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916672 00000100:00100000:2.0:1782759420.844333:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916672 00000100:00100000:0.0:1782759420.844347:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211916800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759420.844369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.844379:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916800 00000100:00100000:2.0:1782759420.844383:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916800 00000100:00100000:0.0:1782759420.844403:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916928 00000100:00100000:0.0:1782759420.844409:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916928 00000100:00100000:2.0:1782759420.844420:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:2.0:1782759420.844431:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211916672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759420.844451:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1782759420.844473:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211916928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.844492:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211916672:12345-0@lo:400:kworker.0 Request processed in 62us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.844501:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:0.0:1782759420.844520:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211916928:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.844524:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:0.0:1782759420.844531:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1782759420.844536:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759420.844571:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211916928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.844579:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211916800:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.844587:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:0.0:1782759420.844598:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211916800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759420.844613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.844636:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211916672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.844642:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917184 00000100:00100000:2.0:1782759420.844646:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917184 00000100:00100000:2.0:1782759420.844685:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00080000:3.0:1782759420.844696:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759420.844700:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759420.844704:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759420.844711:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211917184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759420.844714:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211916544 00000100:00100000:3.0:1782759420.844718:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211916544 00000100:00100000:3.0:1782759420.844743:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1782759420.844752:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211917184:12345-0@lo:400:kworker.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.844754:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211916544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.844768:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1782759420.844813:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211916544:12345-0@lo:400:kworker.0 Request processed in 64us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.844856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1782759420.844922:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211916544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759420.844956:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211917056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759420.845027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.845033:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211917184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.845076:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917056 00000100:00100000:2.0:1782759420.845081:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917056 00000100:00100000:2.0:1782759420.845116:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00080000:3.0:1782759420.845123:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759420.845123:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211917056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759420.845174:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211917056:12345-0@lo:400:kworker.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.845181:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1782759420.845228:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211917056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759421.356576:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759421.356606:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211917312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759421.356677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759421.356740:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917312 00000100:00100000:0.0:1782759421.356747:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917312 00000100:00100000:0.0:1782759421.356793:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:0.0:1782759421.356803:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211917312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759421.356868:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759421.356926:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211917312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.356933:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:0.0:1782759421.356983:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211917312:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759421.511396:0:139368:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc8e1392a0 20000000:00000080:2.0:1782759421.511416:0:139368:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91718853c000 uarg=0000000000000000 00000040:00100000:2.0:1782759421.512518:0:139368:0:(llog.c:1067:llog_reverse_process()) index 44 : idx 1 20000000:01000000:2.0:1782759421.512529:0:139368:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 43 cmd:0xce020 lustre.pool64c 00000040:00080000:2.0:1782759421.512967:0:139368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off16000 20000000:01000000:2.0:1782759421.513001:0:139368:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:2.0:1782759421.513043:0:139368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 128 off16128 00000040:00080000:2.0:1782759421.513084:0:139368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16352 00000040:00080000:2.0:1782759421.513265:0:139368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15272 20000000:01000000:2.0:1782759421.513273:0:139368:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:2.0:1782759421.513311:0:139368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 136 off15408 00000040:00080000:2.0:1782759421.513350:0:139368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15632 10000000:01000000:2.0:1782759421.513366:0:139368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782759421.513388:0:139368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513407:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513423:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513429:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513433:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513437:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513441:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513444:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513448:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513453:0:139368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513459:0:139368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513509:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513537:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 18 pid: 5796 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.513554:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917440:0@lo:104: 00000100:00100000:2.0:1782759421.513636:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759421.513709:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.513718:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 18 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.513727:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917568:0@lo:104: 00000100:00100000:2.0:1782759421.513749:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759421.513847:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917440 00000100:00100000:0.0:1782759421.513856:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917440 00000100:00100000:3.0:1782759421.513868:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917568 00000100:00100000:3.0:1782759421.513873:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917568 00010000:00010000:2.0:1782759421.513958:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.513963:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1782759421.513975:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00010000:00010000:2.0:1782759421.513976:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 18 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.513982:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139368:x1869355211917440:12345-0@lo:104: 00000100:00100000:3.0:1782759421.513990:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139368:x1869355211917568:12345-0@lo:104: 00000100:00100000:2.0:1782759421.513995:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917696:0@lo:104: 00000100:00100000:2.0:1782759421.514022:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759421.514061:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:0.0:1782759421.514068:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.514072:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759421.514072:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1782759421.514098:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 18 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.514109:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917824:0@lo:104: 00010000:00010000:0.0:1782759421.514154:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759421.514160:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759421.514164:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139368:x1869355211917440:12345-0@lo:104: Request processed in 188us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.514174:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00010000:00010000:2.0:1782759421.514189:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.514195:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917696 00000100:00100000:0.0:1782759421.514199:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917696 00010000:00010000:2.0:1782759421.514200:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 18 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.514203:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759421.514213:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.514214:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917824 00000100:00100000:2.0:1782759421.514217:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917952:0@lo:104: 00000100:00100000:0.0:1782759421.514218:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917824 00000100:00100000:0.0:1782759421.514233:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1782759421.514244:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759421.514258:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.514264:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 18 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.514269:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918080:0@lo:104: 00000100:00100000:2.0:1782759421.514284:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759421.514292:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.514297:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 18 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.514302:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918208:0@lo:104: 00000100:00100000:2.0:1782759421.514317:0:139368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759421.514326:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.514331:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 9 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.514346:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918336:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759421.514394:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:139368:x1869355211917696:12345-0@lo:104: 00010000:00010000:2.0:1782759421.514400:0:139368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.514412:0:139368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 9 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.514417:0:139368:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918464:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759421.514432:0:139368:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2f0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759421.514451:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917440:0@lo:104: 00010000:00010000:0.0:1782759421.515100:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.515236:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759421.515248:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:139368:x1869355211917696:12345-0@lo:104: Request processed in 1004us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.515252:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917696:0@lo:104: 00000100:00100000:0.0:1782759421.515268:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00010000:00010000:2.0:1782759421.515292:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759421.515300:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515309:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc1cbdc20) 00000100:00100000:0.0:1782759421.515311:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:00010000:2.0:1782759421.515314:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515328:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.515329:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211917952 10000000:00010000:2.0:1782759421.515343:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.515343:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211917952 10000000:01000000:2.0:1782759421.515356:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1782759421.515381:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211918080 00000100:00100000:0.0:1782759421.515386:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211918080 00000100:00100000:0.0:1782759421.515401:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211918208 00010000:00010000:2.0:1782759421.515402:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.515406:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211918208 00010000:00010000:2.0:1782759421.515423:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759421.515423:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1782759421.515437:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+7:139368:x1869355211917824:12345-0@lo:104: 00010000:00010000:2.0:1782759421.515454:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515463:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777df187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df18e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.515473:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515482:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759421.515486:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759421.515488:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759421.515531:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759421.515538:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+7:139368:x1869355211917824:12345-0@lo:104: Request processed in 103us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.515544:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917824:0@lo:104: 00000100:00100000:0.0:1782759421.515554:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1782759421.515578:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00010000:00010000:2.0:1782759421.515587:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782759421.515588:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+6:139368:x1869355211917952:12345-0@lo:104: 00010000:00010000:2.0:1782759421.515599:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.515602:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515633:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759421.515639:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515649:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759421.515656:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759421.515663:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759421.515690:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1782759421.515694:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.515713:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+6:139368:x1869355211917952:12345-0@lo:104: Request processed in 126us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.515730:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00010000:00010000:2.0:1782759421.515741:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759421.515754:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.515754:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1782759421.515768:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:139368:x1869355211918080:12345-0@lo:104: 00010000:00010000:2.0:1782759421.515771:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df180 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515786:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759421.515794:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.515795:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515850:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759421.515855:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515866:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759421.515875:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759421.515881:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759421.515890:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759421.515896:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:139368:x1869355211918080:12345-0@lo:104: Request processed in 135us (1611us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759421.515902:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.515903:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:2.0:1782759421.515929:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759421.515936:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1782759421.515949:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b347c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139368:x1869355211918208:12345-0@lo:104: 00010000:00010000:2.0:1782759421.515954:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.515958:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515976:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64400/0xdd99f5c4777df16b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df172 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515992:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759421.515994:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.515998:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759421.516000:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.516004:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759421.516008:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759421.516011:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759421.516022:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.516026:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759421.516030:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.516034:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180031400/0xdd99f5c4777df15d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df164 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.516040:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759421.516041:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759421.516042:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759421.516056:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211918592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759421.516096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759421.516138:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1782759421.516145:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcce00 already unused, calling callback (ffffffffc1cbdc20) 00000100:00100000:2.0:1782759421.516146:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211918720:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1782759421.516155:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.516167:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759421.516176:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.516177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759421.516178:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759421.516208:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782759421.516212:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211918976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759421.516239:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.516247:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759421.516265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759421.516266:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.516275:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df1a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1aa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759421.516285:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1782759421.516292:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759421.516302:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759421.516303:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:139368:x1869355211917568:12345-0@lo:104: Request processed in 2308us (2542us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759421.516303:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.516315:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211918848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759421.516322:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00010000:00010000:1.0:1782759421.516338:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759421.516343:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.516362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759421.516366:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759421.516375:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759421.516377:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211918592 00000100:00100000:3.0:1782759421.516384:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211918592 10000000:01000000:1.0:1782759421.516385:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782759421.516403:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211918720 00000100:00100000:2.0:1782759421.516409:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211918720 00010000:00010000:1.0:1782759421.516410:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759421.516418:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 20 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.516422:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759421.516434:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.516435:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 20 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.516453:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df19c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759421.516461:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211918976 00000100:00100000:2.0:1782759421.516466:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211918848 00010000:00010000:1.0:1782759421.516467:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759421.516469:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211918976 00000100:00100000:2.0:1782759421.516471:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211918848 00010000:00010000:1.0:1782759421.516472:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759421.516488:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.516488:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759421.516503:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1782759421.516506:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211919232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759421.516512:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3305:x1869355211918592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759421.516525:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759421.516530:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.516538:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759421.516551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759421.516560:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777df18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df187 expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759421.516570:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 22 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759421.516573:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759421.516588:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211919104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759421.516591:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759421.516605:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919232 00000100:00100000:3.0:1782759421.516612:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919232 00000100:00100000:1.0:1782759421.516632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759421.516640:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 22 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.516641:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3305:x1869355211918592:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.516659:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919104 00000100:00100000:1.0:1782759421.516668:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919104 00000100:00100000:2.0:1782759421.516669:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00010000:00010000:1.0:1782759421.516690:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 22 pid: 5796 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.517630:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1782759421.517642:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1782759421.517648:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3305:x1869355211918720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759421.517663:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759421.517670:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759421.517679:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3308:x1869355211918848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759421.517700:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759421.517701:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.517720:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030800/0xdd99f5c4777df180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df179 expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759421.517721:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 22 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759421.517761:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 21 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759421.517815:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1782759421.517846:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3308:x1869355211918976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759421.517858:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759421.517864:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 21 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.517904:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759421.517957:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3305:x1869355211918720:12345-0@lo:103:ldlm_bl.0 Request processed in 316us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.517964:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1782759421.517984:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1782759421.517991:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355211919232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759421.518000:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759421.518005:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 20 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518013:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 20 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518032:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759421.518065:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355211919232:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.518072:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1782759421.518089:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1782759421.518096:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211919104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759421.518105:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759421.518109:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 19 pid: 5796 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518119:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 19 pid: 5796 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518130:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1a3 expref: 19 pid: 5796 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518148:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759421.518181:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211919104:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.518189:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00010000:00010000:0.0:1782759421.518222:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759421.518240:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b347c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139368:x1869355211918208:12345-0@lo:104: Request processed in 2286us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.518249:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1782759421.518328:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759421.518334:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.518342:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759421.518346:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518409:0:139368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99600/0xdd99f5c4777df19c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df195 expref: 17 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.518426:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 16 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.518427:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917568:0@lo:104: 00010000:00010000:0.0:1782759421.518439:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759421.518450:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.518454:0:139368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777df172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df16b expref: 16 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759421.518464:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782759421.518472:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211917952:0@lo:104: 00000100:00100000:2.0:1782759421.518495:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918080:0@lo:104: 00010000:00010000:0.0:1782759421.518504:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.518509:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918208:0@lo:104: 00010000:00010000:0.0:1782759421.518522:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759421.518547:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.518555:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df14f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df156 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.518583:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759421.518586:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759421.518586:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759421.518593:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759421.518610:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211919360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759421.518657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759421.520404:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df15d expref: 15 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.520431:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759421.520452:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919360 00000100:00100000:0.0:1782759421.520464:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919360 00000100:00100000:2.0:1782759421.520474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782759421.520502:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 15 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.520518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759421.520562:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228160 00000100:00100000:1.0:1782759421.520564:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3308:x1869355211918976:12345-0@lo:103:ldlm_bl.0 Request processed in 2736us (4298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.520568:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228160 00000100:00100000:1.0:1782759421.520578:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1782759421.520583:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228032 00000100:00100000:2.0:1782759421.520591:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228032 00010000:00010000:0.0:1782759421.520608:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 11 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.520622:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 11 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.520642:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1782759421.520665:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3307:x1869355211919360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759421.520669:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 594 00000100:00100000:2.0:1782759421.520691:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 595 00000100:00100000:1.0:1782759421.520692:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197228160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759421.520696:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759421.520708:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 14 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.520710:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759421.520711:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2362:x1869355197228032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759421.520725:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 11 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.520734:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759421.520750:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 11 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.520760:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 14 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.521069:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 11 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759421.521087:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759421.521136:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197228160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 451us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.521155:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 594 00010000:00010000:2.0:1782759421.521158:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 11 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.521175:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759421.521200:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197228032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 497us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.521209:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 595 00010000:00010000:2.0:1782759421.521269:0:139368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030a00/0xdd99f5c4777df148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d91 expref: 9 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.521284:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918336:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759421.521300:0:139368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030600/0xdd99f5c4777df141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d8a expref: 8 pid: 5794 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759421.521319:0:139368:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139368:1869355211918464:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759421.521382:0:139368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759421.521945:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759421.521948:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211919104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759421.521966:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211919232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759421.522008:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211918720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759421.522026:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211918592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759421.522038:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3308:x1869355211918848:12345-0@lo:103:ldlm_bl.0 Request processed in 4376us (5671us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.522048:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00010000:00010000:2.0:1782759421.522052:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759421.522233:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777df156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df14f expref: 13 pid: 5793 timeout: 3589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522260:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522269:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522286:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522293:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522300:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522307:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522322:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759421.522326:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522333:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522349:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.522360:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759421.522376:0:139368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.522388:0:139368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759421.522395:0:139368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df1b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759421.522475:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:3307:x1869355211919360:12345-0@lo:103:ldlm_bl.0 Request processed in 1823us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.522483:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1782759421.523233:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211918848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759421.523248:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211918976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759421.524055:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211919360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759421.548097:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759422.572942:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759422.635928:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759422.635936:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 45 10000000:01000000:2.0:1782759422.635942:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759422.636015:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.636026:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.636037:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.636063:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211919488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.636134:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.636210:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2f0e300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759422.636402:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919488 00000100:00100000:1.0:1782759422.636411:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919488 00000100:00100000:1.0:1782759422.636461:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1782759422.636471:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355211919488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759422.636488:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759422.636501:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1b8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.636526:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.636538:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.636546:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030200, rc 0) 00000100:00100000:1.0:1782759422.636588:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211919488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.636595:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:3.0:1782759422.637510:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211919488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759422.637542:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.637556:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759422.637661:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211919616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.637722:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.637774:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.638572:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919616 00000100:00100000:2.0:1782759422.638584:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919616 00000100:00100000:2.0:1782759422.638709:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:2.0:1782759422.638730:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211919616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.639067:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211919616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.639074:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:3.0:1782759422.639180:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211919616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.639229:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211919744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.639291:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759422.639323:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919744 00000100:00100000:1.0:1782759422.639329:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919744 00000100:00100000:1.0:1782759422.639350:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:1.0:1782759422.639356:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211919744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.639477:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759422.639537:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211919744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.639546:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1782759422.639579:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211919744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.641536:0:139370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139370:1869355211919872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.641608:0:139370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.641660:0:139370:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.641748:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211919872 00000100:00100000:2.0:1782759422.641755:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211919872 00000100:00100000:2.0:1782759422.641806:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:2.0:1782759422.641815:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139370:x1869355211919872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759422.642133:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139370:x1869355211919872:12345-0@lo:502:llog_process_th.0 Request processed in 317us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.642142:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1782759422.642351:0:139370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139370:1869355211919872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.642400:0:139370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139370:1869355211920000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.642437:0:139370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.642465:0:139370:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.642481:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920000 00000100:00100000:2.0:1782759422.642487:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920000 00000100:00100000:2.0:1782759422.642524:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:2.0:1782759422.642530:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139370:x1869355211920000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.642695:0:139370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139370:1869355211920000:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759422.642715:0:139370:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1782759422.642716:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:139370:x1869355211920000:12345-0@lo:502:llog_process_th.0 Request processed in 131us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.642728:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000020:01000000:3.0:1782759422.642921:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-47 (rc=0) 10000000:01000000:3.0:1782759422.642952:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759422.642968:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.642980:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759422.642995:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759422.642998:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1782759422.643002:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759422.643033:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.643042:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.643051:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759422.643065:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.643101:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.643133:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.643188:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920128 00000100:00100000:2.0:1782759422.643193:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920128 00000100:00100000:2.0:1782759422.643224:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1782759422.643231:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211920128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759422.643241:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759422.643256:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1c6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.643282:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.643293:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.643303:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64600, rc 0) 00000100:00100000:2.0:1782759422.643536:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211920128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.643543:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:3.0:1782759422.643800:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759422.643815:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.643840:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759422.643912:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.643948:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.643970:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.644064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759422.644070:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920256 00000100:00100000:0.0:1782759422.644076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920256 00000100:00100000:0.0:1782759422.644111:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1782759422.644118:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211920256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.644221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759422.644291:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228288 00000100:00100000:1.0:1782759422.644301:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228288 00000100:00100000:1.0:1782759422.644338:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2664 00000100:00100000:1.0:1782759422.644346:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2362:x1869355197228288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759422.644414:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2362:x1869355197228288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.644423:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2664 00000100:00100000:0.0:1782759422.644780:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211920256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 661us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.644788:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1782759422.644903:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228416 00000100:00100000:3.0:1782759422.644908:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228416 00000100:00100000:2.0:1782759422.644918:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.644958:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.644974:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2500 00000100:00100000:3.0:1782759422.644985:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197228416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759422.645014:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.645047:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237600 going to sleep for 11 seconds 00000100:00080000:0.0:1782759422.645061:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759422.645090:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920384 00000100:00100000:0.0:1782759422.645094:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920384 00000100:00100000:0.0:1782759422.645123:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:0.0:1782759422.645129:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211920384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.645309:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211920384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.645317:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1782759422.645346:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.645511:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197228416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 527us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.645520:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2500 00000100:00100000:1.0:1782759422.645539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759422.645574:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228672 00000100:00100000:1.0:1782759422.645579:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228672 00000100:00100000:1.0:1782759422.645630:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1954 00000100:00080000:3.0:1782759422.645635:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759422.645640:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197228672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759422.645797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759422.645807:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197228672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 167us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.645816:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1954 00000100:00100000:1.0:1782759422.645851:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228544 00000100:00100000:1.0:1782759422.645855:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228544 00000100:00080000:2.0:1782759422.645882:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759422.645903:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1955 00000100:00100000:1.0:1782759422.645913:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197228544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759422.645941:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197228544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.645948:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1955 00000040:00080000:0.0:1782759422.646669:0:139371:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:2.0:1782759422.649931:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1782759422.649979:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782759422.649994:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.650009:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759422.650022:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759422.650026:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 45 10000000:01000000:2.0:1782759422.650029:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759422.650078:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.650086:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.650099:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.650130:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.650214:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.650315:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759422.652998:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920512 00000100:00100000:0.0:1782759422.653021:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920512 00000100:00100000:0.0:1782759422.653159:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:0.0:1782759422.653174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211920512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759422.653199:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759422.653220:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1d4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.653257:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.653269:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.653301:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99a00, rc 0) 00000100:00100000:0.0:1782759422.653403:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211920512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.653410:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:3.0:1782759422.653524:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759422.653550:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.653561:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759422.653646:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.653682:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.659726:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.659805:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920640 00000100:00100000:2.0:1782759422.659817:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920640 00000100:00100000:2.0:1782759422.659926:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1782759422.659937:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211920640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.660405:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211920640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 469us (6721us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.660414:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:3.0:1782759422.661973:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.662045:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.662118:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.662200:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.665146:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920768 00000100:00100000:2.0:1782759422.665163:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920768 00000100:00100000:2.0:1782759422.665309:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1782759422.665321:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211920768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.665616:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211920768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 297us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.665625:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:3.0:1782759422.665741:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211920768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.669435:0:139372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139372:1869355211920896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759422.669534:0:139372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.669775:0:139372:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759422.669875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211920896 00000100:00100000:0.0:1782759422.669884:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211920896 00000100:00100000:0.0:1782759422.669945:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1782759422.669955:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139372:x1869355211920896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.670248:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139372:x1869355211920896:12345-0@lo:502:llog_process_th.0 Request processed in 293us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.670256:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:3.0:1782759422.670354:0:139372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139372:1869355211920896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759422.670404:0:139372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139372:1869355211921024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759422.670435:0:139372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.670463:0:139372:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759422.670506:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921024 00000100:00100000:0.0:1782759422.670510:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921024 00000100:00100000:0.0:1782759422.670529:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:0.0:1782759422.670534:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139372:x1869355211921024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.670664:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:139372:x1869355211921024:12345-0@lo:502:llog_process_th.0 Request processed in 129us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.670670:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1782759422.670738:0:139372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139372:1869355211921024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759422.670757:0:139372:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1782759422.670979:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-47 (rc=0) 10000000:01000000:0.0:1782759422.671005:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759422.671017:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.671029:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759422.671052:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782759422.671055:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1782759422.671058:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782759422.671085:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.671094:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.671104:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759422.671117:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.671146:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.671235:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.671319:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921152 00000100:00100000:2.0:1782759422.671324:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921152 00000100:00100000:2.0:1782759422.671347:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1782759422.671354:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211921152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759422.671364:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759422.671378:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1e2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.671403:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.671415:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.671426:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65200, rc 0) 00000100:00100000:2.0:1782759422.671466:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211921152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.671480:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:0.0:1782759422.671550:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759422.671563:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.671572:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759422.671615:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.671640:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.671662:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.671704:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921280 00000100:00100000:2.0:1782759422.671708:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921280 00000100:00100000:2.0:1782759422.671723:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1782759422.671728:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211921280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.671992:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211921280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.671998:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:0.0:1782759422.672071:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.672093:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.672126:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.672140:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.672178:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921408 00000100:00100000:2.0:1782759422.672182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921408 00000100:00100000:2.0:1782759422.672197:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1782759422.672203:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211921408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.672338:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211921408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.672342:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1782759422.672395:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759422.673226:0:139373:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1782759422.673361:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1782759422.673380:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782759422.673388:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.673399:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759422.673408:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759422.673411:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 45 10000000:01000000:2.0:1782759422.673414:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759422.673436:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.673451:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.673460:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.673477:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.673518:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.673558:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718637f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.673573:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921536 00000100:00100000:2.0:1782759422.673577:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921536 00000100:00100000:2.0:1782759422.673657:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1782759422.673665:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211921536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759422.673674:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759422.673685:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1f0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.673707:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.673717:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.673725:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64400, rc 0) 00000100:00100000:0.0:1782759422.673788:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.673807:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211921536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.673813:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00010000:00010000:0.0:1782759422.673931:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.673940:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759422.673994:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.674018:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.674032:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836b000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.674071:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921664 00000100:00100000:2.0:1782759422.674074:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921664 00000100:00100000:2.0:1782759422.674089:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1782759422.674093:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211921664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.674295:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211921664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.674302:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1782759422.674368:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.674395:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.674430:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.674451:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836b000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.674495:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921792 00000100:00100000:2.0:1782759422.674499:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921792 00000100:00100000:2.0:1782759422.674516:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1782759422.674522:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211921792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.674658:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211921792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.674665:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:0.0:1782759422.674752:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211921792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.675265:0:139374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139374:1869355211921920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.675298:0:139374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.675350:0:139374:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719836b000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759422.675375:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211921920 00000100:00100000:2.0:1782759422.675378:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211921920 00000100:00100000:2.0:1782759422.675429:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:2.0:1782759422.675436:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139374:x1869355211921920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759422.675611:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139374:x1869355211921920:12345-0@lo:502:llog_process_th.0 Request processed in 175us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.675619:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:0.0:1782759422.675676:0:139374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139374:1869355211921920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.675717:0:139374:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139374:1869355211922048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.675750:0:139374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759422.675772:0:139374:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759422.675813:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922048 00000100:00100000:3.0:1782759422.675817:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922048 00000100:00100000:3.0:1782759422.675902:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1782759422.675909:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139374:x1869355211922048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759422.676071:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:139374:x1869355211922048:12345-0@lo:502:llog_process_th.0 Request processed in 162us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.676078:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:0.0:1782759422.676154:0:139374:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139374:1869355211922048:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759422.676171:0:139374:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1782759422.676317:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-47 (rc=0) 10000000:01000000:2.0:1782759422.676332:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759422.676339:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.676347:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759422.676359:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782759422.676361:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 40 10000000:01000000:2.0:1782759422.676363:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759422.676381:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.676386:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.676392:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.676401:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.676421:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.676441:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759422.676517:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922176 00000100:00100000:1.0:1782759422.676522:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922176 00000100:00100000:1.0:1782759422.676554:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1782759422.676562:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211922176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759422.676571:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759422.676591:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df1fe expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.676613:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.676624:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.676633:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030e00, rc 0) 00000100:00100000:1.0:1782759422.676685:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211922176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.676692:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:2.0:1782759422.676734:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759422.676746:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.676755:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.676794:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.676818:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.676994:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759422.677027:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922304 00000100:00100000:0.0:1782759422.677030:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922304 00000100:00100000:0.0:1782759422.677081:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:0.0:1782759422.677088:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211922304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759422.677351:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211922304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.677359:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1782759422.677374:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.677400:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.677435:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.677455:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759422.677526:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922432 00000100:00100000:1.0:1782759422.677530:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922432 00000100:00100000:1.0:1782759422.677549:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1782759422.677556:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211922432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759422.677701:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211922432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.677708:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:2.0:1782759422.677730:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.678345:0:139375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139375:1869355211922560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759422.678386:0:139375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759422.678468:0:139375:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759422.678501:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922560 00000100:00100000:1.0:1782759422.678506:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922560 00000100:00100000:1.0:1782759422.678567:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1782759422.678574:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139375:x1869355211922560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759422.678801:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139375:x1869355211922560:12345-0@lo:502:llog_process_th.0 Request processed in 227us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.678814:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1782759422.678967:0:139375:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139375:1869355211922560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759422.678992:0:139375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759422.679007:0:139375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759422.679010:0:139375:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-MDT0000-m add lustre.pool64c.lustre-OST0000_UUID 00000020:00000080:0.0:1782759422.679016:0:139375:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1782759422.679033:0:139375:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to pool64c as member 1 00000020:01000004:3.0:1782759422.679955:0:139376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9171932e8800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782759422.679959:0:139376:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9171932e8800 4 00000100:00100000:1.0:1782759422.680446:0:139375:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139375:1869355211922688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759422.680500:0:139375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759422.680540:0:139375:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759422.680590:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922688 00000100:00100000:0.0:1782759422.680597:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922688 00000100:00100000:0.0:1782759422.680634:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:0.0:1782759422.680642:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139375:x1869355211922688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759422.681937:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:139375:x1869355211922688:12345-0@lo:502:llog_process_th.0 Request processed in 1290us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.681947:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1782759422.682053:0:139375:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:139375:1869355211922688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759422.682086:0:139375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759422.682093:0:139375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759422.682095:0:139375:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-MDT0000-m add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:3.0:1782759422.682099:0:139375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1782759422.682231:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 40-42 (rc=0) 10000000:01000000:2.0:1782759422.682260:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782759422.682365:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.682379:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759422.682391:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782759422.682394:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759422.682397:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782759422.682430:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.682440:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.682450:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.682469:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.682508:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.682546:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759422.682583:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922816 00000100:00100000:1.0:1782759422.682589:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922816 00000100:00100000:1.0:1782759422.682660:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1782759422.682670:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211922816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759422.682683:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759422.682700:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df20c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.682728:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.682741:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759422.682751:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759422.682794:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211922816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.682802:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1782759422.682907:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759422.682926:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759422.682945:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759422.682994:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759422.683021:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.683457:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759422.684104:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211922944 00000100:00100000:3.0:1782759422.684110:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211922944 00000100:00100000:3.0:1782759422.684143:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:3.0:1782759422.684150:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211922944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.684418:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211922944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (1395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759422.684424:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:3.0:1782759422.684463:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211922944:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759422.684491:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759422.684499:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.684508:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759422.964007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759422.964128:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228800 00000100:00100000:3.0:1782759422.964139:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228800 00000100:00100000:3.0:1782759422.964199:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2686 00000100:00100000:3.0:1782759422.964209:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197228800:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759422.964227:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759422.964245:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d98 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.964293:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.964305:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759422.964314:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759422.964377:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197228800:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 169us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.964384:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2686 00000100:00100000:2.0:1782759422.966917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759422.966984:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197228928 00000100:00100000:0.0:1782759422.966992:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197228928 00000100:00100000:0.0:1782759422.967040:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2687 00000100:00100000:0.0:1782759422.967050:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197228928:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759422.967370:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197228928:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 321us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.967379:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2687 00000100:00100000:1.0:1782759422.969272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759422.969332:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229056 00000100:00100000:3.0:1782759422.969339:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229056 00000100:00100000:3.0:1782759422.969382:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2688 00000100:00100000:3.0:1782759422.969391:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197229056:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.969641:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197229056:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 250us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.969649:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2688 00000100:00100000:2.0:1782759422.972104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759422.972194:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229184 00000100:00100000:1.0:1782759422.972342:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229184 00000100:00100000:1.0:1782759422.972439:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2689 00000100:00100000:1.0:1782759422.972449:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97972:x1869355197229184:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759422.972721:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97972:x1869355197229184:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 272us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.972730:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2689 00000100:00100000:2.0:1782759422.974641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759422.975040:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229312 00000100:00100000:0.0:1782759422.975048:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229312 00000100:00100000:1.0:1782759422.975113:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2690 00000100:00100000:1.0:1782759422.975123:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97972:x1869355197229312:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759422.975366:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:97972:x1869355197229312:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 243us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.975374:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2690 00000100:00100000:3.0:1782759422.977809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759422.978039:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229440 00000100:00100000:0.0:1782759422.978049:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229440 00000100:00100000:0.0:1782759422.978091:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2691 00000100:00100000:0.0:1782759422.978102:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197229440:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759422.978118:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759422.978136:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66d9f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.978169:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.978180:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759422.978189:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98000, rc 0) 00000100:00100000:0.0:1782759422.978376:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197229440:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 275us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.978384:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2691 00000100:00100000:2.0:1782759422.979304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759422.979382:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229568 00000100:00100000:3.0:1782759422.979387:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229568 00000100:00100000:3.0:1782759422.979456:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2692 00000100:00100000:3.0:1782759422.979465:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197229568:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759422.979680:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197229568:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 216us (376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759422.979688:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2692 00000100:00100000:2.0:1782759423.582157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.582209:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229696 00000100:00100000:3.0:1782759423.582219:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229696 00000100:00100000:3.0:1782759423.582284:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1901 00000100:00100000:3.0:1782759423.582296:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97982:x1869355197229696:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759423.594596:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97982:x1869355197229696:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 12293us (12439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.594609:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1901 00000100:00100000:0.0:1782759423.595737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.595774:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229824 00000100:00100000:3.0:1782759423.595783:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229824 00000100:00100000:3.0:1782759423.595895:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 963 00000100:00100000:3.0:1782759423.595908:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97982:x1869355197229824:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759423.596391:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97982:x1869355197229824:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 485us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.596400:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 963 00010000:00010000:2.0:1782759423.596975:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759423.598243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.598568:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197229952 00000100:00100000:2.0:1782759423.598577:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197229952 00000100:00100000:2.0:1782759423.598625:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1902 00000100:00100000:2.0:1782759423.598635:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97982:x1869355197229952:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.599467:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97982:x1869355197229952:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 831us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.599477:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1902 00000100:00100000:3.0:1782759423.602499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.602534:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230080 00000100:00100000:3.0:1782759423.602544:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230080 00000100:00100000:3.0:1782759423.602608:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1903 00000100:00100000:3.0:1782759423.602621:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97982:x1869355197230080:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759423.616472:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97982:x1869355197230080:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 13847us (13971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.616486:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1903 00000100:00100000:2.0:1782759423.625816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.625935:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230208 00000100:00100000:3.0:1782759423.625945:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230208 00000100:00100000:3.0:1782759423.626000:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1904 00000100:00100000:3.0:1782759423.626010:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97983:x1869355197230208:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759423.626113:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97983:x1869355197230208:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.626120:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1904 00000100:00100000:0.0:1782759423.627256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.627346:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230336 00000100:00100000:2.0:1782759423.627352:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230336 00000100:00100000:2.0:1782759423.627388:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 964 00000100:00100000:2.0:1782759423.627394:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97983:x1869355197230336:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759423.627725:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97983:x1869355197230336:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 329us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.627739:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 964 00000100:00100000:0.0:1782759423.628534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.628576:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230464 00000100:00100000:2.0:1782759423.628581:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230464 00000100:00100000:2.0:1782759423.628623:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1905 00000100:00100000:2.0:1782759423.628631:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97983:x1869355197230464:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.628967:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97983:x1869355197230464:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 336us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.628975:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1905 00000100:00100000:0.0:1782759423.630481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.630533:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230592 00000100:00100000:3.0:1782759423.630540:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230592 00000100:00100000:3.0:1782759423.630580:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1906 00000100:00100000:3.0:1782759423.630591:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97983:x1869355197230592:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759423.642409:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97983:x1869355197230592:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 11809us (11918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.642425:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1906 00000100:00100000:0.0:1782759423.652224:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.652301:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230720 00000100:00100000:3.0:1782759423.652325:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230720 00000100:00100000:3.0:1782759423.652407:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1907 00000100:00100000:3.0:1782759423.652421:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97984:x1869355197230720:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.665949:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97984:x1869355197230720:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 13520us (13725us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.665964:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1907 00000100:00100000:0.0:1782759423.667212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759423.667271:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230848 00000100:00100000:1.0:1782759423.667280:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230848 00000100:00100000:1.0:1782759423.667352:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:1.0:1782759423.667362:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97984:x1869355197230848:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759423.667786:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97984:x1869355197230848:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 424us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.667793:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:1.0:1782759423.671461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.671526:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197230976 00000100:00100000:2.0:1782759423.671535:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197230976 00000100:00100000:2.0:1782759423.671593:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1908 00000100:00100000:2.0:1782759423.671604:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97984:x1869355197230976:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.672296:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97984:x1869355197230976:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 693us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.672304:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1908 00000100:00100000:0.0:1782759423.674687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.674747:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231104 00000100:00100000:3.0:1782759423.674755:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231104 00000100:00100000:3.0:1782759423.674795:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1909 00000100:00100000:3.0:1782759423.674802:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97984:x1869355197231104:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759423.689510:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97984:x1869355197231104:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 14688us (14809us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.689532:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1909 00000100:00100000:0.0:1782759423.701812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.701895:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231232 00000100:00100000:2.0:1782759423.701907:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231232 00000100:00100000:2.0:1782759423.701965:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1910 00000100:00100000:2.0:1782759423.701976:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97985:x1869355197231232:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.702080:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97985:x1869355197231232:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 105us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.702087:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1910 00000100:00100000:0.0:1782759423.703177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.703270:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231360 00000100:00100000:3.0:1782759423.703277:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231360 00000100:00100000:3.0:1782759423.703456:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:3.0:1782759423.703467:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97985:x1869355197231360:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759423.703909:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97985:x1869355197231360:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 444us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.703917:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:0.0:1782759423.705415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.705475:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231488 00000100:00100000:2.0:1782759423.705481:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231488 00000100:00100000:2.0:1782759423.705516:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1911 00000100:00100000:2.0:1782759423.705527:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97985:x1869355197231488:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.705945:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97985:x1869355197231488:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 420us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.705951:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1911 00000100:00100000:1.0:1782759423.708325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.708389:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231616 00000100:00100000:3.0:1782759423.708398:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231616 00000100:00100000:3.0:1782759423.708455:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1912 00000100:00100000:3.0:1782759423.708467:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97985:x1869355197231616:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759423.723015:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97985:x1869355197231616:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 14538us (14686us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.723036:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1912 00000100:00100000:1.0:1782759423.735084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.735200:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231744 00000100:00100000:2.0:1782759423.735210:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231744 00000100:00100000:2.0:1782759423.735266:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1913 00000100:00100000:2.0:1782759423.735276:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97986:x1869355197231744:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759423.748624:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97986:x1869355197231744:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 13340us (13542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.748639:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1913 00000100:00100000:0.0:1782759423.750011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.750072:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197231872 00000100:00100000:2.0:1782759423.750084:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197231872 00000100:00100000:2.0:1782759423.750128:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 967 00000100:00100000:2.0:1782759423.750137:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97986:x1869355197231872:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759423.750579:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97986:x1869355197231872:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 442us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.750586:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 967 00000100:00100000:0.0:1782759423.751721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.751779:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232000 00000100:00100000:2.0:1782759423.751787:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232000 00000100:00100000:2.0:1782759423.751880:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1914 00000100:00100000:2.0:1782759423.751891:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97986:x1869355197232000:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.752430:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97986:x1869355197232000:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 539us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.752437:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1914 00000100:00100000:1.0:1782759423.754094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.754241:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232128 00000100:00100000:3.0:1782759423.754249:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232128 00000100:00100000:3.0:1782759423.754300:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1915 00000100:00100000:3.0:1782759423.754311:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97986:x1869355197232128:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759423.766523:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97986:x1869355197232128:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 12203us (12424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.766538:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1915 00000100:00100000:0.0:1782759423.775963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759423.776043:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232256 00000100:00100000:1.0:1782759423.776054:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232256 00000100:00100000:1.0:1782759423.776122:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1916 00000100:00100000:1.0:1782759423.776133:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97987:x1869355197232256:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759423.776250:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97987:x1869355197232256:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.776260:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1916 00000100:00100000:1.0:1782759423.779236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759423.779304:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232384 00000100:00100000:0.0:1782759423.779313:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232384 00000100:00100000:0.0:1782759423.779369:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 968 00000100:00100000:0.0:1782759423.779379:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97987:x1869355197232384:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759423.779784:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:97987:x1869355197232384:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 405us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.779792:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 968 00000100:00100000:0.0:1782759423.780981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.781025:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232512 00000100:00100000:2.0:1782759423.781040:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232512 00000100:00100000:2.0:1782759423.781082:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1917 00000100:00100000:2.0:1782759423.781092:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97987:x1869355197232512:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.781466:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97987:x1869355197232512:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 376us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.781474:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1917 00000100:00100000:2.0:1782759423.783965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759423.784076:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232640 00000100:00100000:0.0:1782759423.784087:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232640 00000100:00100000:0.0:1782759423.784137:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1918 00000100:00100000:0.0:1782759423.784144:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97987:x1869355197232640:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759423.797028:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97987:x1869355197232640:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 12867us (13064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.797075:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1918 00000100:00100000:1.0:1782759423.806308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.806361:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232768 00000100:00100000:3.0:1782759423.806370:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232768 00000100:00100000:3.0:1782759423.806423:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1919 00000100:00100000:3.0:1782759423.806433:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97988:x1869355197232768:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.832216:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97988:x1869355197232768:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 25771us (25908us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.832231:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1919 00000100:00100000:1.0:1782759423.841058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.841128:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197232896 00000100:00100000:2.0:1782759423.841139:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197232896 00000100:00100000:2.0:1782759423.841200:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1920 00000100:00100000:2.0:1782759423.841210:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97989:x1869355197232896:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.862947:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97989:x1869355197232896:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 21724us (21882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.862964:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1920 00000100:00100000:0.0:1782759423.873048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759423.873109:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233024 00000100:00100000:3.0:1782759423.873120:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233024 00000100:00100000:3.0:1782759423.873183:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1921 00000100:00100000:3.0:1782759423.873207:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97990:x1869355197233024:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759423.904025:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97990:x1869355197233024:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 30823us (30975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.904042:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1921 00000100:00100000:1.0:1782759423.911979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.912052:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233152 00000100:00100000:2.0:1782759423.912063:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233152 00000100:00100000:2.0:1782759423.912122:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1922 00000100:00100000:2.0:1782759423.912134:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97991:x1869355197233152:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.915955:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211923072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759423.916040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759423.916070:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923072 00000100:00100000:0.0:1782759423.916078:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923072 00000100:00100000:0.0:1782759423.916142:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1782759423.916150:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211923072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759423.916179:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759423.916230:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211923072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.916236:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00080000:1.0:1782759423.916269:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759423.916286:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211923072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759423.934785:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97991:x1869355197233152:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 22643us (22806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.934803:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1922 00000100:00100000:0.0:1782759423.944035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759423.944119:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233280 00000100:00100000:2.0:1782759423.944129:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233280 00000100:00100000:2.0:1782759423.944185:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1923 00000100:00100000:2.0:1782759423.944210:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97992:x1869355197233280:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.967039:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97992:x1869355197233280:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 22822us (23002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.967055:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1923 00000100:00100000:0.0:1782759423.975667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759423.975757:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233408 00000100:00100000:1.0:1782759423.975767:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233408 00000100:00100000:1.0:1782759423.975850:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1924 00000100:00100000:1.0:1782759423.975862:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97993:x1869355197233408:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.997179:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97993:x1869355197233408:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 21309us (21510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.997193:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1924 00000100:00100000:1.0:1782759424.006944:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759424.007002:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233536 00000100:00100000:3.0:1782759424.007012:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233536 00000100:00100000:3.0:1782759424.007093:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1925 00000100:00100000:3.0:1782759424.007106:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97994:x1869355197233536:12345-192.168.204.31@tcp:48:lfs.0 00000100:00080000:1.0:1782759424.007219:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759424.035099:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97994:x1869355197233536:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 27985us (28152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.035115:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1925 00000100:00100000:0.0:1782759424.044183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.044288:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233664 00000100:00100000:2.0:1782759424.044298:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233664 00000100:00100000:2.0:1782759424.044370:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1926 00000100:00100000:2.0:1782759424.044379:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97995:x1869355197233664:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.070038:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97995:x1869355197233664:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 25648us (25854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.070053:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1926 00000100:00100000:3.0:1782759424.079753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.079855:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233792 00000100:00100000:2.0:1782759424.079875:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233792 00000100:00100000:2.0:1782759424.079966:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1927 00000100:00100000:2.0:1782759424.079977:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97996:x1869355197233792:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.109909:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97996:x1869355197233792:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 29924us (30157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.109924:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1927 00000100:00100000:1.0:1782759424.122166:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.122259:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197233920 00000100:00100000:2.0:1782759424.122281:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197233920 00000100:00100000:2.0:1782759424.122335:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1928 00000100:00100000:2.0:1782759424.122347:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97997:x1869355197233920:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.174414:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97997:x1869355197233920:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 52055us (52242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.174430:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1928 00000100:00100000:0.0:1782759424.188084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.188177:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234048 00000100:00100000:2.0:1782759424.188187:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234048 00000100:00100000:2.0:1782759424.188240:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1929 00000100:00100000:2.0:1782759424.188249:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97998:x1869355197234048:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.220291:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97998:x1869355197234048:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 32032us (32204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.220306:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1929 00000100:00100000:3.0:1782759424.232346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.232399:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234176 00000100:00100000:2.0:1782759424.232408:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234176 00000100:00100000:2.0:1782759424.232468:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00100000:2.0:1782759424.232479:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97999:x1869355197234176:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.259956:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:97999:x1869355197234176:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 27468us (27606us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.259972:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00100000:1.0:1782759424.269274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.269365:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234304 00000100:00100000:2.0:1782759424.269375:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234304 00000100:00100000:2.0:1782759424.269434:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1931 00000100:00100000:2.0:1782759424.269444:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234304:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.269537:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234304:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.269553:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1931 00000100:00100000:0.0:1782759424.271096:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759424.271275:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234432 00000100:00100000:3.0:1782759424.271290:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234432 00000100:00100000:3.0:1782759424.271362:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:3.0:1782759424.271371:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98000:x1869355197234432:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759424.271711:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98000:x1869355197234432:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 340us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759424.271719:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00080000:1.0:1782759424.272596:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759424.273237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.273329:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234560 00000100:00100000:2.0:1782759424.273336:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234560 00000100:00100000:2.0:1782759424.273450:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 970 00000100:00100000:2.0:1782759424.273465:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234560:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:1.0:1782759424.273538:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759424.273983:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234560:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 524us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.273993:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 970 00000100:00100000:2.0:1782759424.275210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.275917:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234688 00000100:00100000:0.0:1782759424.275925:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234688 00000100:00100000:0.0:1782759424.276030:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1932 00000100:00100000:0.0:1782759424.276041:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234688:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759424.276355:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234688:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 316us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.276363:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1932 00000100:00100000:0.0:1782759424.277908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.277954:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234816 00000100:00100000:2.0:1782759424.277961:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234816 00000100:00100000:2.0:1782759424.278007:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1933 00000100:00100000:2.0:1782759424.278018:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234816:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759424.293574:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98000:x1869355197234816:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 15549us (15658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759424.293589:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1933 00000100:00100000:3.0:1782759424.303929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.304028:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197234944 00000100:00100000:0.0:1782759424.304051:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197234944 00000100:00100000:1.0:1782759424.304195:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00100000:1.0:1782759424.304209:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197234944:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759424.304310:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197234944:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759424.304320:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00100000:2.0:1782759424.307168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.307236:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235072 00000100:00100000:0.0:1782759424.307245:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235072 00000100:00100000:0.0:1782759424.307303:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 971 00000100:00100000:0.0:1782759424.307313:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98001:x1869355197235072:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759424.309737:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98001:x1869355197235072:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 2420us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.309749:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 971 00000100:00100000:0.0:1782759424.311199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759424.311504:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235200 00000100:00100000:3.0:1782759424.311522:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235200 00000100:00100000:3.0:1782759424.311569:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 972 00000100:00100000:3.0:1782759424.311580:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197235200:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759424.311936:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197235200:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 356us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759424.311944:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 972 00000100:00100000:3.0:1782759424.313670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.313870:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235328 00000100:00100000:0.0:1782759424.313878:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235328 00000100:00100000:0.0:1782759424.313948:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1935 00000100:00100000:0.0:1782759424.313956:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197235328:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759424.314229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197235328:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 273us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.314234:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1935 00000100:00100000:2.0:1782759424.317597:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759424.317729:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235456 00000100:00100000:1.0:1782759424.317738:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235456 00000100:00100000:1.0:1782759424.317800:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1936 00000100:00100000:1.0:1782759424.317813:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197235456:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759424.335298:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98001:x1869355197235456:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 17475us (17703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759424.335316:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1936 00000100:00100000:1.0:1782759424.343736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.343852:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235584 00000100:00100000:2.0:1782759424.343874:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235584 00000100:00100000:2.0:1782759424.343932:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1937 00000100:00100000:2.0:1782759424.343942:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197235584:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.344042:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197235584:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.344050:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1937 00000100:00100000:3.0:1782759424.345297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.345352:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235712 00000100:00100000:2.0:1782759424.345358:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235712 00000100:00100000:2.0:1782759424.345391:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:2.0:1782759424.345411:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98002:x1869355197235712:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759424.345748:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98002:x1869355197235712:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 338us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.345755:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:1.0:1782759424.346777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.346847:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235840 00000100:00100000:0.0:1782759424.346854:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235840 00000100:00100000:0.0:1782759424.346912:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:0.0:1782759424.346921:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197235840:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759424.347333:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197235840:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 409us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.347341:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:1.0:1782759424.348561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.348622:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197235968 00000100:00100000:0.0:1782759424.348629:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197235968 00000100:00100000:0.0:1782759424.348681:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00100000:0.0:1782759424.348690:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197235968:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759424.349206:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197235968:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 517us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.349214:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00100000:3.0:1782759424.351341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759424.351411:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236096 00000100:00100000:1.0:1782759424.351419:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236096 00000100:00100000:1.0:1782759424.351466:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1939 00000100:00100000:1.0:1782759424.351477:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197236096:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759424.361524:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98002:x1869355197236096:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 10038us (10179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759424.361547:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1939 00000100:00100000:1.0:1782759424.369952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.370028:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236224 00000100:00100000:2.0:1782759424.370038:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236224 00000100:00100000:2.0:1782759424.370088:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1940 00000100:00100000:2.0:1782759424.370099:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236224:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.370186:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236224:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.370192:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1940 00000100:00100000:0.0:1782759424.371424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759424.371478:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236352 00000100:00100000:3.0:1782759424.371485:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236352 00000100:00100000:3.0:1782759424.371526:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 975 00000100:00100000:3.0:1782759424.371534:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98003:x1869355197236352:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759424.371916:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98003:x1869355197236352:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 382us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759424.371924:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 975 00000100:00100000:3.0:1782759424.372806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.372870:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236480 00000100:00100000:2.0:1782759424.372876:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236480 00000100:00100000:2.0:1782759424.372905:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 976 00000100:00100000:2.0:1782759424.372911:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236480:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759424.373104:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236480:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 193us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.373109:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 976 00000100:00100000:1.0:1782759424.373888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.373965:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236608 00000100:00100000:0.0:1782759424.373970:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236608 00000100:00100000:0.0:1782759424.374010:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1941 00000100:00100000:0.0:1782759424.374018:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236608:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759424.374274:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236608:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 256us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.374282:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1941 00000100:00100000:0.0:1782759424.375416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759424.375466:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236736 00000100:00100000:1.0:1782759424.375471:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236736 00000100:00100000:1.0:1782759424.375505:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00100000:1.0:1782759424.375513:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236736:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.387889:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98003:x1869355197236736:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 12344us (12442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.387905:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00100000:3.0:1782759424.400698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.400880:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236864 00000100:00100000:2.0:1782759424.400896:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236864 00000100:00100000:2.0:1782759424.400960:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1943 00000100:00100000:2.0:1782759424.400973:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197236864:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.401114:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197236864:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 142us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.401122:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1943 00000100:00100000:1.0:1782759424.402696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.402782:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197236992 00000100:00100000:0.0:1782759424.402797:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197236992 00000100:00100000:0.0:1782759424.403357:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:0.0:1782759424.403372:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98004:x1869355197236992:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759424.404049:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98004:x1869355197236992:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 679us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.404058:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:0.0:1782759424.407925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759424.407983:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237120 00000100:00100000:3.0:1782759424.407995:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237120 00000100:00100000:3.0:1782759424.408059:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:3.0:1782759424.408069:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197237120:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759424.408611:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197237120:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 540us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759424.408619:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:3.0:1782759424.410082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.410207:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237248 00000100:00100000:0.0:1782759424.410216:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237248 00000100:00100000:0.0:1782759424.410265:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1944 00000100:00100000:0.0:1782759424.410277:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197237248:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759424.410774:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197237248:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 499us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.410791:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1944 00000100:00100000:1.0:1782759424.412695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.412969:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237376 00000100:00100000:2.0:1782759424.412979:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237376 00000100:00100000:2.0:1782759424.413031:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1945 00000100:00100000:2.0:1782759424.413042:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197237376:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.426866:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98004:x1869355197237376:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 13782us (14135us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.426885:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1945 00000100:00100000:1.0:1782759424.436669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.436758:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237504 00000100:00100000:2.0:1782759424.436767:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237504 00000100:00100000:2.0:1782759424.436808:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00100000:2.0:1782759424.436818:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197237504:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.437004:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197237504:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 186us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.437010:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00100000:3.0:1782759424.438675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.438800:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237632 00000100:00100000:2.0:1782759424.438806:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237632 00000100:00100000:2.0:1782759424.438866:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 979 00000100:00100000:2.0:1782759424.438877:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbb33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98005:x1869355197237632:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759424.439173:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbb33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98005:x1869355197237632:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 299us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.439178:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 979 00000100:00100000:1.0:1782759424.440935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.441133:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237760 00000100:00100000:0.0:1782759424.441140:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237760 00000100:00100000:0.0:1782759424.441182:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 980 00000100:00100000:0.0:1782759424.441192:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197237760:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759424.441509:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197237760:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 317us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.441516:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 980 00000100:00100000:1.0:1782759424.443052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759424.443112:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197237888 00000100:00100000:0.0:1782759424.443120:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197237888 00000100:00100000:0.0:1782759424.443164:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1947 00000100:00100000:0.0:1782759424.443175:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197237888:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759424.443572:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197237888:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 398us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.443580:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1947 00000100:00100000:3.0:1782759424.446374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759424.446445:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238016 00000100:00100000:2.0:1782759424.446469:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238016 00000100:00100000:2.0:1782759424.446520:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1948 00000100:00100000:2.0:1782759424.446531:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197238016:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759424.462110:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98005:x1869355197238016:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 15567us (15733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.462129:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1948 00010000:00010000:2.0:1782759424.620040:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759424.807122:0:139424:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c24066a2 len=0 uarg=00007ffc40a76050 00040000:00000080:3.0:1782759424.807139:0:139424:0:(qmt_handler.c:1453:qmt_iocontrol()) lustre-QMT0000: cmd=c24066a2 len=584 karg=ffff917084fa3000 uarg=0000000000000000 00080000:10000000:3.0:1782759424.808456:0:139424:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/8/4) registered 00080000:10000000:3.0:1782759424.822278:0:139424:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3c:0x0] (8/8/4) registered 00080000:10000000:3.0:1782759424.833527:0:139424:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3d:0x0] (8/8/4) registered 00080000:10000000:3.0:1782759424.847098:0:139424:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3f:0x0] (8/8/4) registered 00080000:10000000:3.0:1782759424.858554:0:139424:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x40:0x0] (8/8/4) registered 00080000:10000000:3.0:1782759424.872507:0:139424:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x41:0x0] (8/8/4) registered 00000020:00000080:1.0:1782759425.271258:0:139472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c24066a2 len=0 uarg=00007ffc378c09a0 00040000:00000080:1.0:1782759425.271274:0:139472:0:(qmt_handler.c:1453:qmt_iocontrol()) lustre-QMT0000: cmd=c24066a2 len=584 karg=ffff917082bc2800 uarg=0000000000000000 00000020:01000004:1.0:1782759425.272157:0:139473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9171932e8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782759425.272161:0:139473:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9171932e8800 4 00080000:10000000:1.0:1782759425.273169:0:139472:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x42:0x0] (4/8/1) registered 00000020:01000004:3.0:1782759425.273344:0:139474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9171932e8800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782759425.273348:0:139474:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9171932e8800 4 00000100:00100000:1.0:1782759425.289149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759425.289217:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238144 00000100:00100000:2.0:1782759425.289226:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238144 00000100:00100000:2.0:1782759425.289280:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1949 00000100:00100000:2.0:1782759425.289291:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98024:x1869355197238144:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.344624:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98024:x1869355197238144:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 55324us (55471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.344639:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1949 00000100:00100000:0.0:1782759425.347437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759425.347483:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238272 00000100:00100000:2.0:1782759425.347493:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238272 00000100:00100000:2.0:1782759425.347555:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1950 00000100:00100000:2.0:1782759425.347565:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98024:x1869355197238272:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.365521:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98024:x1869355197238272:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 17887us (18020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.365536:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1950 00000100:00100000:0.0:1782759425.374914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759425.376409:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238400 00000100:00100000:2.0:1782759425.376434:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238400 00000100:00100000:2.0:1782759425.376510:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1951 00000100:00100000:2.0:1782759425.376520:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98025:x1869355197238400:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.376626:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98025:x1869355197238400:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 107us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.376635:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1951 00000100:00100000:1.0:1782759425.378653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759425.379106:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238528 00000100:00100000:3.0:1782759425.379123:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238528 00000100:00100000:3.0:1782759425.379198:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1952 00000100:00100000:3.0:1782759425.379221:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98025:x1869355197238528:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.395134:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98025:x1869355197238528:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 15915us (16476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.395150:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1952 00000100:00100000:1.0:1782759425.406182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759425.406284:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238656 00000100:00100000:3.0:1782759425.406294:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238656 00000100:00100000:3.0:1782759425.406408:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1953 00000100:00100000:3.0:1782759425.406421:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98026:x1869355197238656:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.434591:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98026:x1869355197238656:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 28161us (28406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.434610:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1953 00000100:00100000:1.0:1782759425.436626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759425.436688:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238784 00000100:00100000:2.0:1782759425.436697:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238784 00000100:00100000:2.0:1782759425.436753:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1954 00000100:00100000:2.0:1782759425.436761:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98026:x1869355197238784:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.455149:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98026:x1869355197238784:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 18378us (18521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.455179:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1954 00000100:00100000:2.0:1782759425.468260:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759425.468322:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197238912 00000100:00100000:3.0:1782759425.468332:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197238912 00000100:00100000:3.0:1782759425.468398:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1955 00000100:00100000:3.0:1782759425.468418:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98027:x1869355197238912:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.468527:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98027:x1869355197238912:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.468535:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1955 00000100:00100000:0.0:1782759425.471929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759425.472051:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239040 00000100:00100000:1.0:1782759425.472062:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239040 00000100:00100000:1.0:1782759425.472176:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1956 00000100:00100000:1.0:1782759425.472187:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98027:x1869355197239040:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.490086:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98027:x1869355197239040:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 17890us (18155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.490102:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1956 00000100:00100000:1.0:1782759425.499559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759425.499627:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239168 00000100:00100000:2.0:1782759425.499637:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239168 00000100:00100000:2.0:1782759425.499695:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1957 00000100:00100000:2.0:1782759425.499705:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98028:x1869355197239168:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.524068:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98028:x1869355197239168:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 24354us (24507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.524083:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1957 00000100:00100000:2.0:1782759425.526534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759425.526676:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239296 00000100:00100000:0.0:1782759425.526685:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239296 00000100:00100000:0.0:1782759425.526741:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1958 00000100:00100000:0.0:1782759425.526751:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98028:x1869355197239296:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.540192:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98028:x1869355197239296:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 13432us (13654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.540209:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1958 00000100:00100000:0.0:1782759425.549093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759425.549160:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239424 00000100:00100000:1.0:1782759425.549170:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239424 00000100:00100000:1.0:1782759425.549219:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1959 00000100:00100000:1.0:1782759425.549229:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98029:x1869355197239424:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.549322:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98029:x1869355197239424:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.549327:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1959 00000100:00100000:3.0:1782759425.550551:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759425.551057:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239552 00000100:00100000:2.0:1782759425.551064:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239552 00000100:00100000:2.0:1782759425.551105:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1960 00000100:00100000:2.0:1782759425.551111:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98029:x1869355197239552:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.565490:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98029:x1869355197239552:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 14368us (14931us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.565504:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1960 00010000:00010000:0.0:1782759425.644642:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759425.964039:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211923456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.964117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759425.964174:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759425.964180:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211923584:0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.964207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759425.964207:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211923328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759425.964268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759425.964293:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923456 00000100:00100000:0.0:1782759425.964297:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211923840:0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.964303:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923456 00000100:00100000:0.0:1782759425.964337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759425.964343:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759425.964363:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759425.964373:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211923200:0@lo:400:kworker.0 00000100:00100000:1.0:1782759425.964374:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923328 00000100:00100000:2.0:1782759425.964381:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1782759425.964381:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923328 00000100:00100000:2.0:1782759425.964395:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211923456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759425.964414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759425.964434:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:1.0:1782759425.964444:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211923328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.964469:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211923456:12345-0@lo:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.964470:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211923712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.964484:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1782759425.964492:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211923328:12345-0@lo:400:kworker.0 Request processed in 48us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.964507:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:0.0:1782759425.964516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759425.964534:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211923456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.964698:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923712 00000100:00100000:2.0:1782759425.964703:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923712 00000100:00080000:1.0:1782759425.964727:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759425.964747:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:2.0:1782759425.964756:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211923712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759425.964884:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923584 00000100:00100000:3.0:1782759425.964890:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923584 00000100:00100000:3.0:1782759425.964933:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923840 00000100:00100000:3.0:1782759425.964936:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923840 00000100:00100000:3.0:1782759425.964962:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1782759425.964970:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211923584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759425.966035:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211923712:12345-0@lo:400:kworker.0 Request processed in 1279us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.966045:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1782759425.966051:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211923712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759425.966069:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211923328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759425.966111:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:0.0:1782759425.966122:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211923840:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759425.966141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759425.966147:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759425.966171:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211923840:12345-0@lo:400:kworker.0 Request processed in 52us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.966178:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:0.0:1782759425.966203:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923200 00000100:00100000:0.0:1782759425.966220:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923200 00000100:00100000:0.0:1782759425.966257:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1782759425.966264:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211923200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759425.966295:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211923200:12345-0@lo:400:kworker.0 Request processed in 33us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.966301:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1782759425.966335:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211923200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759425.966346:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211923840:0@lo:400:kworker.0 00000100:00100000:3.0:1782759425.966431:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211923584:12345-0@lo:400:kworker.0 Request processed in 1462us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.966447:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1782759425.966554:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211923584:0@lo:400:kworker.0 00000020:00000080:1.0:1782759425.971482:0:139522:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff46c01440 20000000:00000080:1.0:1782759425.971497:0:139522:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc0c00 uarg=0000000000000000 00010000:00010000:1.0:1782759425.971940:0:139522:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759425.971972:0:139522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759425.971975:0:139522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759425.971983:0:139522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df133 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d83 expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.972000:0:139522:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1782759425.972016:0:139522:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759425.972030:0:139522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.972044:0:139522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.972052:0:139522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.972089:0:139522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.972102:0:139522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 18 pid: 5794 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759425.972115:0:139522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139522:1869355211923968:0@lo:104: 00000100:00100000:1.0:1782759425.972174:0:139522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759425.972225:0:139522:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759425.972609:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211923968 00000100:00100000:3.0:1782759425.972616:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211923968 00000100:00100000:3.0:1782759425.972662:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1782759425.972669:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139522:x1869355211923968:12345-0@lo:104: 00010000:00010000:3.0:1782759425.972680:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759425.972731:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759425.972735:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139522:x1869355211923968:12345-0@lo:104: Request processed in 67us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.972740:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1782759425.972782:0:139522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139522:1869355211923968:0@lo:104: 00010000:00010000:1.0:1782759425.972801:0:139522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.972814:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759425.972844:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.972856:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759425.972860:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.972869:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759425.972877:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759425.972893:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759425.972921:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.972927:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759425.972949:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759425.972958:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211924096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759425.972961:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df11e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df125 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.972977:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759425.972979:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759425.972981:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759425.972990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759425.973036:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924096 00000100:00100000:1.0:1782759425.973041:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924096 00010000:00010000:1.0:1782759425.973062:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 19 pid: 5794 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759425.973087:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1782759425.973094:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211924096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759425.973105:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759425.973109:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 19 pid: 5794 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973119:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 19 pid: 5794 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973130:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031000/0xdd99f5c4777df125 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df11e expref: 19 pid: 5794 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973141:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973149:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973160:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973177:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973184:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973191:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973196:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759425.973200:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973208:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973223:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.973233:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759425.973239:0:139522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.973246:0:139522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.973251:0:139522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031a00/0xdd99f5c4777df228 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759425.973268:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211924096:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.973276:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1782759425.973301:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211924096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759426.476974:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759426.476999:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211924224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759426.477067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759426.477314:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924224 00000100:00100000:0.0:1782759426.477322:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924224 00000100:00100000:0.0:1782759426.477369:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1782759426.477378:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211924224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759426.477413:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759426.477474:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211924224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759426.477481:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1782759426.477593:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211924224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759426.668036:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759427.369410:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.369461:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239680 00000100:00100000:3.0:1782759427.369471:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239680 00000100:00100000:3.0:1782759427.369555:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1961 00000100:00100000:3.0:1782759427.369567:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98103:x1869355197239680:12345-192.168.204.31@tcp:48:lfs.0 00000100:00080000:2.0:1782759427.369621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759427.369646:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98103:x1869355197239680:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 83us (243us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.369661:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1961 00000100:00100000:0.0:1782759427.390381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.390426:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239808 00000100:00100000:0.0:1782759427.390434:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239808 00000100:00100000:0.0:1782759427.390552:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1962 00000100:00100000:0.0:1782759427.390561:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98104:x1869355197239808:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.390634:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98104:x1869355197239808:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 74us (263us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759427.390643:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1962 00000100:00100000:1.0:1782759427.405348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.405956:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197239936 00000100:00100000:2.0:1782759427.405967:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197239936 00000100:00100000:2.0:1782759427.406016:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1963 00000100:00100000:2.0:1782759427.406023:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98105:x1869355197239936:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.406101:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98105:x1869355197239936:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 78us (768us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.406106:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1963 00000100:00100000:1.0:1782759427.415781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.415947:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240064 00000100:00100000:3.0:1782759427.415957:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240064 00000100:00100000:3.0:1782759427.416011:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1964 00000100:00100000:3.0:1782759427.416021:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98106:x1869355197240064:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.416109:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98106:x1869355197240064:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 89us (337us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.416117:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1964 00000100:00100000:0.0:1782759427.426279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.426335:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240192 00000100:00100000:2.0:1782759427.426346:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240192 00000100:00100000:2.0:1782759427.426399:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1965 00000100:00100000:2.0:1782759427.426409:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98107:x1869355197240192:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.426507:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98107:x1869355197240192:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 99us (236us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.426515:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1965 10000000:01000000:3.0:1782759427.436762:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759427.436770:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759427.436775:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759427.436930:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.436943:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.436955:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759427.436982:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211924352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759427.437012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.437036:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759427.437085:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759427.437862:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240320 00000100:00100000:2.0:1782759427.437871:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240320 00000100:00100000:2.0:1782759427.437935:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1966 00000100:00100000:2.0:1782759427.437944:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98108:x1869355197240320:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.438020:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98108:x1869355197240320:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 77us (1011us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.438028:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1966 00000100:00100000:0.0:1782759427.438565:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924352 00000100:00100000:0.0:1782759427.438571:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924352 00000100:00100000:0.0:1782759427.438605:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1782759427.438613:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211924352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759427.438624:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759427.438641:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df22f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759427.438665:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759427.438695:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759427.438705:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99800, rc 0) 00000100:00100000:0.0:1782759427.438755:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211924352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.438762:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1782759427.438945:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211924352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759427.438963:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.438984:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759427.439006:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759427.439012:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.439019:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759427.447399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.447508:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240448 00000100:00100000:3.0:1782759427.447519:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240448 00000100:00100000:3.0:1782759427.447578:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1967 00000100:00100000:3.0:1782759427.447589:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240448:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.447719:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240448:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.447728:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1967 00000100:00100000:1.0:1782759427.448691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.448742:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240576 00000100:00100000:0.0:1782759427.448749:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240576 00000100:00080000:2.0:1782759427.448842:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759427.448849:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:0.0:1782759427.448864:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240576:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759427.449202:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240576:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 342us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.449210:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:1.0:1782759427.451875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.452036:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240704 00000100:00100000:0.0:1782759427.452049:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240704 00000100:00100000:0.0:1782759427.452113:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1968 00000100:00100000:0.0:1782759427.452134:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240704:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.452433:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240704:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 311us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.452439:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1968 00000100:00100000:1.0:1782759427.454318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.454410:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240832 00000100:00100000:3.0:1782759427.454418:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240832 00000100:00100000:3.0:1782759427.454523:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00100000:3.0:1782759427.454534:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240832:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.454668:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98109:x1869355197240832:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 136us (355us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.454680:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00100000:1.0:1782759427.463581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.463663:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197240960 00000100:00100000:3.0:1782759427.463672:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197240960 00000100:00100000:3.0:1782759427.463736:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1970 00000100:00100000:3.0:1782759427.463747:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197240960:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.463878:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197240960:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.463887:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1970 00000100:00100000:1.0:1782759427.464736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.464806:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241088 00000100:00100000:2.0:1782759427.464812:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241088 00000100:00100000:2.0:1782759427.464865:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00100000:2.0:1782759427.464874:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197241088:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759427.465252:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197241088:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 379us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.465261:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00100000:1.0:1782759427.466268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.466334:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241216 00000100:00100000:0.0:1782759427.466342:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241216 00000100:00100000:0.0:1782759427.466389:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1971 00000100:00100000:0.0:1782759427.466399:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197241216:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.466866:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197241216:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 467us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.466874:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1971 00000100:00100000:1.0:1782759427.469322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.469377:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241344 00000100:00100000:3.0:1782759427.469386:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241344 00000100:00100000:3.0:1782759427.469439:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1972 00000100:00100000:3.0:1782759427.469450:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197241344:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.469535:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98110:x1869355197241344:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 87us (220us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.469542:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1972 00000100:00100000:1.0:1782759427.479610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.479664:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241472 00000100:00100000:3.0:1782759427.479673:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241472 00000100:00100000:3.0:1782759427.479736:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1973 00000100:00100000:3.0:1782759427.479748:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241472:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.479900:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241472:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 154us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.479909:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1973 00000100:00100000:1.0:1782759427.480868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.480943:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241600 00000100:00100000:3.0:1782759427.480948:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241600 00000100:00100000:3.0:1782759427.481018:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 983 00000100:00100000:3.0:1782759427.481027:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241600:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759427.481391:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241600:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 364us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.481415:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 983 00000100:00100000:1.0:1782759427.483349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.483420:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241728 00000100:00100000:0.0:1782759427.483431:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241728 00000100:00100000:0.0:1782759427.483482:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1974 00000100:00100000:0.0:1782759427.483493:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241728:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.483860:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241728:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 366us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.483869:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1974 00000100:00100000:2.0:1782759427.485244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.485305:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241856 00000100:00100000:3.0:1782759427.485313:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241856 00000100:00100000:3.0:1782759427.485364:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1975 00000100:00100000:3.0:1782759427.485373:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241856:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.485426:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98111:x1869355197241856:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 55us (187us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.485431:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1975 00000100:00100000:1.0:1782759427.494005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.494245:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197241984 00000100:00100000:2.0:1782759427.494261:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197241984 00000100:00100000:2.0:1782759427.494331:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1976 00000100:00100000:2.0:1782759427.494343:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98112:x1869355197241984:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.494428:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98112:x1869355197241984:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 87us (432us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.494439:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1976 00000100:00100000:1.0:1782759427.504020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.504095:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242112 00000100:00100000:0.0:1782759427.504112:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242112 00000100:00100000:0.0:1782759427.504189:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1977 00000100:00100000:0.0:1782759427.504201:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98113:x1869355197242112:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.504309:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98113:x1869355197242112:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 110us (298us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759427.504318:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1977 00000100:00100000:1.0:1782759427.516335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.516439:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242240 00000100:00100000:3.0:1782759427.516450:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242240 00000100:00100000:3.0:1782759427.516498:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1978 00000100:00100000:3.0:1782759427.516506:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98114:x1869355197242240:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.516582:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98114:x1869355197242240:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 77us (257us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.516590:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1978 00000100:00100000:1.0:1782759427.526537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.526934:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242368 00000100:00100000:2.0:1782759427.526952:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242368 00000100:00100000:2.0:1782759427.527044:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1979 00000100:00100000:2.0:1782759427.527057:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98115:x1869355197242368:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.527181:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98115:x1869355197242368:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 127us (661us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.527190:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1979 00000100:00100000:1.0:1782759427.536914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.536985:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242496 00000100:00100000:0.0:1782759427.536995:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242496 00000100:00100000:0.0:1782759427.537047:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1980 00000100:00100000:0.0:1782759427.537055:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98116:x1869355197242496:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.537155:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98116:x1869355197242496:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 98us (251us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759427.537163:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1980 00000100:00100000:1.0:1782759427.546756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.546878:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242624 00000100:00100000:3.0:1782759427.546898:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242624 00000100:00100000:3.0:1782759427.546982:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1981 00000100:00100000:3.0:1782759427.546994:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98117:x1869355197242624:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.547111:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98117:x1869355197242624:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 118us (365us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.547118:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1981 00000100:00100000:1.0:1782759427.557098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.557175:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242752 00000100:00100000:2.0:1782759427.557186:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242752 00000100:00100000:2.0:1782759427.557246:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1982 00000100:00100000:2.0:1782759427.557255:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98118:x1869355197242752:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.557330:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98118:x1869355197242752:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 76us (244us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.557335:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1982 00000100:00100000:1.0:1782759427.566006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.566077:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197242880 00000100:00100000:0.0:1782759427.566101:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197242880 00000100:00100000:0.0:1782759427.566169:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1983 00000100:00100000:0.0:1782759427.566179:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98119:x1869355197242880:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.566287:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98119:x1869355197242880:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 109us (291us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759427.566295:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1983 00000100:00100000:1.0:1782759427.575377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.575446:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243008 00000100:00100000:3.0:1782759427.575457:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243008 00000100:00100000:3.0:1782759427.575530:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1984 00000100:00100000:3.0:1782759427.575555:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98120:x1869355197243008:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.575645:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98120:x1869355197243008:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 92us (278us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.575654:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1984 00000100:00100000:1.0:1782759427.584382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.584522:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243136 00000100:00100000:2.0:1782759427.584532:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243136 00000100:00100000:2.0:1782759427.584592:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1985 00000100:00100000:2.0:1782759427.584608:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243136:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.584770:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243136:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 168us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.584790:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1985 00000100:00100000:1.0:1782759427.586319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.586400:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243264 00000100:00100000:0.0:1782759427.586408:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243264 00000100:00100000:0.0:1782759427.586472:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 984 00000100:00100000:0.0:1782759427.586482:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243264:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759427.586893:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243264:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 412us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.586901:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 984 00000100:00100000:1.0:1782759427.588949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.589024:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243392 00000100:00100000:2.0:1782759427.589033:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243392 00000100:00080000:1.0:1782759427.589098:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759427.589117:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 985 00000100:00100000:2.0:1782759427.589129:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98121:x1869355197243392:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759427.589469:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98121:x1869355197243392:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 342us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.589477:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 985 00000100:00100000:1.0:1782759427.590702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.590762:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243520 00000100:00100000:0.0:1782759427.590769:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243520 00000100:00100000:0.0:1782759427.590850:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1986 00000100:00100000:0.0:1782759427.590861:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243520:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.591132:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243520:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 273us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.591139:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1986 00000100:00100000:1.0:1782759427.592427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.592508:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243648 00000100:00100000:2.0:1782759427.592515:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243648 00000100:00100000:2.0:1782759427.592571:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1987 00000100:00100000:2.0:1782759427.592578:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243648:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.592638:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98121:x1869355197243648:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 60us (214us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.592646:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1987 00000100:00100000:1.0:1782759427.601210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.601285:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243776 00000100:00100000:2.0:1782759427.601295:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243776 00000100:00100000:2.0:1782759427.601357:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1988 00000100:00100000:2.0:1782759427.601368:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197243776:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.601456:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197243776:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.601464:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1988 00000100:00100000:1.0:1782759427.603046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.603156:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197243904 00000100:00100000:3.0:1782759427.603163:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197243904 00000100:00100000:3.0:1782759427.603215:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00100000:3.0:1782759427.603225:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197243904:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759427.603595:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197243904:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 370us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.603603:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 986 00000100:00100000:1.0:1782759427.604791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.604887:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244032 00000100:00100000:0.0:1782759427.604894:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244032 00000100:00100000:0.0:1782759427.604966:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 987 00000100:00100000:0.0:1782759427.604976:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98122:x1869355197244032:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759427.605271:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98122:x1869355197244032:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 295us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.605289:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 987 00000100:00100000:1.0:1782759427.606563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.606612:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244160 00000100:00100000:0.0:1782759427.606618:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244160 00000100:00100000:0.0:1782759427.606663:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1989 00000100:00100000:0.0:1782759427.606673:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197244160:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.607053:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197244160:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 380us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.607060:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1989 00000100:00100000:2.0:1782759427.608588:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.608660:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244288 00000100:00100000:3.0:1782759427.608668:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244288 00000100:00100000:3.0:1782759427.608714:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1990 00000100:00100000:3.0:1782759427.608724:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197244288:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.608790:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98122:x1869355197244288:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 68us (206us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.608810:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1990 00000100:00100000:1.0:1782759427.617612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.617704:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244416 00000100:00100000:2.0:1782759427.617727:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244416 00000100:00100000:2.0:1782759427.617791:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1991 00000100:00100000:2.0:1782759427.617813:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244416:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.617932:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244416:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.617937:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1991 00000100:00100000:1.0:1782759427.618931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.618984:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244544 00000100:00100000:2.0:1782759427.618991:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244544 00000100:00100000:2.0:1782759427.619035:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 988 00000100:00100000:2.0:1782759427.619043:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244544:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759427.619388:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244544:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 345us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.619396:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 988 00000100:00100000:1.0:1782759427.620339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.620414:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244672 00000100:00100000:3.0:1782759427.620421:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244672 00000100:00100000:3.0:1782759427.620502:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 989 00000100:00100000:3.0:1782759427.620511:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98123:x1869355197244672:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759427.620772:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:98123:x1869355197244672:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 261us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.620779:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 989 00000100:00100000:1.0:1782759427.621773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759427.621858:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244800 00000100:00100000:0.0:1782759427.621863:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244800 00000100:00100000:0.0:1782759427.621903:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1992 00000100:00100000:0.0:1782759427.621911:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244800:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759427.622167:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244800:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 256us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.622179:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1992 00000100:00100000:1.0:1782759427.623706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.623754:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197244928 00000100:00100000:3.0:1782759427.623761:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197244928 00000100:00100000:3.0:1782759427.623818:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1993 00000100:00100000:3.0:1782759427.623848:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244928:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.623923:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98123:x1869355197244928:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 77us (218us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.623931:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1993 00000100:00100000:1.0:1782759427.632550:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.632643:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245056 00000100:00100000:2.0:1782759427.632653:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245056 00000100:00100000:2.0:1782759427.632708:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1994 00000100:00100000:2.0:1782759427.632775:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98124:x1869355197245056:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.632911:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98124:x1869355197245056:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 191us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.632918:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1994 00000100:00100000:1.0:1782759427.636157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.636291:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245184 00000100:00100000:2.0:1782759427.636300:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245184 00000100:00100000:2.0:1782759427.636359:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1995 00000100:00100000:2.0:1782759427.636369:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98124:x1869355197245184:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.636479:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98124:x1869355197245184:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 106us (339us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.636504:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1995 00000100:00100000:1.0:1782759427.646396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.646552:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245312 00000100:00100000:3.0:1782759427.646563:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245312 00000100:00100000:3.0:1782759427.646643:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1996 00000100:00100000:3.0:1782759427.646654:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98125:x1869355197245312:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.647046:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98125:x1869355197245312:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 392us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759427.647055:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1996 00000100:00100000:1.0:1782759427.649100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.649320:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245440 00000100:00100000:2.0:1782759427.649329:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245440 00000100:00100000:2.0:1782759427.649374:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1997 00000100:00100000:2.0:1782759427.649383:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98125:x1869355197245440:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.649459:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98125:x1869355197245440:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 77us (364us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759427.649467:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1997 00000100:00100000:1.0:1782759427.660407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.660481:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245568 00000100:00100000:2.0:1782759427.660492:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245568 00000100:00100000:2.0:1782759427.660551:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1998 00000100:00100000:2.0:1782759427.660561:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98126:x1869355197245568:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759427.660662:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98126:x1869355197245568:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.660670:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1998 00000100:00100000:1.0:1782759427.662983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759427.663036:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245696 00000100:00100000:3.0:1782759427.663044:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245696 00000100:00100000:3.0:1782759427.663104:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1999 00000100:00100000:3.0:1782759427.663115:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98126:x1869355197245696:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759427.663189:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98126:x1869355197245696:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 76us (221us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759427.663196:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1999 00010000:00010000:0.0:1782759427.692884:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759427.766178:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759427.766274:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245824 00000100:00100000:2.0:1782759427.766283:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245824 00000100:00100000:2.0:1782759427.766329:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2695 00000100:00100000:2.0:1782759427.766337:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197245824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759427.766402:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197245824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.766407:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2695 00000020:00000080:0.0:1782759428.498752:0:139766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd94a1def0 20000000:00000080:0.0:1782759428.498769:0:139766:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084eec800 uarg=0000000000000000 00010000:00010000:0.0:1782759428.501240:0:139766:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759428.501318:0:139766:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759428.501363:0:139766:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759428.501382:0:139766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.501399:0:139766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.501422:0:139766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.501459:0:139766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.501476:0:139766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 18 pid: 5796 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759428.501490:0:139766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139766:1869355211924480:0@lo:104: 00000100:00100000:0.0:1782759428.501551:0:139766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759428.501608:0:139766:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759428.501684:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924480 00000100:00100000:1.0:1782759428.501691:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924480 00000100:00100000:1.0:1782759428.501738:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1782759428.501745:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139766:x1869355211924480:12345-0@lo:104: 00010000:00010000:1.0:1782759428.501755:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759428.501883:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759428.501889:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139766:x1869355211924480:12345-0@lo:104: Request processed in 144us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759428.501895:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00010000:00010000:3.0:1782759428.501907:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759428.501916:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.501926:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759428.501938:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.501948:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759428.501952:0:139766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139766:1869355211924480:0@lo:104: 10000000:00010000:3.0:1782759428.501962:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759428.501970:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759428.501970:0:139766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502011:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502019:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759428.502045:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502052:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df22f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df236 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759428.502057:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211924608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759428.502071:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759428.502075:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759428.502078:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759428.502085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759428.502114:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924608 00000100:00100000:3.0:1782759428.502119:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924608 00010000:00010000:3.0:1782759428.502140:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 19 pid: 5796 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759428.502166:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1782759428.502172:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211924608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759428.502182:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759428.502191:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 19 pid: 5796 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502207:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 19 pid: 5796 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502219:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99800/0xdd99f5c4777df236 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df22f expref: 19 pid: 5796 timeout: 3596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502230:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502237:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502248:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502254:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502260:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502265:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502270:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759428.502274:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502281:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502305:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.502313:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759428.502336:0:139766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.502345:0:139766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.502351:0:139766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df23d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759428.502353:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211924608:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759428.502372:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1782759428.502386:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211924608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759428.718961:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759428.903437:0:139814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc446e5580 20000000:00000080:0.0:1782759428.903459:0:139814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be3000 uarg=0000000000000000 00010000:00010000:0.0:1782759428.903718:0:139814:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759428.903733:0:139814:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759428.903750:0:139814:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759428.903781:0:139814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903796:0:139814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903807:0:139814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903812:0:139814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903819:0:139814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903899:0:139814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903905:0:139814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759428.903908:0:139814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903916:0:139814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903929:0:139814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903947:0:139814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759428.903953:0:139814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99800/0xdd99f5c4777df244 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759429.036022:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759429.036044:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211924736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759429.036116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759429.036163:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924736 00000100:00100000:3.0:1782759429.036171:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924736 00000100:00080000:0.0:1782759429.036233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759429.036240:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1782759429.036252:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211924736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759429.036292:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759429.036350:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211924736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759429.036359:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1782759429.037050:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211924736:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782759429.297249:0:139862:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5d76b390 20000000:00000080:1.0:1782759429.297268:0:139862:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917191997800 uarg=0000000000000000 00010000:00010000:1.0:1782759429.297481:0:139862:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759429.297496:0:139862:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759429.297519:0:139862:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759429.297539:0:139862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297553:0:139862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297565:0:139862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297571:0:139862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297577:0:139862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297585:0:139862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297591:0:139862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759429.297595:0:139862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297604:0:139862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297617:0:139862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297625:0:139862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.297642:0:139862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031800/0xdd99f5c4777df24b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759429.612963:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759429.612974:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759429.612981:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759429.613050:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.613064:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.613076:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759429.613111:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211924864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759429.613206:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759429.613377:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759429.613417:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924864 00000100:00100000:0.0:1782759429.613426:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924864 00000100:00100000:0.0:1782759429.613518:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1782759429.613528:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211924864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759429.613546:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759429.613562:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df252 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.613591:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.613603:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.613614:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99c00, rc 0) 00000100:00100000:0.0:1782759429.613709:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211924864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759429.613718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1782759429.613817:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211924864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759429.613871:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.613880:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759429.613903:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759429.613908:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.613936:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.743889:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759429.744575:0:139910:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7cafd190 20000000:00000080:2.0:1782759429.744590:0:139910:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b58c00 uarg=0000000000000000 00010000:00010000:2.0:1782759429.745087:0:139910:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759429.745102:0:139910:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759429.745117:0:139910:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759429.745135:0:139910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.745150:0:139910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.745159:0:139910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.745209:0:139910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.745223:0:139910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 18 pid: 5796 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759429.745238:0:139910:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139910:1869355211924992:0@lo:104: 00000100:00100000:2.0:1782759429.745306:0:139910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759429.745394:0:139910:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759429.745437:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211924992 00000100:00100000:0.0:1782759429.745445:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211924992 00000100:00100000:0.0:1782759429.745555:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1782759429.745572:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139910:x1869355211924992:12345-0@lo:104: 00010000:00010000:0.0:1782759429.745586:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.745664:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759429.745670:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:139910:x1869355211924992:12345-0@lo:104: Request processed in 100us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759429.745676:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00010000:1.0:1782759429.745728:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759429.745735:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.745742:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759429.745746:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.745766:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759429.745774:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759429.745780:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759429.745814:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.745842:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759429.745863:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.745871:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65400/0xdd99f5c4777df252 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df259 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.745885:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759429.745893:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759429.745895:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759429.745913:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211925120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759429.745944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759429.745981:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925120 00000100:00100000:1.0:1782759429.745986:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925120 00010000:00010000:1.0:1782759429.746004:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 19 pid: 5796 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759429.746028:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1782759429.746035:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211925120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759429.746051:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759429.746057:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 19 pid: 5796 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746069:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 19 pid: 5796 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746085:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746094:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746108:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.746111:0:139910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99c00/0xdd99f5c4777df259 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df252 expref: 19 pid: 5796 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746123:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759429.746132:0:139910:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139910:1869355211924992:0@lo:104: 00010000:00010000:1.0:1782759429.746135:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746149:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.746152:0:139910:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746157:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759429.746164:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.746168:0:139910:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746174:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.746178:0:139910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746191:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746200:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df260 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759429.746213:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759429.746243:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211925120:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759429.746250:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1782759429.746281:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211925120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759430.764231:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759431.084253:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211925248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.084418:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211925632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759431.084484:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211925504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759431.084580:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759431.084583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759431.084656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759431.084703:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211925376:0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.084749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759431.084766:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211925888:0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.084804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759431.084900:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211925760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.084912:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925504 00000100:00100000:2.0:1782759431.084922:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925504 00000100:00100000:3.0:1782759431.084933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759431.084985:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925248 00000100:00100000:3.0:1782759431.084989:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925248 00000100:00100000:2.0:1782759431.084998:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925376 00000100:00100000:2.0:1782759431.085003:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925376 00000100:00100000:1.0:1782759431.085024:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925760 00000100:00100000:1.0:1782759431.085039:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925760 00000100:00100000:3.0:1782759431.085048:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:2.0:1782759431.085048:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:3.0:1782759431.085070:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211925248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.085070:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211925504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759431.085100:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:1.0:1782759431.085117:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211925376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.085144:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211925504:12345-0@lo:400:kworker.0 Request processed in 81us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759431.085152:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211925248:12345-0@lo:400:kworker.0 Request processed in 90us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759431.085158:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:3.0:1782759431.085164:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:2.0:1782759431.085189:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:2.0:1782759431.085204:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211925760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759431.085241:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211925376:12345-0@lo:400:kworker.0 Request processed in 127us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759431.085253:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211925248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759431.085255:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1782759431.085270:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211925760:12345-0@lo:400:kworker.0 Request processed in 66us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759431.085286:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:3.0:1782759431.085291:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211925760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.085342:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211925376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759431.085459:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211925504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759431.085487:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925632 00000100:00100000:0.0:1782759431.085491:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925632 00000100:00100000:0.0:1782759431.085565:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211925888 00000100:00100000:0.0:1782759431.085569:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211925888 00000100:00100000:2.0:1782759431.085610:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1782759431.085621:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211925632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.085671:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211925632:12345-0@lo:400:kworker.0 Request processed in 54us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759431.085680:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1782759431.085700:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211925632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.085704:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:2.0:1782759431.085718:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211925888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759431.085773:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211925888:12345-0@lo:400:kworker.0 Request processed in 60us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759431.085793:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1782759431.085809:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211925888:0@lo:400:kworker.0 00000100:00080000:0.0:1782759431.085944:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759431.085951:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759431.085958:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1782759431.474279:0:140108:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0263f420 20000000:00000080:2.0:1782759431.474298:0:140108:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfd9400 uarg=0000000000000000 10000000:01000000:2.0:1782759431.474732:0:140108:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759431.474754:0:140108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474772:0:140108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474784:0:140108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474792:0:140108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474798:0:140108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474806:0:140108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474811:0:140108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759431.474815:0:140108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474851:0:140108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474864:0:140108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474882:0:140108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.474889:0:140108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df267 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759431.596017:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759431.596042:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211926016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759431.596118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759431.596173:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926016 00000100:00100000:0.0:1782759431.596182:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926016 00000100:00100000:0.0:1782759431.596240:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1782759431.596251:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211926016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759431.596293:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759431.596347:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211926016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759431.596355:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1782759431.596378:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211926016:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1782759431.723939:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759431.723948:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759431.723955:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759431.724022:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759431.724037:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759431.724052:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759431.724098:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211926144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759431.724211:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759431.724288:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718b697240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759431.724299:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926144 00000100:00100000:0.0:1782759431.724310:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926144 00000100:00100000:0.0:1782759431.724389:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1782759431.724401:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211926144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759431.724417:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759431.724435:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df26e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.724465:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.724485:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.724496:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759431.724551:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211926144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759431.724560:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1782759431.724597:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211926144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759431.724619:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759431.724631:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759431.724654:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759431.724660:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759431.724668:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.788174:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759431.861002:0:140156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd253ed20 20000000:00000080:0.0:1782759431.861020:0:140156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be1000 uarg=0000000000000000 10000000:01000000:0.0:1782759431.861255:0:140156:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759431.861279:0:140156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.861299:0:140156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.861307:0:140156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.861352:0:140156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.861377:0:140156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 18 pid: 5796 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759431.861393:0:140156:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140156:1869355211926272:0@lo:104: 00000100:00100000:0.0:1782759431.861460:0:140156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759431.861526:0:140156:0:(client.c:2701:ptlrpc_set_wait()) set ffff917089191cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759431.861604:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926272 00000100:00100000:2.0:1782759431.861613:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926272 00000100:00100000:2.0:1782759431.861671:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1782759431.861681:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140156:x1869355211926272:12345-0@lo:104: 00010000:00010000:2.0:1782759431.861695:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.861777:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759431.861785:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140156:x1869355211926272:12345-0@lo:104: Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759431.861793:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00010000:00010000:3.0:1782759431.861843:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759431.861851:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.861884:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759431.861889:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.861898:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759431.861905:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759431.861911:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759431.861949:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.861956:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759431.861975:0:140156:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140156:1869355211926272:0@lo:104: 00010000:00010000:3.0:1782759431.861977:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.861988:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df26e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df275 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862000:0:140156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.862004:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759431.862007:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759431.862011:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759431.862024:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211926400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759431.862066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759431.862159:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926400 00000100:00100000:0.0:1782759431.862166:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926400 00010000:00010000:0.0:1782759431.862185:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 19 pid: 5796 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759431.862212:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1782759431.862220:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211926400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759431.862229:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759431.862234:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 19 pid: 5796 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862244:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 19 pid: 5796 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862257:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99600/0xdd99f5c4777df275 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df26e expref: 19 pid: 5796 timeout: 3600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862269:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862284:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862296:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862303:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862310:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862316:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862321:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759431.862325:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862333:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.862435:0:140156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.862443:0:140156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862786:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862795:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99400/0xdd99f5c4777df27c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759431.862808:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759431.863007:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211926400:12345-0@lo:103:ldlm_bl.0 Request processed in 787us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759431.863018:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1782759431.863059:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211926400:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1782759432.239431:0:140204:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefd9c0220 20000000:00000080:0.0:1782759432.239456:0:140204:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be2400 uarg=0000000000000000 00010000:00010000:0.0:1782759432.239771:0:140204:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759432.239788:0:140204:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759432.239812:0:140204:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759432.239869:0:140204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239889:0:140204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239901:0:140204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239909:0:140204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239916:0:140204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239924:0:140204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239930:0:140204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759432.239935:0:140204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239942:0:140204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239967:0:140204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239975:0:140204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.239982:0:140204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99600/0xdd99f5c4777df283 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.812938:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759432.884486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759432.884529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759432.884578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759432.884612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759432.884628:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246080 00000100:00100000:3.0:1782759432.884640:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246080 00000100:00100000:2.0:1782759432.884645:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197245952 00000100:00100000:0.0:1782759432.884648:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246336 00000100:00100000:2.0:1782759432.884652:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197245952 00000100:00100000:0.0:1782759432.884654:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246336 00000100:00100000:2.0:1782759432.884717:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2699 00000100:00100000:3.0:1782759432.884722:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2507 00000100:00100000:2.0:1782759432.884734:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197245952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759432.884735:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246208 00000100:00100000:3.0:1782759432.884736:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197246080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759432.884754:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246208 00000100:00100000:3.0:1782759432.884807:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197246080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759432.884815:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197245952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759432.884817:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2507 00000100:00100000:2.0:1782759432.884854:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2699 00000100:00080000:2.0:1782759432.887221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759432.887230:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759432.887233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759432.887339:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1960 00000100:00100000:0.0:1782759432.887352:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197246336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759432.887404:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197246336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759432.887412:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1960 00000100:00100000:1.0:1782759432.887634:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1961 00000100:00100000:1.0:1782759432.887642:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197246208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759432.888878:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197246208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1231us (4259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759432.888887:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1961 10000000:01000000:1.0:1782759433.707929:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759433.707938:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759433.707942:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759433.707993:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.708005:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.708017:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759433.708046:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211926528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759433.708113:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759433.708169:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759433.708223:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926528 00000100:00100000:0.0:1782759433.708231:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926528 00000100:00100000:0.0:1782759433.708282:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1782759433.708293:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211926528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759433.708307:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759433.708321:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df28a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.708357:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.708368:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.708375:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99200, rc 0) 00000100:00100000:0.0:1782759433.708439:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211926528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759433.708445:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:1.0:1782759433.708509:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211926528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759433.708522:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.708528:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759433.708544:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759433.708553:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.708561:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.837754:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759433.982535:0:140400:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcafe20670 20000000:00000080:3.0:1782759433.982553:0:140400:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317dc00 uarg=0000000000000000 00010000:00010000:3.0:1782759433.982793:0:140400:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759433.982808:0:140400:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759433.982864:0:140400:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759433.982883:0:140400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.982902:0:140400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.982911:0:140400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.982948:0:140400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.982962:0:140400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 18 pid: 5794 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759433.982979:0:140400:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140400:1869355211926656:0@lo:104: 00000100:00100000:3.0:1782759433.983046:0:140400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759433.983117:0:140400:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759433.983187:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926656 00000100:00100000:2.0:1782759433.983195:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926656 00000100:00100000:2.0:1782759433.983240:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1782759433.983250:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140400:x1869355211926656:12345-0@lo:104: 00010000:00010000:2.0:1782759433.983263:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759433.983363:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759433.983370:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140400:x1869355211926656:12345-0@lo:104: Request processed in 122us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759433.983377:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00010000:00010000:1.0:1782759433.983433:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759433.983441:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.983448:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759433.983451:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.983459:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759433.983466:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759433.983472:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759433.983531:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.983538:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759433.983561:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.983568:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777df28a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df291 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759433.983583:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211926784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759433.983596:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759433.983600:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759433.983603:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759433.983615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.983649:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926784 00000100:00100000:0.0:1782759433.983652:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926784 00000100:00100000:3.0:1782759433.983661:0:140400:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140400:1869355211926656:0@lo:104: 00010000:00010000:0.0:1782759433.983681:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 19 pid: 5794 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.983690:0:140400:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759433.983711:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1782759433.983720:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211926784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759433.983732:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759433.983737:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 19 pid: 5794 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983749:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 19 pid: 5794 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983761:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df291 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df28a expref: 19 pid: 5794 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983783:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983791:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983805:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983839:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983847:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983854:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983860:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759433.983864:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983870:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983885:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.983895:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759433.983926:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211926784:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759433.983939:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1782759433.983945:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211926784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759433.984229:0:140400:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.984237:0:140400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759433.984243:0:140400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777df298 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759434.156091:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211926912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759434.156209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759434.156428:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211926912 00000100:00100000:3.0:1782759434.156439:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211926912 00000100:00100000:3.0:1782759434.156516:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1782759434.156531:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211926912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759434.156576:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759434.156640:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211926912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759434.156649:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:3.0:1782759434.156686:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759434.156738:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211926912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759434.860386:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759434.987957:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759434.987966:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759434.987971:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759434.988035:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.988071:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.988088:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759434.988124:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211927040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759434.988209:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759434.988262:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759434.988282:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927040 00000100:00100000:2.0:1782759434.988291:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927040 00000100:00100000:2.0:1782759434.988351:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1782759434.988360:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211927040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759434.988373:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759434.988394:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df29f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759434.988419:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759434.988430:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759434.988439:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64c00, rc 0) 00000100:00100000:2.0:1782759434.988498:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211927040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759434.988505:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:1.0:1782759434.988678:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211927040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759434.988693:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759434.988701:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759434.988720:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759434.988726:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759434.988733:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759435.294505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759435.294560:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246464 00000100:00100000:2.0:1782759435.294570:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246464 00000100:00080000:3.0:1782759435.294627:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759435.294664:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2000 00000100:00100000:2.0:1782759435.294675:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98398:x1869355197246464:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759435.329419:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98398:x1869355197246464:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 34736us (34913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759435.329432:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2000 00000100:00100000:1.0:1782759435.342932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759435.342995:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246592 00000100:00100000:0.0:1782759435.343005:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246592 00000100:00100000:0.0:1782759435.343082:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2001 00000100:00100000:0.0:1782759435.343094:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98399:x1869355197246592:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759435.371729:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98399:x1869355197246592:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 28627us (28800us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759435.371746:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2001 00000100:00100000:0.0:1782759435.384552:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759435.384682:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246720 00000100:00100000:1.0:1782759435.384692:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246720 00000100:00100000:1.0:1782759435.384797:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2002 00000100:00100000:1.0:1782759435.384808:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98400:x1869355197246720:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759435.412961:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98400:x1869355197246720:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 28143us (28409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759435.412973:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2002 00000100:00100000:0.0:1782759435.426286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759435.426408:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246848 00000100:00100000:2.0:1782759435.426421:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246848 00000100:00100000:2.0:1782759435.426482:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2003 00000100:00100000:2.0:1782759435.426494:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98401:x1869355197246848:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759435.456307:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98401:x1869355197246848:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 29802us (30021us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759435.456322:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2003 00000100:00100000:1.0:1782759435.466809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759435.467664:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197246976 00000100:00100000:2.0:1782759435.467694:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197246976 00000100:00100000:2.0:1782759435.467762:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2004 00000100:00100000:2.0:1782759435.467772:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98402:x1869355197246976:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759435.495092:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98402:x1869355197246976:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 27308us (28281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759435.495110:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2004 00000100:00100000:1.0:1782759435.505971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759435.506095:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247104 00000100:00100000:0.0:1782759435.506110:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247104 00000100:00100000:0.0:1782759435.506262:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2005 00000100:00100000:0.0:1782759435.506275:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98403:x1869355197247104:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759435.541335:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98403:x1869355197247104:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 35044us (35366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759435.541357:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2005 00010000:00010000:1.0:1782759435.884342:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759435.906464:0:140595:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc63489f50 20000000:00000080:0.0:1782759435.906477:0:140595:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be1000 uarg=0000000000000000 00010000:00010000:0.0:1782759435.907241:0:140595:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759435.907256:0:140595:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759435.907273:0:140595:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759435.907290:0:140595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.907308:0:140595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.907314:0:140595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.907345:0:140595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.907356:0:140595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 18 pid: 5796 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759435.907370:0:140595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140595:1869355211927168:0@lo:104: 00000100:00100000:0.0:1782759435.907429:0:140595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759435.907485:0:140595:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759435.907544:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927168 00000100:00100000:2.0:1782759435.907552:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927168 00000100:00100000:2.0:1782759435.907644:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1782759435.907653:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140595:x1869355211927168:12345-0@lo:104: 00010000:00010000:2.0:1782759435.907665:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759435.907732:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759435.907738:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140595:x1869355211927168:12345-0@lo:104: Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759435.907746:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00010000:00010000:3.0:1782759435.907787:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759435.907794:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759435.907802:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759435.907806:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759435.907814:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759435.907854:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759435.907860:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759435.907893:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759435.907899:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759435.907926:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759435.907934:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df29f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759435.907948:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759435.907950:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759435.907951:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759435.907962:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211927296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759435.907991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759435.908115:0:140595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140595:1869355211927168:0@lo:104: 00010000:00010000:0.0:1782759435.908133:0:140595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759435.908160:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927296 00000100:00100000:0.0:1782759435.908171:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927296 00010000:00010000:0.0:1782759435.908188:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 19 pid: 5796 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759435.908217:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1782759435.908223:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211927296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759435.908232:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759435.908236:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 19 pid: 5796 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908246:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 19 pid: 5796 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908257:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df2a6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df29f expref: 19 pid: 5796 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908266:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908273:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908284:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908291:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908298:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908304:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908315:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759435.908319:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908326:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908338:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908346:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759435.908372:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211927296:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759435.908379:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00010000:00010000:0.0:1782759435.908397:0:140595:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908404:0:140595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759435.908410:0:140595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df2ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759435.909240:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211927296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759436.204111:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211927808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759436.204143:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211927680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759436.204169:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211927424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759436.204176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759436.204195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759436.204212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759436.204242:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211927936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759436.204258:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927680 00000100:00100000:2.0:1782759436.204271:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927680 00000100:00080000:1.0:1782759436.204322:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759436.204328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759436.204371:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759436.204379:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211927552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759436.204407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759436.204409:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927808 00000100:00100000:0.0:1782759436.204415:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927808 00000100:00100000:2.0:1782759436.204444:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927936 00000100:00100000:2.0:1782759436.204450:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927936 00000100:00100000:1.0:1782759436.204458:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1782759436.204464:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927424 00000100:00100000:0.0:1782759436.204470:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927424 00000100:00100000:1.0:1782759436.204471:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211927680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759436.204492:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211927552 00000100:00100000:2.0:1782759436.204496:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:3.0:1782759436.204499:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211927552 00000100:00100000:0.0:1782759436.204504:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:2.0:1782759436.204510:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211927936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759436.204519:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211927808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759436.204540:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211927680:12345-0@lo:400:kworker.0 Request processed in 70us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759436.204541:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1782759436.204551:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:3.0:1782759436.204567:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211927424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759436.204567:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211927936:12345-0@lo:400:kworker.0 Request processed in 59us (294us total) trans 0 rc 0/0 00000100:00080000:1.0:1782759436.204579:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759436.204583:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00080000:1.0:1782759436.204586:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759436.204596:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211927808:12345-0@lo:400:kworker.0 Request processed in 81us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759436.204605:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:3.0:1782759436.204611:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211927424:12345-0@lo:400:kworker.0 Request processed in 49us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759436.204618:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:0.0:1782759436.204641:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:2.0:1782759436.204647:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211927424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759436.204654:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211927552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759436.204675:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211927680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759436.204678:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211927936:0@lo:400:kworker.0 00000100:00100000:0.0:1782759436.204699:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211927552:12345-0@lo:400:kworker.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759436.204708:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:1.0:1782759436.204719:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211927808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759436.204725:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211927552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759436.716129:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759436.716161:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211928064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759436.716258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759436.716335:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928064 00000100:00100000:3.0:1782759436.716352:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928064 00000100:00100000:3.0:1782759436.716417:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1782759436.716430:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211928064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759436.716487:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759436.716555:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211928064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759436.716563:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1782759436.716597:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211928064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759436.907996:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759437.229270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759437.229321:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247232 00000100:00100000:3.0:1782759437.229332:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247232 00000100:00100000:3.0:1782759437.229391:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2006 00000100:00100000:3.0:1782759437.229403:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98476:x1869355197247232:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759437.229479:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98476:x1869355197247232:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 79us (217us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759437.229488:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2006 00000100:00080000:3.0:1782759437.229510:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759437.257084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759437.257237:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247360 00000100:00100000:3.0:1782759437.257249:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247360 00000100:00100000:3.0:1782759437.257372:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2007 00000100:00100000:3.0:1782759437.257382:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98477:x1869355197247360:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759437.257472:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98477:x1869355197247360:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 91us (393us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759437.257481:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2007 00000100:00100000:3.0:1782759437.275187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759437.275331:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247488 00000100:00100000:0.0:1782759437.275342:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247488 00000100:00100000:0.0:1782759437.275435:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2008 00000100:00100000:0.0:1782759437.275446:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98478:x1869355197247488:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759437.275532:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:98478:x1869355197247488:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 88us (353us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759437.275540:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2008 10000000:01000000:3.0:1782759437.868908:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759437.868922:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759437.868938:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759437.869028:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759437.869043:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759437.869061:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759437.869100:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211928192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759437.869227:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759437.869305:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c09906c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759437.870058:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928192 00000100:00100000:1.0:1782759437.870067:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928192 00000100:00100000:1.0:1782759437.870174:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:1.0:1782759437.870188:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211928192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759437.870218:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759437.870241:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df2b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759437.870276:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759437.870289:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759437.870313:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031000, rc 0) 00000100:00100000:1.0:1782759437.870368:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211928192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759437.870375:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:3.0:1782759437.870582:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211928192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759437.870614:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759437.870624:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759437.870654:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759437.870660:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759437.870722:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759437.932054:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759438.004809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759438.004874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759438.004911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759438.004990:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247872 00000100:00100000:3.0:1782759438.004999:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247872 00000100:00100000:3.0:1782759438.005057:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1964 00000100:00100000:3.0:1782759438.005067:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197247872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759438.005147:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197247872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759438.005155:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1964 00000100:00100000:3.0:1782759438.005182:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247744 00000100:00100000:3.0:1782759438.005186:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247744 00000100:00100000:3.0:1782759438.005218:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2511 00000100:00100000:3.0:1782759438.005225:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197247744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759438.005254:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197247744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759438.005260:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2511 00000100:00080000:3.0:1782759438.005285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759438.005404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759438.005414:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197247616 00000100:00100000:0.0:1782759438.005420:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197247616 00000100:00100000:1.0:1782759438.005441:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248000 00000100:00100000:1.0:1782759438.005446:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248000 00000100:00100000:0.0:1782759438.005455:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2703 00000100:00100000:0.0:1782759438.005464:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197247616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759438.005481:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1965 00000100:00100000:1.0:1782759438.005490:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197248000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759438.005499:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197247616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.005507:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2703 00000100:00100000:1.0:1782759438.005522:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197248000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759438.005531:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1965 00000100:00080000:0.0:1782759438.005544:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759438.956627:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759439.276152:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211928320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759439.276229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759439.276275:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928320 00000100:00100000:3.0:1782759439.276285:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928320 00000100:00080000:0.0:1782759439.276328:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759439.276347:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1782759439.276358:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211928320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759439.276396:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759439.276451:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211928320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759439.276459:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1782759439.276496:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211928320:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782759439.671793:0:140938:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd22fac6e0 20000000:00000080:2.0:1782759439.671819:0:140938:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc2800 uarg=0000000000000000 00010000:00010000:2.0:1782759439.672120:0:140938:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759439.672138:0:140938:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759439.672154:0:140938:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759439.672174:0:140938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759439.672191:0:140938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759439.672200:0:140938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759439.672242:0:140938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759439.672257:0:140938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 18 pid: 5794 timeout: 3608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759439.672272:0:140938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140938:1869355211928448:0@lo:104: 00000100:00100000:2.0:1782759439.672348:0:140938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759439.672419:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759439.672420:0:140938:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3d300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759439.672434:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928448 00000100:00100000:0.0:1782759439.672441:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928448 00000100:00100000:0.0:1782759439.672494:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1782759439.672504:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187964450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140938:x1869355211928448:12345-0@lo:104: 00010000:00010000:0.0:1782759439.672517:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.672606:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759439.672613:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187964450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:140938:x1869355211928448:12345-0@lo:104: Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759439.672620:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1782759439.672643:0:140938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140938:1869355211928448:0@lo:104: 00010000:00010000:2.0:1782759439.672676:0:140938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759439.672699:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759439.672718:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759439.672761:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759439.672766:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759439.672777:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759439.672786:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759439.672792:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759439.672891:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759439.672897:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759439.672940:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759439.672961:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759439.672969:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211928576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759439.672988:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759439.672992:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759439.672994:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759439.673039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759439.673064:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928576 00000100:00100000:0.0:1782759439.673071:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928576 00010000:00010000:0.0:1782759439.673111:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 19 pid: 5794 timeout: 3608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759439.673137:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1782759439.673144:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211928576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759439.673154:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759439.673159:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 19 pid: 5794 timeout: 3608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673170:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 19 pid: 5794 timeout: 3608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673187:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031000/0xdd99f5c4777df2bb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df2b4 expref: 19 pid: 5794 timeout: 3608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673210:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673218:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673230:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673236:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673242:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673249:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673255:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759439.673259:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673266:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673293:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759439.673302:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759439.673344:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211928576:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (305us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759439.673352:0:140938:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759439.673360:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00010000:00010000:2.0:1782759439.673368:0:140938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759439.673376:0:140938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df2c2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759439.673392:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211928576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759439.979951:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759441.004068:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759441.212269:0:141135:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c24066a2 len=0 uarg=00007ffe18be2f80 00040000:00000080:1.0:1782759441.212286:0:141135:0:(qmt_handler.c:1453:qmt_iocontrol()) lustre-QMT0000: cmd=c24066a2 len=584 karg=ffff917191997000 uarg=0000000000000000 00000100:00100000:3.0:1782759441.324104:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211928832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324146:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211928704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759441.324217:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211928960:0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759441.324291:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211929344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324297:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211929216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759441.324344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759441.324386:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211929088:0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324409:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928832 00000100:00100000:3.0:1782759441.324412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759441.324418:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928832 00000100:00100000:3.0:1782759441.324445:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211929344 00000100:00100000:3.0:1782759441.324450:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211929344 00000100:00100000:2.0:1782759441.324466:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211929216 00000100:00100000:2.0:1782759441.324471:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211929216 00000100:00100000:2.0:1782759441.324502:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:3.0:1782759441.324508:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211929088 00000100:00100000:2.0:1782759441.324511:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211928832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324513:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211929088 00000100:00100000:3.0:1782759441.324557:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1782759441.324565:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211929344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324581:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211928832:12345-0@lo:400:kworker.0 Request processed in 71us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759441.324589:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:3.0:1782759441.324607:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211929344:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759441.324610:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:3.0:1782759441.324620:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1782759441.324623:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211929216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324638:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1782759441.324647:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211929088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324674:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211929216:12345-0@lo:400:kworker.0 Request processed in 53us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759441.324683:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:3.0:1782759441.324693:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211929088:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759441.324701:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00080000:3.0:1782759441.324725:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759441.324729:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759441.324731:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759441.324746:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211929216:0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324761:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211929088:0@lo:400:kworker.0 00000100:00100000:2.0:1782759441.324793:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211928832:0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324800:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928704 00000100:00100000:3.0:1782759441.324805:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928704 00000100:00100000:2.0:1782759441.324808:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211929344:0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324861:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:3.0:1782759441.324871:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211928704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.324920:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211928704:12345-0@lo:400:kworker.0 Request processed in 52us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759441.324933:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:1.0:1782759441.324956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759441.325036:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211928704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.325052:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211928960 00000100:00100000:3.0:1782759441.325058:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211928960 00000100:00080000:2.0:1782759441.325082:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759441.325099:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:3.0:1782759441.325106:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211928960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759441.325145:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211928960:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759441.325153:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1782759441.325164:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211928960:0@lo:400:kworker.0 10000000:01000000:3.0:1782759441.453676:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759441.453691:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759441.453695:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759441.453733:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759441.453741:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759441.453749:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759441.453767:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211929472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759441.453861:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759441.453898:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211929472 00000100:00100000:0.0:1782759441.453906:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211929472 00000100:00100000:3.0:1782759441.453907:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759441.454020:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1782759441.454030:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211929472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759441.454042:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759441.454055:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df2c9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759441.454079:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759441.454089:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759441.454098:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99400, rc 0) 00000100:00100000:0.0:1782759441.454149:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211929472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759441.454155:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:3.0:1782759441.454223:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211929472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759441.454238:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759441.454246:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759441.454288:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759441.454293:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759441.454299:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759441.836048:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211929600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759441.836133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759441.836187:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211929600 00000100:00100000:3.0:1782759441.836195:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211929600 00000100:00100000:3.0:1782759441.836249:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1782759441.836260:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211929600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759441.836294:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759441.836339:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211929600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759441.836344:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1782759441.836548:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211929600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759442.029284:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759442.312274:0:141279:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffceff31a70 20000000:00000080:3.0:1782759442.312292:0:141279:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff917084cb0400 uarg=0000000000000000 00000040:00100000:3.0:1782759442.313317:0:141279:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 20000000:01000000:3.0:1782759442.313324:0:141279:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 46 cmd:0xce021 lustre.pool64c lustre-OST0000_UUID 20000000:01000000:3.0:1782759442.313338:0:141279:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool64c.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1782759442.313734:0:141280:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 45 marker 30 1->4: lustre-clilov add lustre.pool64c.lustre-OST0000_UUID 20000000:01000000:0.0:1782759442.313819:0:141280:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 47 marker 30 2->4: lustre-clilov add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:0.0:1782759442.313884:0:141280:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1782759442.314173:0:141279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 20000000:01000000:3.0:1782759442.314187:0:141279:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:3.0:1782759442.314217:0:141279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 128 off16736 00000040:00080000:3.0:1782759442.314260:0:141279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16960 20000000:01000000:3.0:1782759442.314274:0:141279:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool64c.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1782759442.314708:0:141281:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 40 marker 31 1->4: lustre-MDT0000-mdtlov add lustre.pool64c.lustre-OST0000_UUID 20000000:01000000:0.0:1782759442.314787:0:141281:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 42 marker 31 2->4: lustre-MDT0000-mdtlov add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:0.0:1782759442.314853:0:141281:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1782759442.315095:0:141279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15856 20000000:01000000:3.0:1782759442.315115:0:141279:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:3.0:1782759442.315176:0:141279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 136 off15992 00000040:00080000:3.0:1782759442.315203:0:141279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off16216 10000000:01000000:3.0:1782759442.315212:0:141279:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782759442.315229:0:141279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315254:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315262:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315270:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315277:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315283:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315287:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315291:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315297:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315301:0:141279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315312:0:141279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315345:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315360:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 9 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.315375:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211929728:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759442.315490:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315499:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 9 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.315520:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211929856:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759442.315550:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315556:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.315565:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211929984:0@lo:104: 00000100:00100000:3.0:1782759442.315598:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759442.315637:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315656:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 18 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759442.315657:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211929984 00000100:00100000:2.0:1782759442.315667:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211929984 00000100:00100000:3.0:1782759442.315671:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930112:0@lo:104: 00000100:00100000:3.0:1782759442.315698:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759442.315720:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930112 00000100:00100000:2.0:1782759442.315725:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930112 00000100:00100000:1.0:1782759442.315737:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00010000:00010000:3.0:1782759442.315742:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.315754:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211929984:12345-0@lo:104: 00010000:00010000:3.0:1782759442.315755:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.315769:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00010000:00010000:1.0:1782759442.315771:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.315772:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930240:0@lo:104: 00000100:00100000:0.0:1782759442.315783:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930112:12345-0@lo:104: 00000100:00100000:3.0:1782759442.315799:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759442.315799:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.315859:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1782759442.315865:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782759442.315867:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211929984:12345-0@lo:104: Request processed in 118us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759442.315876:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759442.315877:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00010000:00010000:2.0:1782759442.315879:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.315887:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930112:12345-0@lo:104: Request processed in 107us (187us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759442.315894:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:3.0:1782759442.315897:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759442.315901:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.315901:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1782759442.315903:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930240 00010000:00010000:3.0:1782759442.315911:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.315911:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930240 00010000:00010000:2.0:1782759442.315920:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.315923:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930368:0@lo:104: 00010000:00010000:0.0:1782759442.315927:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759442.315935:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759442.315937:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.315944:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00010000:00010000:0.0:1782759442.315952:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc1cbdc20) 00000100:00100000:3.0:1782759442.315953:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1782759442.315956:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1782759442.315960:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141279:x1869355211930240:12345-0@lo:104: 10000000:00010000:0.0:1782759442.315961:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.315973:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.315975:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.315987:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759442.315993:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316002:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.316003:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 18 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759442.316003:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759442.316021:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759442.316022:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759442.316027:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930496:0@lo:104: 00010000:00010000:0.0:1782759442.316028:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316032:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141279:x1869355211930240:12345-0@lo:104: Request processed in 75us (231us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759442.316044:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759442.316047:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316048:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:2.0:1782759442.316059:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65000/0xdd99f5c4777df20c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df213 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316070:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930368 00010000:00010000:0.0:1782759442.316070:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316071:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759442.316073:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782759442.316076:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930368 00010000:00010000:2.0:1782759442.316080:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316086:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64a00/0xdd99f5c4777df1fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df205 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316089:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759442.316092:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316095:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930496 00010000:00010000:3.0:1782759442.316099:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316101:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930496 00010000:00010000:2.0:1782759442.316103:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316122:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 10000000:00010000:2.0:1782759442.316123:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316123:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759442.316125:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 18 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316128:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759442.316132:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759442.316137:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930368:12345-0@lo:104: 10000000:01000000:2.0:1782759442.316141:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782759442.316146:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930880:0@lo:104: 00000100:00100000:0.0:1782759442.316151:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00010000:00010000:2.0:1782759442.316158:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316160:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316172:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759442.316176:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759442.316178:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930496:12345-0@lo:104: 00010000:00010000:2.0:1782759442.316187:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316189:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.316194:0:141279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316214:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1782759442.316216:0:141279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316216:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65e00/0xdd99f5c4777df1f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316225:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930368:12345-0@lo:104: Request processed in 91us (274us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759442.316240:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782759442.316243:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1782759442.316244:0:141279:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211931136:0@lo:104: 00010000:00010000:2.0:1782759442.316247:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316249:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759442.316260:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930880 00000100:00100000:0.0:1782759442.316260:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141279:x1869355211930496:12345-0@lo:104: Request processed in 98us (189us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759442.316261:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc1cbdc20) 00000100:00100000:1.0:1782759442.316265:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930880 10000000:00010000:2.0:1782759442.316268:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316277:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:2.0:1782759442.316280:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316281:0:141279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1782759442.316289:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759442.316293:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782759442.316300:0:141279:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759442.316300:0:139369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759442.316309:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00010000:00010000:2.0:1782759442.316311:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316317:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931136 00010000:00010000:2.0:1782759442.316320:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759442.316323:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1782759442.316323:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931136 00000100:00100000:3.0:1782759442.316325:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211929984:0@lo:104: 00010000:00010000:2.0:1782759442.316331:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316342:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930112:0@lo:104: 00010000:00010000:2.0:1782759442.316343:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98400/0xdd99f5c4777df1e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316343:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930880:12345-0@lo:104: 00000100:00100000:0.0:1782759442.316351:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1782759442.316356:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930240:0@lo:104: 00010000:00010000:1.0:1782759442.316359:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316366:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081256c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211931136:12345-0@lo:104: 00010000:00010000:2.0:1782759442.316367:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782759442.316373:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930368:0@lo:104: 00010000:00010000:2.0:1782759442.316380:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316381:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316387:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930496:0@lo:104: 00010000:00010000:1.0:1782759442.316400:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1782759442.316401:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65a00 already unused, calling callback (ffffffffc1cbdc20) 00000100:00100000:3.0:1782759442.316406:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211930880:0@lo:104: 10000000:00010000:2.0:1782759442.316407:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316410:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141279:x1869355211930880:12345-0@lo:104: Request processed in 75us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759442.316422:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316428:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 10000000:00010000:2.0:1782759442.316436:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759442.316443:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759442.316450:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759442.316456:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316463:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1782759442.316465:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:2.0:1782759442.316467:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759442.316471:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316472:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081256c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141279:x1869355211931136:12345-0@lo:104: Request processed in 108us (192us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759442.316483:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759442.316492:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211931136:0@lo:104: 00010000:00010000:2.0:1782759442.316493:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316493:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316500:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00010000:00010000:2.0:1782759442.316520:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65a00/0xdd99f5c4777df1d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1db expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759442.316530:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316536:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211930752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759442.316537:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1782759442.316540:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759442.316542:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316549:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759442.316552:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316565:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759442.316571:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316572:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316573:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211931264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.316577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1782759442.316589:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759442.316591:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759442.316601:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316609:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df1c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1cd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316612:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.316619:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211931520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759442.316624:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759442.316625:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759442.316629:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759442.316633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.316634:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759442.316635:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316646:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df1b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316647:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759442.316662:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211930624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759442.316664:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759442.316669:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759442.316674:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930752 00010000:00010000:2.0:1782759442.316675:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759442.316680:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930752 00000100:00100000:2.0:1782759442.316691:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211931008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.316699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.316707:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 19 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316709:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931264 00000100:00100000:0.0:1782759442.316717:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931264 00000100:00100000:3.0:1782759442.316726:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211931392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759442.316729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759442.316739:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 20 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316743:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211930624 00000100:00100000:1.0:1782759442.316748:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211930624 00000100:00100000:2.0:1782759442.316754:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211931648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759442.316761:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931008 00000100:00100000:3.0:1782759442.316764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.316767:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 21 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.316768:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931008 00000100:00100000:2.0:1782759442.316781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759442.316788:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 22 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.316789:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931392 00000100:00100000:1.0:1782759442.316793:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931392 00000100:00100000:3.0:1782759442.316804:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931648 00000100:00100000:3.0:1782759442.316810:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931648 00000100:00100000:0.0:1782759442.316814:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00010000:00010000:1.0:1782759442.316817:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 24 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759442.316850:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1782759442.316868:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3305:x1869355211931264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759442.316870:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1782759442.316880:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3307:x1869355211930752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759442.316884:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782759442.316885:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3306:x1869355211930624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759442.316892:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759442.316896:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759442.316899:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 24 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316900:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 24 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316904:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 24 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316923:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 24 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316936:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 24 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316948:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 24 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316966:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030e00/0xdd99f5c4777df205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1fe expref: 24 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.316971:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df1e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1e2 expref: 24 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.316976:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777df213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df20c expref: 24 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.316982:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759442.316992:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759442.316995:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759442.317025:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3307:x1869355211930752:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759442.317033:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1782759442.317045:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3305:x1869355211931264:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759442.317047:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355211930624:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759442.317054:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1782759442.317061:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1782759442.317081:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1782759442.317095:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1782759442.317099:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211931008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759442.317108:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211931392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759442.317110:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759442.317119:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.317121:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759442.317128:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 18 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.317132:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211930624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759442.317147:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.317160:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 18 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.317175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759442.317175:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df1f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1f0 expref: 18 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.317181:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777df1db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1d4 expref: 18 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.317195:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759442.317200:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759442.317218:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211930752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759442.317238:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3308:x1869355211931008:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759442.317246:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3306:x1869355211931392:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759442.317247:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1782759442.317259:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1782759442.317260:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211931392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759442.317270:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931520 00000100:00100000:0.0:1782759442.317275:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931520 00010000:00010000:3.0:1782759442.317284:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 15 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.317292:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 15 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.317309:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211931264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.317315:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1782759442.317322:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1782759442.317327:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3308:x1869355211931648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759442.317334:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3307:x1869355211931520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.317338:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759442.317344:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.317345:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 15 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.317353:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 15 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.317357:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211931008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.317359:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 15 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.317377:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 15 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759442.317392:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211929728:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759442.317397:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030200/0xdd99f5c4777df1bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1b8 expref: 15 pid: 5794 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.317401:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df1cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df1c6 expref: 15 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.317417:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759442.317419:0:141279:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141279:1869355211929856:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759442.317421:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.317461:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3308:x1869355211931648:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759442.317469:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3307:x1869355211931520:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.317470:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00010000:00010000:2.0:1782759442.317472:0:141279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.317490:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1782759442.317495:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211931648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759442.317546:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211931520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.318200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759442.318322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759442.318368:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248128 00000100:00100000:2.0:1782759442.318373:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248128 00000100:00100000:1.0:1782759442.318388:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248256 00000100:00100000:1.0:1782759442.318394:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248256 00010000:00010000:2.0:1782759442.318395:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 10 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.318415:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 11 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.318443:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 610 00000100:00100000:1.0:1782759442.318452:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197248128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759442.318465:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759442.318467:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 611 00010000:00010000:1.0:1782759442.318472:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 11 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.318482:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2362:x1869355197248256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759442.318485:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 11 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318494:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759442.318503:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 11 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.318504:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98000/0xdd99f5c4777df221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d9f expref: 11 pid: 5793 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318533:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 10 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318576:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df21a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d98 expref: 10 pid: 5796 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318588:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.318593:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759442.318596:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318612:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318620:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318627:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318643:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318650:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759442.318653:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318661:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.318667:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2361:x1869355197248128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 215us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759442.318677:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 610 00010000:00010000:0.0:1782759442.318686:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.318699:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759442.318714:0:141279:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.318724:0:141279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.318725:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2362:x1869355197248256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 247us (402us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759442.318740:0:141279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df2d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.318741:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 611 00010000:00010000:1.0:1782759443.052225:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759443.124977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759443.125016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759443.125053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759443.125119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759443.125119:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248640 00000100:00100000:1.0:1782759443.125138:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248640 00000100:00100000:3.0:1782759443.125194:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248384 00000100:00100000:3.0:1782759443.125199:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248384 00000100:00100000:1.0:1782759443.125204:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248768 00000100:00100000:1.0:1782759443.125209:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248768 00000100:00100000:3.0:1782759443.125234:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2706 00000100:00100000:3.0:1782759443.125243:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2361:x1869355197248384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759443.125303:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2361:x1869355197248384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 61us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.125310:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2706 00000100:00100000:3.0:1782759443.125344:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1968 00000100:00100000:3.0:1782759443.125353:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197248640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759443.125365:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00100000:1.0:1782759443.125377:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197248768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759443.125383:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197248640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.125391:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1968 00000100:00100000:1.0:1782759443.125433:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197248768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.125441:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00080000:2.0:1782759443.125549:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759443.125554:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759443.125618:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248512 00000100:00100000:0.0:1782759443.125624:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248512 00000100:00100000:0.0:1782759443.125676:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2515 00000100:00100000:0.0:1782759443.125688:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197248512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759443.125725:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197248512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.125732:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2515 00000100:00080000:2.0:1782759443.125841:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1782759443.691885:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759443.691893:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 48 10000000:01000000:1.0:1782759443.691899:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759443.691947:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.691955:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.691963:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759443.691986:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211931776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.692046:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.692111:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759443.692194:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931776 00000100:00100000:0.0:1782759443.692201:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931776 00000100:00100000:0.0:1782759443.692302:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1782759443.692311:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355211931776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759443.692334:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759443.692345:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df2de expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.692363:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.692369:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.692376:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759443.692412:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211931776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.692417:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:1.0:1782759443.692458:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211931776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759443.692473:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.692496:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759443.692549:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211931904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.692578:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.692603:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759443.692635:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211931904 00000100:00100000:3.0:1782759443.692640:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211931904 00000100:00100000:3.0:1782759443.692667:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:3.0:1782759443.692674:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211931904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.692948:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211931904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.692955:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:1.0:1782759443.693080:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211931904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.693109:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.693144:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.693172:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759443.693220:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932032 00000100:00100000:0.0:1782759443.693224:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932032 00000100:00100000:0.0:1782759443.693251:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1782759443.693257:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211932032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.693391:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211932032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.693399:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:1.0:1782759443.693425:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.693788:0:141282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141282:1869355211932160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.693838:0:141282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.693858:0:141282:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759443.693882:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932160 00000100:00100000:3.0:1782759443.693887:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932160 00000100:00100000:3.0:1782759443.693912:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:3.0:1782759443.693919:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141282:x1869355211932160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759443.694090:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141282:x1869355211932160:12345-0@lo:502:llog_process_th.0 Request processed in 170us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.694107:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1782759443.694136:0:141282:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141282:1869355211932160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.694177:0:141282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141282:1869355211932288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.694217:0:141282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.694235:0:141282:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759443.694260:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932288 00000100:00100000:0.0:1782759443.694269:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932288 00000100:00100000:0.0:1782759443.694293:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1782759443.694300:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141282:x1869355211932288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759443.694393:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141282:x1869355211932288:12345-0@lo:502:llog_process_th.0 Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.694405:0:141282:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141282:1869355211932288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759443.694406:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000040:00080000:1.0:1782759443.694431:0:141282:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1782759443.694521:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1782759443.694541:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759443.694548:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.694558:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759443.694566:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759443.694568:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1782759443.694571:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759443.694590:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.694596:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.694604:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.694615:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.694653:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.694670:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.694694:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932416 00000100:00100000:1.0:1782759443.694699:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932416 00000100:00100000:1.0:1782759443.694727:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:1.0:1782759443.694736:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211932416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759443.694745:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759443.694756:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df2ec expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.694774:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.694795:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.694803:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030800, rc 0) 00000100:00100000:1.0:1782759443.694887:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211932416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.694895:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1782759443.694915:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759443.694929:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.694946:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.694984:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.695009:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.695111:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759443.695197:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932544 00000100:00100000:0.0:1782759443.695201:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932544 00000100:00100000:0.0:1782759443.695228:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:0.0:1782759443.695234:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211932544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.695405:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211932544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.695410:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:3.0:1782759443.695530:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.695563:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.695598:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.695619:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.695636:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932672 00000100:00100000:1.0:1782759443.695641:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932672 00000100:00100000:1.0:1782759443.695671:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1782759443.695679:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211932672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.695801:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211932672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.695808:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:3.0:1782759443.695862:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759443.696667:0:141283:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1782759443.696882:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1782759443.696903:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782759443.696911:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.696921:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759443.696930:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759443.696932:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 48 10000000:01000000:3.0:1782759443.696935:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759443.696956:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.696964:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.696981:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.696997:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.697033:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.697120:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759443.697158:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932800 00000100:00100000:0.0:1782759443.697163:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932800 00000100:00100000:0.0:1782759443.697194:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:0.0:1782759443.697206:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211932800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759443.697215:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759443.697225:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df2fa expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.697243:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.697252:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.697259:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99200, rc 0) 00000100:00100000:0.0:1782759443.697294:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211932800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.697300:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:3.0:1782759443.697378:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759443.697387:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.697393:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.697424:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.697444:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.697461:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.697494:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211932928 00000100:00100000:1.0:1782759443.697499:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211932928 00000100:00100000:1.0:1782759443.697521:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1782759443.697528:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211932928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.697721:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211932928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.697729:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:3.0:1782759443.697787:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211932928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.697817:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.697878:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.697906:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759443.698032:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933056 00000100:00100000:0.0:1782759443.698041:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933056 00000100:00100000:0.0:1782759443.698069:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1782759443.698076:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211933056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.698203:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211933056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.698210:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:3.0:1782759443.698239:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.698497:0:141284:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141284:1869355211933184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759443.698530:0:141284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.698548:0:141284:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.698572:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933184 00000100:00100000:1.0:1782759443.698577:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933184 00000100:00100000:1.0:1782759443.698602:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1782759443.698609:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141284:x1869355211933184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.698776:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141284:x1869355211933184:12345-0@lo:502:llog_process_th.0 Request processed in 168us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.698783:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:0.0:1782759443.698806:0:141284:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141284:1869355211933184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759443.698867:0:141284:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141284:1869355211933312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759443.698913:0:141284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.698937:0:141284:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759443.698955:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933312 00000100:00100000:2.0:1782759443.698960:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933312 00000100:00100000:2.0:1782759443.698987:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:2.0:1782759443.698994:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141284:x1869355211933312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759443.699106:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141284:x1869355211933312:12345-0@lo:502:llog_process_th.0 Request processed in 112us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.699119:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:0.0:1782759443.699139:0:141284:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141284:1869355211933312:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759443.699169:0:141284:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1782759443.699242:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1782759443.699267:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759443.699275:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.699290:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759443.699298:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782759443.699300:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1782759443.699303:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759443.699320:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.699327:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.699334:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.699346:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.699373:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.699397:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.699443:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933440 00000100:00100000:1.0:1782759443.699447:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933440 00000100:00100000:1.0:1782759443.699518:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1782759443.699526:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211933440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759443.699533:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759443.699543:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df308 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.699558:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.699567:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.699574:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759443.699615:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211933440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.699621:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:0.0:1782759443.699676:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759443.699687:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759443.699695:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759443.699730:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.699751:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.699896:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759443.700002:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933568 00000100:00100000:3.0:1782759443.700007:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933568 00000100:00100000:3.0:1782759443.700025:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:3.0:1782759443.700031:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211933568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.700268:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211933568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.700274:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:0.0:1782759443.700430:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.700453:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759443.700497:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.700514:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759443.700547:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933696 00000100:00100000:3.0:1782759443.700552:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933696 00000100:00100000:3.0:1782759443.700580:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:3.0:1782759443.700595:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211933696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.700728:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211933696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.700735:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1782759443.700760:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759443.701888:0:141285:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:3.0:1782759443.701956:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1782759443.701977:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759443.701985:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.701996:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759443.702004:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759443.702007:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 48 10000000:01000000:3.0:1782759443.702010:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759443.702031:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.702038:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.702047:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.702061:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.702091:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.702169:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759443.702208:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933824 00000100:00100000:2.0:1782759443.702213:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933824 00000100:00100000:2.0:1782759443.702245:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:2.0:1782759443.702252:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211933824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759443.702262:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759443.702273:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df316 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.702296:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.702306:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.702313:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65200, rc 0) 00000100:00100000:2.0:1782759443.702350:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211933824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.702356:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:3.0:1782759443.702388:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759443.702420:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.702430:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.702471:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.702511:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.702530:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.702549:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211933952 00000100:00100000:1.0:1782759443.702555:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211933952 00000100:00100000:1.0:1782759443.702584:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:1.0:1782759443.702592:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211933952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.702812:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211933952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.702848:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1782759443.702878:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211933952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.702903:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.702938:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.702963:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759443.702989:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934080 00000100:00100000:2.0:1782759443.702994:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934080 00000100:00100000:2.0:1782759443.703022:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:2.0:1782759443.703029:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211934080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759443.703165:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211934080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.703172:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:3.0:1782759443.703210:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.703468:0:141286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141286:1869355211934208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.703513:0:141286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.703531:0:141286:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759443.703539:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934208 00000100:00100000:3.0:1782759443.703543:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934208 00000100:00100000:3.0:1782759443.703570:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:3.0:1782759443.703576:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141286:x1869355211934208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759443.703761:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141286:x1869355211934208:12345-0@lo:502:llog_process_th.0 Request processed in 181us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.703768:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1782759443.703789:0:141286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141286:1869355211934208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.703852:0:141286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141286:1869355211934336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.703890:0:141286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.703914:0:141286:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759443.703934:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934336 00000100:00100000:2.0:1782759443.703944:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934336 00000100:00100000:2.0:1782759443.703972:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:2.0:1782759443.703978:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141286:x1869355211934336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759443.704091:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141286:x1869355211934336:12345-0@lo:502:llog_process_th.0 Request processed in 112us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.704098:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1782759443.704122:0:141286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141286:1869355211934336:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759443.704146:0:141286:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1782759443.704222:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1782759443.704246:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759443.704254:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.704274:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759443.704282:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759443.704283:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1782759443.704294:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759443.704311:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.704322:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.704329:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.704341:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.704367:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.704383:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.704400:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934464 00000100:00100000:1.0:1782759443.704405:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934464 00000100:00100000:1.0:1782759443.704432:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1782759443.704439:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211934464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759443.704447:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759443.704457:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df324 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.704472:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.704492:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.704500:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031800, rc 0) 00000100:00100000:1.0:1782759443.704530:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211934464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.704543:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1782759443.704554:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759443.704564:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.704571:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759443.704596:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.704612:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.704635:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759443.704681:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934592 00000100:00100000:2.0:1782759443.704685:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934592 00000100:00100000:2.0:1782759443.704750:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1782759443.704757:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211934592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759443.704947:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211934592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.704952:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1782759443.705047:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759443.705067:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759443.705098:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759443.705123:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.705132:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934720 00000100:00100000:1.0:1782759443.705138:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934720 00000100:00100000:1.0:1782759443.705165:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:1.0:1782759443.705172:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211934720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.705288:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211934720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.705295:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1782759443.705321:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211934720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.705576:0:141287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141287:1869355211934848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.705610:0:141287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.705629:0:141287:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759443.705729:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934848 00000100:00100000:2.0:1782759443.705740:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934848 00000100:00100000:2.0:1782759443.705797:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1782759443.705807:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141287:x1869355211934848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759443.706152:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141287:x1869355211934848:12345-0@lo:502:llog_process_th.0 Request processed in 345us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.706164:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1782759443.706185:0:141287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141287:1869355211934848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759443.706227:0:141287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759443.706239:0:141287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759443.706242:0:141287:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre-MDT0000-m rem lustre.pool64c.lustre-OST0000_UUID 00000020:00000080:1.0:1782759443.706250:0:141287:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1782759443.706263:0:141287:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from pool64c 00000020:01000004:1.0:1782759443.706767:0:141288:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9171932e8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782759443.706772:0:141288:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9171932e8800 4 00000100:00100000:3.0:1782759443.706796:0:141287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141287:1869355211934976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759443.706884:0:141287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.706910:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211934976 00000100:00100000:3.0:1782759443.706914:0:141287:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.706916:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211934976 00000100:00100000:1.0:1782759443.706944:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:1.0:1782759443.706950:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141287:x1869355211934976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759443.707146:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141287:x1869355211934976:12345-0@lo:502:llog_process_th.0 Request processed in 195us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.707153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1782759443.707280:0:141287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141287:1869355211934976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759443.707299:0:141287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759443.707303:0:141287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759443.707305:0:141287:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre-MDT0000-m rem lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:3.0:1782759443.707308:0:141287:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1782759443.707370:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1782759443.707399:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782759443.707410:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.707419:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759443.707430:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782759443.707432:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759443.707435:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782759443.707455:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.707461:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.707467:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759443.707476:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211935104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759443.707512:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759443.707527:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759443.707547:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211935104 00000100:00100000:3.0:1782759443.707551:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211935104 00000100:00100000:3.0:1782759443.707582:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:3.0:1782759443.707586:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211935104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759443.707592:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759443.707601:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df332 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.707617:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.707624:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.707629:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc400, rc 0) 00000100:00100000:3.0:1782759443.707656:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211935104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.707660:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1782759443.707689:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211935104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759443.707703:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.707712:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759443.707763:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211935232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759443.707796:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759443.707813:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759443.707893:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211935232 00000100:00100000:1.0:1782759443.707898:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211935232 00000100:00100000:1.0:1782759443.707924:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1782759443.707932:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211935232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.708084:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211935232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (285us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759443.708091:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:2.0:1782759443.708097:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211935232:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782759443.708117:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782759443.708121:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759443.708127:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759443.956322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759443.956453:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197248896 00000100:00100000:3.0:1782759443.956507:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197248896 00000100:00100000:3.0:1782759443.956621:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2735 00000100:00100000:3.0:1782759443.956632:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197248896:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759443.956656:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759443.956681:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66da6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.956735:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.956753:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759443.956766:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759443.956911:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197248896:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 280us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.956919:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2735 00000100:00100000:3.0:1782759443.958336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759443.958399:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249024 00000100:00100000:1.0:1782759443.958410:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249024 00000100:00100000:1.0:1782759443.958472:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2736 00000100:00100000:1.0:1782759443.958494:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197249024:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759443.958880:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197249024:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 383us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.958888:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2736 00000100:00100000:0.0:1782759443.960447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759443.960543:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249152 00000100:00100000:3.0:1782759443.960551:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249152 00000100:00100000:3.0:1782759443.960593:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2737 00000100:00100000:3.0:1782759443.960603:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197249152:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.960971:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197249152:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 369us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.960980:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2737 00000100:00100000:2.0:1782759443.962763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759443.962934:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249280 00000100:00100000:1.0:1782759443.962943:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249280 00000100:00100000:1.0:1782759443.963004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2738 00000100:00100000:1.0:1782759443.963015:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99010:x1869355197249280:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759443.963291:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99010:x1869355197249280:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 277us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.963299:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2738 00000100:00100000:1.0:1782759443.967064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759443.967127:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249408 00000100:00100000:3.0:1782759443.967137:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249408 00000100:00100000:3.0:1782759443.967199:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2739 00000100:00100000:3.0:1782759443.967209:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99010:x1869355197249408:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759443.967417:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99010:x1869355197249408:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 208us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.967426:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2739 00000100:00100000:0.0:1782759443.969600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759443.969671:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249536 00000100:00100000:1.0:1782759443.969680:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249536 00000100:00100000:1.0:1782759443.969730:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2740 00000100:00100000:1.0:1782759443.969738:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197249536:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759443.969764:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759443.969781:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dad expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.969808:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.969845:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759443.969856:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031a00, rc 0) 00000100:00100000:1.0:1782759443.969932:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197249536:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 193us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.969940:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2740 00000100:00100000:2.0:1782759443.971524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759443.971575:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249664 00000100:00100000:3.0:1782759443.971584:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249664 00000100:00100000:3.0:1782759443.971624:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2741 00000100:00100000:3.0:1782759443.971632:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197249664:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759443.972059:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197249664:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 426us (539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759443.972067:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2741 00010000:00010000:1.0:1782759444.076043:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759444.395966:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211935360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759444.396041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.396117:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211935360 00000100:00100000:3.0:1782759444.396133:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211935360 00000100:00080000:1.0:1782759444.396195:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759444.396311:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1782759444.396332:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211935360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759444.396384:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759444.396512:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211935360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.396521:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1782759444.396541:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211935360:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759445.009443:0:141386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd087547a0 20000000:00000080:0.0:1782759445.009473:0:141386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff917082be2400 uarg=0000000000000000 00000040:00100000:0.0:1782759445.010371:0:141386:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 20000000:01000000:0.0:1782759445.010378:0:141386:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 50 cmd:0xce022 lustre.pool64c lustre-OST0000_UUID 20000000:01000000:0.0:1782759445.010392:0:141386:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool64c fl=4 20000000:01000000:0.0:1782759445.010987:0:141387:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 42 marker 28 1->4: lustre-clilov new lustre.pool64c 20000000:01000000:0.0:1782759445.011080:0:141387:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 44 marker 28 2->4: lustre-clilov new lustre.pool64c 00000040:00080000:0.0:1782759445.011130:0:141387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000040:00080000:2.0:1782759445.011412:0:141386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17184 20000000:01000000:2.0:1782759445.011432:0:141386:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool64c (null) (null) 00000040:00080000:2.0:1782759445.011490:0:141386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 104 off17288 00000040:00080000:2.0:1782759445.011565:0:141386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 20000000:01000000:2.0:1782759445.011592:0:141386:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool64c fl=4 20000000:01000000:0.0:1782759445.012080:0:141388:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 37 marker 29 1->4: lustre-MDT0000-mdtlov new lustre.pool64c 20000000:01000000:0.0:1782759445.012121:0:141388:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 39 marker 29 2->4: lustre-MDT0000-mdtlov new lustre.pool64c 00000040:00080000:0.0:1782759445.012180:0:141388:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000040:00080000:2.0:1782759445.012477:0:141386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16608 20000000:01000000:2.0:1782759445.012491:0:141386:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool64c (null) (null) 00000040:00080000:2.0:1782759445.012525:0:141386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].48, 112 off16720 00000040:00080000:2.0:1782759445.012579:0:141386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16944 10000000:01000000:2.0:1782759445.012594:0:141386:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782759445.012615:0:141386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012646:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012654:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012661:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012668:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012675:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012681:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012688:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012698:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012706:0:141386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012714:0:141386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012762:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012779:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 9 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.012795:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935488:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759445.012949:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.012959:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 9 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.012969:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935616:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759445.013003:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.013012:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.013021:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935744:0@lo:104: 00000100:00100000:2.0:1782759445.013060:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759445.013100:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.013109:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 18 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.013113:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211935744 00000100:00100000:1.0:1782759445.013121:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211935744 00000100:00100000:2.0:1782759445.013133:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935872:0@lo:104: 00000100:00100000:2.0:1782759445.013158:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759445.013186:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013192:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211935872 00010000:00010000:2.0:1782759445.013196:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013205:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211935872 00000100:00100000:2.0:1782759445.013207:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936000:0@lo:104: 00000100:00100000:1.0:1782759445.013222:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1782759445.013235:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211935744:12345-0@lo:104: 00000100:00100000:2.0:1782759445.013243:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759445.013253:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936000 00010000:00010000:1.0:1782759445.013258:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013259:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936000 00010000:00010000:2.0:1782759445.013267:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013281:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00010000:00010000:2.0:1782759445.013285:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013294:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:141386:x1869355211935872:12345-0@lo:104: 00000100:00100000:2.0:1782759445.013297:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936128:0@lo:104: 00010000:00010000:0.0:1782759445.013305:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013331:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759445.013343:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.013348:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:141386:x1869355211935744:12345-0@lo:104: Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.013358:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:0.0:1782759445.013373:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1782759445.013374:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.013381:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936128 00000100:00100000:0.0:1782759445.013385:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211935872:12345-0@lo:104: Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.013389:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936128 00010000:00010000:2.0:1782759445.013390:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013400:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1782759445.013407:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936256:0@lo:104: 00000100:00100000:1.0:1782759445.013416:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1782759445.013427:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1782759445.013428:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936000:12345-0@lo:104: 00000100:00100000:2.0:1782759445.013436:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759445.013440:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.013441:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936128:12345-0@lo:104: 00010000:00010000:0.0:1782759445.013470:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.013475:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013499:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1782759445.013501:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.013511:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936000:12345-0@lo:104: Request processed in 85us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759445.013516:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782759445.013518:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936384:0@lo:104: 00000100:00100000:1.0:1782759445.013523:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1782759445.013527:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936128:12345-0@lo:104: Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759445.013537:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1782759445.013541:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936256 00000100:00100000:1.0:1782759445.013546:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936256 00000100:00100000:2.0:1782759445.013556:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.013579:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936384 00010000:00010000:0.0:1782759445.013580:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1782759445.013583:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936384 00010000:00010000:0.0:1782759445.013588:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.013591:0:141386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.013604:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00010000:00010000:0.0:1782759445.013608:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759445.013614:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.013616:0:141386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.013618:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936256:12345-0@lo:104: 00010000:00010000:1.0:1782759445.013632:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.013640:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.013645:0:141386:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936512:0@lo:104: 10000000:00010000:0.0:1782759445.013657:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759445.013664:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759445.013673:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782759445.013681:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936256:12345-0@lo:104: Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.013691:0:141386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.013694:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1782759445.013710:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936512 00010000:00010000:0.0:1782759445.013713:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.013714:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936512 00010000:00010000:0.0:1782759445.013721:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759445.013727:0:141386:0:(client.c:2701:ptlrpc_set_wait()) set ffff917089191240 going to sleep for 11 seconds 00010000:00010000:0.0:1782759445.013746:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.013748:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1782759445.013756:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935744:0@lo:104: 00000100:00100000:1.0:1782759445.013759:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00010000:00010000:0.0:1782759445.013759:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64e00/0xdd99f5c4777df332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df339 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.013766:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936384:12345-0@lo:104: 00000100:00100000:2.0:1782759445.013772:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935872:0@lo:104: 00000100:00100000:1.0:1782759445.013775:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917191997050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936512:12345-0@lo:104: 00010000:00010000:0.0:1782759445.013779:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782759445.013784:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013787:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.013788:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936000:0@lo:104: 00000100:00100000:2.0:1782759445.013803:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936128:0@lo:104: 00010000:00010000:0.0:1782759445.013803:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759445.013810:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.013818:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.013819:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936256:0@lo:104: 10000000:00010000:0.0:1782759445.013853:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013861:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:0.0:1782759445.013862:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1782759445.013871:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917191997050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:141386:x1869355211936512:12345-0@lo:104: Request processed in 100us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.013879:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00010000:00010000:0.0:1782759445.013887:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.013894:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759445.013904:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936512:0@lo:104: 00010000:00010000:1.0:1782759445.013904:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782759445.013913:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.013914:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013930:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759445.013935:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013942:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.013946:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211936768:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1782759445.013958:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.013962:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777df324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df32b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759445.013968:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759445.013982:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1782759445.013985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759445.013988:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.013997:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.013997:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759445.014001:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014009:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759445.014014:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014022:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759445.014023:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014029:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211936640:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1782759445.014042:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759445.014053:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777df316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df31d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014061:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014066:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782759445.014067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759445.014073:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759445.014074:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014083:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014085:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759445.014091:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014093:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df30f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014099:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782759445.014103:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014109:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211937024:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1782759445.014124:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014129:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1782759445.014130:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759445.014139:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759445.014143:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014151:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014160:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759445.014166:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014170:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759445.014174:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936768 00010000:00010000:0.0:1782759445.014176:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014181:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936768 10000000:00010000:0.0:1782759445.014183:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014184:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759445.014200:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759445.014201:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777df2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df301 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.014209:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 19 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.014210:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1782759445.014215:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782759445.014228:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141386:x1869355211936384:12345-0@lo:104: Request processed in 466us (669us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759445.014228:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014228:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014232:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936640 00000100:00100000:2.0:1782759445.014238:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936640 00010000:00010000:1.0:1782759445.014248:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:0.0:1782759445.014248:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759445.014254:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 10000000:00010000:1.0:1782759445.014254:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.014256:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 20 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014258:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014276:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014280:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030c00/0xdd99f5c4777df2de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2e5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014291:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937024 10000000:00010000:1.0:1782759445.014292:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014295:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937024 00010000:00010000:0.0:1782759445.014296:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759445.014300:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759445.014303:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759445.014304:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759445.014310:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 21 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.014319:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00010000:00010000:1.0:1782759445.014326:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.014328:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3307:x1869355211936768:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759445.014339:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00010000:00010000:1.0:1782759445.014341:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759445.014343:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759445.014350:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014353:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3306:x1869355211936640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759445.014357:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 21 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014362:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df2ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2f3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.014370:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759445.014377:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 21 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.014380:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 21 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.014382:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00010000:00010000:1.0:1782759445.014387:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759445.014392:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759445.014396:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759445.014398:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3306:x1869355211937024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759445.014401:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031800/0xdd99f5c4777df32b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df324 expref: 21 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.014403:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 21 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014406:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759445.014413:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782759445.014417:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1782759445.014425:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 20 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014428:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759445.014433:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211937152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759445.014435:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777df339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df332 expref: 20 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.014446:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 20 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.014466:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759445.014473:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777df30f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df308 expref: 19 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.014478:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211936768:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (491us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759445.014487:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759445.014492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759445.014492:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1782759445.014509:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3306:x1869355211936640:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759445.014513:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937152 00000100:00100000:2.0:1782759445.014519:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1782759445.014520:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937152 00000100:00100000:3.0:1782759445.014533:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3306:x1869355211937024:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.014537:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211936896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759445.014540:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 17 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.014551:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1782759445.014551:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211937280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759445.014579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759445.014600:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211936384:0@lo:104: 00000100:00100000:1.0:1782759445.014608:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211937408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759445.014627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.014653:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211936896 00000100:00100000:1.0:1782759445.014657:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211936896 00000100:00100000:0.0:1782759445.014673:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937408 00010000:00010000:1.0:1782759445.014679:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 17 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759445.014679:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937408 00000100:00100000:3.0:1782759445.014685:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1782759445.014699:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211937152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759445.014701:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.014711:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782759445.014711:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00010000:00010000:3.0:1782759445.014721:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.014728:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211936896:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759445.014732:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1782759445.014734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1782759445.014745:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759445.014748:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211937408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759445.014753:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014759:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759445.014765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782759445.014769:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.014783:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014793:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935488:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759445.014797:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.014806:0:141386:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141386:1869355211935616:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759445.014810:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.014863:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df2fa expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014869:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df31d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df316 expref: 18 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.014875:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030800/0xdd99f5c4777df2f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df2ec expref: 18 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.014898:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759445.014900:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759445.014902:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759445.014950:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3308:x1869355211936896:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759445.014956:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3308:x1869355211937408:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.014959:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3305:x1869355211937152:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.014965:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1782759445.014975:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1782759445.014981:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1782759445.014987:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249792 00000100:00100000:1.0:1782759445.014992:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249792 00000100:00100000:0.0:1782759445.014998:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197249920 00000100:00100000:0.0:1782759445.015004:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197249920 00010000:00010000:1.0:1782759445.015012:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 11 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.015025:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211937152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759445.015028:0:141386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.015030:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 11 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.015063:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 618 00000100:00100000:0.0:1782759445.015072:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 619 00000100:00100000:1.0:1782759445.015076:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197249792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782759445.015086:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197249920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759445.015087:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759445.015097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759445.015097:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 11 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759445.015099:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759445.015108:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 11 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.015117:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 11 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.015125:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211936768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759445.015142:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 11 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.015154:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211937024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759445.015160:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031a00/0xdd99f5c4777df347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dad expref: 11 pid: 5794 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.015165:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937280 00000100:00100000:2.0:1782759445.015166:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211936640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759445.015166:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66da6 expref: 11 pid: 5793 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.015176:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937280 00010000:00010000:1.0:1782759445.015185:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759445.015189:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759445.015198:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 13 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.015227:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211936896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.015228:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1782759445.015237:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2361:x1869355197249920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 151us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.015238:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2361:x1869355197249792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 161us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.015244:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3307:x1869355211937280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759445.015246:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211937408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759445.015257:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 619 00010000:00010000:3.0:1782759445.015262:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.015270:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 13 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.015273:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 618 00010000:00010000:3.0:1782759445.015288:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 13 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015300:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98200/0xdd99f5c4777df2e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df2de expref: 13 pid: 5796 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015312:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015321:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015346:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015352:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015356:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015361:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015364:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759445.015367:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015371:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015381:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.015388:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759445.015397:0:141386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.015406:0:141386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.015413:0:141386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df34e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.015416:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:3307:x1869355211937280:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759445.015452:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211937280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.015480:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00010000:00010000:0.0:1782759445.100002:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759445.379952:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759445.379961:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 52 10000000:01000000:1.0:1782759445.379966:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759445.380009:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.380018:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.380026:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.380067:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211937536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.380159:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.380225:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937536 00000100:00100000:1.0:1782759445.380227:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.380233:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937536 00000100:00100000:3.0:1782759445.380295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:3.0:1782759445.380306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355211937536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.380327:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759445.380339:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df355 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.380363:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.380375:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.380383:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759445.380433:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211937536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.380441:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1782759445.380473:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211937536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759445.380489:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.380498:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.380552:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211937664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.380570:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.380586:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.380617:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937664 00000100:00100000:3.0:1782759445.380622:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937664 00000100:00100000:3.0:1782759445.380651:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1782759445.380658:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211937664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.380954:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211937664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.380962:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:1.0:1782759445.380986:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211937664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.381017:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211937792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.381056:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.381079:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.381097:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937792 00000100:00100000:3.0:1782759445.381102:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937792 00000100:00100000:3.0:1782759445.381127:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1782759445.381133:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211937792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.381286:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211937792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.381303:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:1.0:1782759445.381382:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211937792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.381765:0:141389:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141389:1869355211937920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.381801:0:141389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.381851:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211937920 00000100:00100000:1.0:1782759445.381854:0:141389:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.381857:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211937920 00000100:00100000:3.0:1782759445.381898:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:3.0:1782759445.381904:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141389:x1869355211937920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759445.382072:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141389:x1869355211937920:12345-0@lo:502:llog_process_th.0 Request processed in 168us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.382080:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1782759445.382108:0:141389:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141389:1869355211937920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.382150:0:141389:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141389:1869355211938048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.382182:0:141389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.382200:0:141389:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.382221:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938048 00000100:00100000:3.0:1782759445.382226:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938048 00000100:00100000:3.0:1782759445.382256:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:3.0:1782759445.382262:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141389:x1869355211938048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759445.382362:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:141389:x1869355211938048:12345-0@lo:502:llog_process_th.0 Request processed in 100us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.382371:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:1.0:1782759445.382388:0:141389:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141389:1869355211938048:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759445.382409:0:141389:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1782759445.382505:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1782759445.382534:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759445.382544:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.382554:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.382563:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759445.382565:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1782759445.382568:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759445.382591:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.382605:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.382614:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.382628:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.382657:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.382678:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.382747:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938176 00000100:00100000:1.0:1782759445.382752:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938176 00000100:00100000:1.0:1782759445.382779:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:1.0:1782759445.382787:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355211938176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759445.382795:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759445.382803:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df363 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.382819:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.382861:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.382870:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030a00, rc 0) 00000100:00100000:1.0:1782759445.382902:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211938176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.382906:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:3.0:1782759445.382937:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.382950:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.382958:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.382996:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.383020:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.383042:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.383069:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938304 00000100:00100000:2.0:1782759445.383074:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938304 00000100:00100000:2.0:1782759445.383104:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:2.0:1782759445.383113:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211938304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.383361:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211938304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.383366:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:3.0:1782759445.383414:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.383440:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.383541:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.383560:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.383585:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938432 00000100:00100000:1.0:1782759445.383590:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938432 00000100:00100000:1.0:1782759445.383618:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:1.0:1782759445.383625:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211938432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.383759:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211938432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.383777:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:3.0:1782759445.383778:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759445.384422:0:141390:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1782759445.384524:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1782759445.384556:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782759445.384564:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.384578:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.384586:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759445.384588:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 52 10000000:01000000:3.0:1782759445.384591:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759445.384610:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.384617:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.384625:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.384638:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.384670:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.384697:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.384726:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938560 00000100:00100000:2.0:1782759445.384731:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938560 00000100:00100000:2.0:1782759445.384759:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:2.0:1782759445.384776:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355211938560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759445.384785:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759445.384794:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df371 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.384811:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.384852:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.384862:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65000, rc 0) 00000100:00100000:2.0:1782759445.384899:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211938560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.384906:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:3.0:1782759445.384935:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.384946:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.384954:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.384997:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.385029:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.385051:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.385060:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938688 00000100:00100000:1.0:1782759445.385063:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938688 00000100:00100000:1.0:1782759445.385087:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:1.0:1782759445.385094:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211938688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.385271:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211938688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.385278:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:3.0:1782759445.385285:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.385309:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.385339:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.385357:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.385379:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938816 00000100:00100000:2.0:1782759445.385384:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938816 00000100:00100000:2.0:1782759445.385407:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:2.0:1782759445.385412:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211938816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.385528:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211938816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.385535:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:3.0:1782759445.385560:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211938816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.385776:0:141391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141391:1869355211938944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.385803:0:141391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.385816:0:141391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.385842:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211938944 00000100:00100000:3.0:1782759445.385847:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211938944 00000100:00100000:3.0:1782759445.385872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:3.0:1782759445.385880:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141391:x1869355211938944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759445.386061:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141391:x1869355211938944:12345-0@lo:502:llog_process_th.0 Request processed in 181us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.386070:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:1.0:1782759445.386086:0:141391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141391:1869355211938944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.386143:0:141391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141391:1869355211939072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.386174:0:141391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.386202:0:141391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.386230:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939072 00000100:00100000:2.0:1782759445.386236:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939072 00000100:00100000:2.0:1782759445.386262:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1782759445.386270:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141391:x1869355211939072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759445.386386:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:141391:x1869355211939072:12345-0@lo:502:llog_process_th.0 Request processed in 117us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.386394:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:1.0:1782759445.386409:0:141391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141391:1869355211939072:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759445.386431:0:141391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1782759445.386514:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1782759445.386548:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759445.386556:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.386566:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.386574:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782759445.386576:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1782759445.386579:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759445.386597:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.386612:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.386620:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.386632:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.386657:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.386671:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.386683:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939200 00000100:00100000:1.0:1782759445.386689:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939200 00000100:00100000:1.0:1782759445.386716:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:1.0:1782759445.386724:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355211939200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759445.386731:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759445.386739:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df37f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.386759:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.386767:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.386774:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031000, rc 0) 00000100:00100000:1.0:1782759445.386806:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211939200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.386813:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:3.0:1782759445.386851:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.386866:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.386876:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.386910:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.386938:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.386959:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.386980:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939328 00000100:00100000:2.0:1782759445.386985:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939328 00000100:00100000:2.0:1782759445.387012:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:2.0:1782759445.387021:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211939328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.387225:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211939328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.387233:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:3.0:1782759445.387256:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.387281:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.387315:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.387332:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.387343:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939456 00000100:00100000:1.0:1782759445.387347:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939456 00000100:00100000:1.0:1782759445.387366:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:1.0:1782759445.387371:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211939456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.387492:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211939456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.387501:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1782759445.387515:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759445.388269:0:141392:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:3.0:1782759445.388338:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1782759445.388364:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759445.388372:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.388382:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.388389:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759445.388392:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 52 10000000:01000000:3.0:1782759445.388394:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759445.388413:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.388421:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.388429:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.388443:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.388486:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.388512:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.388537:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939584 00000100:00100000:2.0:1782759445.388543:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939584 00000100:00100000:2.0:1782759445.388572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:2.0:1782759445.388581:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355211939584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759445.388591:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759445.388601:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df38d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.388637:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.388647:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.388655:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65a00, rc 0) 00000100:00100000:2.0:1782759445.388690:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211939584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.388697:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1782759445.388721:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.388735:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.388744:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.388780:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.388803:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.388817:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.388856:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939712 00000100:00100000:1.0:1782759445.388861:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939712 00000100:00100000:1.0:1782759445.388882:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:1.0:1782759445.388887:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211939712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.389032:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211939712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.389040:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:3.0:1782759445.389059:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.389085:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.389132:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.389161:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.389218:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939840 00000100:00100000:2.0:1782759445.389223:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939840 00000100:00100000:2.0:1782759445.389287:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:2.0:1782759445.389294:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211939840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.389409:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211939840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.389417:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:0.0:1782759445.389462:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211939840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759445.389726:0:141393:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141393:1869355211939968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759445.389764:0:141393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759445.389793:0:141393:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170829163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.389800:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211939968 00000100:00100000:1.0:1782759445.389810:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211939968 00000100:00100000:1.0:1782759445.389858:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1782759445.389865:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141393:x1869355211939968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.390054:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141393:x1869355211939968:12345-0@lo:502:llog_process_th.0 Request processed in 189us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.390061:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:0.0:1782759445.390084:0:141393:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141393:1869355211939968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759445.390115:0:141393:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141393:1869355211940096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759445.390139:0:141393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759445.390158:0:141393:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170829163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.390184:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940096 00000100:00100000:2.0:1782759445.390189:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940096 00000100:00100000:2.0:1782759445.390218:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:2.0:1782759445.390225:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141393:x1869355211940096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759445.390320:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:141393:x1869355211940096:12345-0@lo:502:llog_process_th.0 Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.390327:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:0.0:1782759445.390358:0:141393:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141393:1869355211940096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759445.390381:0:141393:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1782759445.390468:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1782759445.390497:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759445.390506:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.390515:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.390525:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759445.390528:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:3.0:1782759445.390530:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759445.390549:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.390557:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.390566:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.390579:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.390605:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.390633:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.390647:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940224 00000100:00100000:1.0:1782759445.390653:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940224 00000100:00100000:1.0:1782759445.390683:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:1.0:1782759445.390691:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355211940224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759445.390700:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759445.390710:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df39b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.390728:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.390737:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.390744:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030800, rc 0) 00000100:00100000:1.0:1782759445.390779:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211940224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.390786:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1782759445.390798:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.390814:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.390860:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.390902:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.390929:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.390952:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.390971:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940352 00000100:00100000:2.0:1782759445.390977:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940352 00000100:00100000:2.0:1782759445.391005:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1782759445.391013:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211940352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.391235:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211940352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.391243:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:3.0:1782759445.391255:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.391277:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.391302:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.391318:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.391344:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940480 00000100:00100000:1.0:1782759445.391349:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940480 00000100:00100000:1.0:1782759445.391374:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:1.0:1782759445.391381:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211940480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.391522:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211940480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.391531:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:3.0:1782759445.391546:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.391985:0:141394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141394:1869355211940608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.392022:0:141394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.392051:0:141394:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.392071:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940608 00000100:00100000:2.0:1782759445.392076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940608 00000100:00100000:2.0:1782759445.392100:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1782759445.392104:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141394:x1869355211940608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759445.392245:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141394:x1869355211940608:12345-0@lo:502:llog_process_th.0 Request processed in 140us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.392251:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00100000:1.0:1782759445.392283:0:141394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141394:1869355211940608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759445.392307:0:141394:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759445.392317:0:141394:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759445.392320:0:141394:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre-MDT0000-m del lustre.pool64c 00000020:00000080:1.0:1782759445.392325:0:141394:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1782759445.393719:0:141394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141394:1869355211940736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759445.393770:0:141394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759445.393805:0:141394:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759445.393848:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940736 00000100:00100000:3.0:1782759445.393854:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940736 00000100:00100000:3.0:1782759445.393887:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:3.0:1782759445.393895:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141394:x1869355211940736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759445.394048:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:141394:x1869355211940736:12345-0@lo:502:llog_process_th.0 Request processed in 154us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.394055:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00100000:1.0:1782759445.394141:0:141394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:141394:1869355211940736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759445.394161:0:141394:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759445.394166:0:141394:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759445.394168:0:141394:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre-MDT0000-m del lustre.pool64c 00000040:00080000:1.0:1782759445.394171:0:141394:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:3.0:1782759445.394321:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:3.0:1782759445.394345:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782759445.394354:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.394374:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.394383:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782759445.394385:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759445.394389:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782759445.394412:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.394419:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.394428:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.394440:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.394479:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.394503:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759445.394534:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940864 00000100:00100000:2.0:1782759445.394540:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940864 00000100:00100000:2.0:1782759445.394571:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:2.0:1782759445.394577:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211940864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759445.394586:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759445.394598:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df3a9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.394619:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.394629:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.394638:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64600, rc 0) 00000100:00100000:2.0:1782759445.394681:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211940864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.394694:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:3.0:1782759445.394737:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759445.394750:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.394760:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.394801:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759445.394845:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.394870:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759445.394898:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211940992 00000100:00100000:1.0:1782759445.394903:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211940992 00000100:00100000:1.0:1782759445.394934:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:1.0:1782759445.394941:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211940992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.395123:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211940992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (275us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759445.395131:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:3.0:1782759445.395144:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211940992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759445.395173:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759445.395179:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.395186:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759445.747885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759445.747978:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250048 00000100:00100000:2.0:1782759445.747997:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250048 00000100:00100000:2.0:1782759445.748080:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2770 00000100:00100000:2.0:1782759445.748093:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197250048:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759445.748126:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759445.748147:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66db4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.748184:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.748197:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.748208:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64400, rc 0) 00000100:00100000:2.0:1782759445.748298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197250048:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 208us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.748310:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2770 00000100:00100000:2.0:1782759445.749639:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759445.749701:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250176 00000100:00100000:1.0:1782759445.749709:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250176 00000100:00100000:1.0:1782759445.749761:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2771 00000100:00100000:1.0:1782759445.749771:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197250176:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759445.750102:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197250176:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 332us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.750110:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2771 00000100:00100000:0.0:1782759445.752108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759445.752184:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250304 00000100:00100000:2.0:1782759445.752195:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250304 00000100:00100000:2.0:1782759445.752264:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2772 00000100:00100000:2.0:1782759445.752274:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197250304:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.752525:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197250304:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 251us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.752544:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2772 00000100:00100000:3.0:1782759445.754321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759445.754393:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250432 00000100:00100000:1.0:1782759445.754401:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250432 00000100:00100000:1.0:1782759445.754453:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2773 00000100:00100000:1.0:1782759445.754463:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99029:x1869355197250432:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759445.754801:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99029:x1869355197250432:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 339us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.754813:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2773 00000100:00100000:0.0:1782759445.756127:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759445.756220:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250560 00000100:00100000:2.0:1782759445.756226:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250560 00000100:00100000:2.0:1782759445.756326:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2774 00000100:00100000:2.0:1782759445.756336:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99029:x1869355197250560:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759445.756535:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:99029:x1869355197250560:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 199us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.756542:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2774 00000100:00100000:0.0:1782759445.759679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759445.759758:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250688 00000100:00100000:1.0:1782759445.759769:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250688 00000100:00100000:1.0:1782759445.759879:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2775 00000100:00100000:1.0:1782759445.759896:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197250688:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759445.759922:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759445.759946:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dbb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.759998:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.760012:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759445.760036:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759445.760106:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197250688:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 217us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759445.760114:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2775 00000100:00100000:1.0:1782759445.761874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759445.761947:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250816 00000100:00100000:2.0:1782759445.761956:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250816 00000100:00100000:2.0:1782759445.762013:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2776 00000100:00100000:2.0:1782759445.762024:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197250816:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759445.762362:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197250816:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 338us (492us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759445.762372:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2776 00010000:00010000:1.0:1782759446.124042:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759446.444482:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211941376:0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.444533:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211941120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759446.444566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.444578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759446.444625:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759446.444630:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211941504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759446.444652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.444660:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211941248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759446.444698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.444721:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211941760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759446.444747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.444785:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941376 00000100:00100000:2.0:1782759446.444793:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941376 00000100:00100000:2.0:1782759446.444910:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941248 00000100:00100000:2.0:1782759446.444914:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941248 00000100:00100000:2.0:1782759446.444940:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:2.0:1782759446.444950:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211941376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759446.445016:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211941376:12345-0@lo:400:kworker.0 Request processed in 67us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.445024:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:2.0:1782759446.445041:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:2.0:1782759446.445047:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211941248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759446.445082:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211941248:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.445089:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:3.0:1782759446.445220:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211941632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.445248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.445281:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941632 00000100:00100000:1.0:1782759446.445286:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941632 00000100:00100000:3.0:1782759446.445289:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941120 00000100:00100000:3.0:1782759446.445295:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941120 00000100:00100000:3.0:1782759446.445339:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1782759446.445350:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211941120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.445392:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211941120:12345-0@lo:400:kworker.0 Request processed in 47us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759446.445399:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1782759446.445438:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941504 00000100:00100000:3.0:1782759446.445443:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941504 00000100:00100000:3.0:1782759446.445475:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941760 00000100:00100000:3.0:1782759446.445478:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941760 00000100:00100000:3.0:1782759446.445500:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1782759446.445506:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211941504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.445552:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211941504:12345-0@lo:400:kworker.0 Request processed in 46us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759446.445558:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1782759446.445570:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:3.0:1782759446.445576:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211941760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.445608:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211941760:12345-0@lo:400:kworker.0 Request processed in 31us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759446.445615:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:3.0:1782759446.445663:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211941120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.445877:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:3.0:1782759446.445887:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211941632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.445933:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211941632:12345-0@lo:400:kworker.0 Request processed in 48us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759446.445940:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:1.0:1782759446.445963:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211941632:0@lo:400:kworker.0 00000100:00080000:3.0:1782759446.445995:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759446.446000:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759446.446002:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759446.446033:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211941504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.446047:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211941376:0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.446071:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211941248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759446.446082:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211941760:0@lo:400:kworker.0 00000020:00000080:3.0:1782759446.839495:0:141491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeaf31fbc0 20000000:00000080:3.0:1782759446.839512:0:141491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718337dc00 uarg=0000000000000000 00010000:00010000:3.0:1782759446.839960:0:141491:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759446.839981:0:141491:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759446.840001:0:141491:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759446.840018:0:141491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.840034:0:141491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.840042:0:141491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.840077:0:141491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.840088:0:141491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 18 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.840099:0:141491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141491:1869355211941888:0@lo:104: 00000100:00100000:3.0:1782759446.840156:0:141491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.840205:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211941888 00000100:00100000:3.0:1782759446.840206:0:141491:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183da80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.840212:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211941888 00000100:00100000:1.0:1782759446.840254:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1782759446.840263:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141491:x1869355211941888:12345-0@lo:104: 00010000:00010000:1.0:1782759446.840275:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.840337:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759446.840344:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141491:x1869355211941888:12345-0@lo:104: Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.840352:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1782759446.840359:0:141491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141491:1869355211941888:0@lo:104: 00010000:00010000:2.0:1782759446.840361:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759446.840368:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.840375:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc1cbdc20) 00010000:00010000:3.0:1782759446.840378:0:141491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759446.840380:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.840388:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759446.840396:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759446.840401:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759446.840438:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.840446:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759446.840480:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.840486:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211942016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759446.840499:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777df2c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df2d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.840513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759446.840515:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759446.840516:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759446.840518:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759446.840549:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942016 00000100:00100000:0.0:1782759446.840554:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942016 00010000:00010000:0.0:1782759446.840576:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759446.840613:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1782759446.840622:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211942016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759446.840632:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759446.840637:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840647:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840659:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99400/0xdd99f5c4777df2d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df2c9 expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840671:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840676:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840685:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840689:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840693:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840697:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840708:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759446.840711:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840717:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840732:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.840741:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759446.840756:0:141491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.840765:0:141491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.840778:0:141491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df3c5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759446.840797:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211942016:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.840804:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1782759446.840887:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211942016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759446.956071:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759446.956110:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211942144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759446.956197:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.956260:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942144 00000100:00100000:3.0:1782759446.956276:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942144 00000100:00100000:3.0:1782759446.956351:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1782759446.956363:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211942144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759446.956413:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759446.956521:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211942144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759446.956529:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1782759446.956613:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211942144:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1782759447.124113:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759447.124123:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759447.124129:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759447.124192:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.124220:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.124233:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759447.124262:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211942272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759447.124335:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759447.124398:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759447.124462:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942272 00000100:00100000:2.0:1782759447.124471:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942272 00000100:00100000:2.0:1782759447.124529:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1782759447.124539:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211942272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759447.124555:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759447.124569:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df3cc expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759447.124592:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759447.124604:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759447.124614:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65200, rc 0) 00000100:00100000:2.0:1782759447.124672:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211942272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759447.124681:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:3.0:1782759447.124711:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211942272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759447.124753:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.124762:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759447.124782:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759447.124787:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.124806:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.149283:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759447.205454:0:141539:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea9ac86e0 20000000:00000080:3.0:1782759447.205470:0:141539:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bba97000 uarg=0000000000000000 00010000:00010000:3.0:1782759447.205673:0:141539:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759447.205686:0:141539:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759447.205700:0:141539:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759447.205716:0:141539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.205742:0:141539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.205750:0:141539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.205784:0:141539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.205805:0:141539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 18 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759447.205818:0:141539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141539:1869355211942400:0@lo:104: 00000100:00100000:3.0:1782759447.205910:0:141539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759447.205962:0:141539:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759447.206006:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942400 00000100:00100000:2.0:1782759447.206022:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942400 00000100:00100000:2.0:1782759447.206158:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1782759447.206171:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141539:x1869355211942400:12345-0@lo:104: 00010000:00010000:2.0:1782759447.206202:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759447.206314:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759447.206322:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141539:x1869355211942400:12345-0@lo:104: Request processed in 153us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759447.206331:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00010000:00010000:1.0:1782759447.206349:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759447.206359:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759447.206368:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759447.206372:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759447.206382:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759447.206398:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759447.206406:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782759447.206421:0:141539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141539:1869355211942400:0@lo:104: 00010000:00010000:3.0:1782759447.206438:0:141539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759447.206454:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759447.206463:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759447.206487:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759447.206495:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211942528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759447.206499:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df3cc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3d3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759447.206517:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759447.206520:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759447.206521:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759447.206529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759447.207040:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942528 00000100:00100000:0.0:1782759447.207047:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942528 00010000:00010000:0.0:1782759447.207074:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759447.207109:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1782759447.207119:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211942528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759447.207131:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759447.207136:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207147:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207169:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df3d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df3cc expref: 19 pid: 5796 timeout: 3615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207178:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207183:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207192:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207197:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207201:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207205:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207208:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759447.207211:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207215:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207227:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759447.207246:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759447.207305:0:141539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.207315:0:141539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.207322:0:141539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3da lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759447.207354:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211942528:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759447.207363:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1782759447.207494:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211942528:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1782759447.595374:0:141588:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc50031790 20000000:00000080:3.0:1782759447.595390:0:141588:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718337dc00 uarg=0000000000000000 00010000:00010000:3.0:1782759447.595682:0:141588:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759447.595695:0:141588:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759447.595710:0:141588:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759447.595728:0:141588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595749:0:141588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595759:0:141588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595766:0:141588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595773:0:141588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595779:0:141588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595786:0:141588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759447.595790:0:141588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595798:0:141588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595809:0:141588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595816:0:141588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759447.595898:0:141588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df3e1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759448.172488:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759448.172495:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759448.172499:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759448.172551:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759448.172562:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759448.172574:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759448.172599:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211942656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759448.172667:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759448.172721:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759448.172721:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942656 00000100:00100000:2.0:1782759448.172731:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942656 00000100:00100000:2.0:1782759448.172785:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:2.0:1782759448.172794:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211942656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759448.172807:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759448.172965:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df3e8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759448.172996:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759448.173008:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759448.173015:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64800, rc 0) 00000100:00100000:2.0:1782759448.173056:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211942656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759448.173064:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:0.0:1782759448.173084:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211942656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759448.173098:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759448.173106:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759448.173124:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759448.173124:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759448.173129:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759448.173137:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759448.245517:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759448.245577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759448.245582:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251072 00000100:00100000:1.0:1782759448.245592:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251072 00000100:00100000:2.0:1782759448.245630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:3.0:1782759448.245664:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759448.245673:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2519 00000100:00100000:2.0:1782759448.245674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759448.245690:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197251072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759448.245699:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251200 00000100:00100000:3.0:1782759448.245705:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251200 00000100:00100000:2.0:1782759448.245719:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251328 00000100:00100000:2.0:1782759448.245725:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251328 00000100:00100000:3.0:1782759448.245753:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1972 00000100:00100000:3.0:1782759448.245765:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197251328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759448.245770:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197251072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759448.245771:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 990 00000100:00100000:1.0:1782759448.245785:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2519 00000100:00100000:2.0:1782759448.245789:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2360:x1869355197251200:12345-192.168.204.31@tcp:9:kworker.0 00000100:00100000:3.0:1782759448.245804:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197251328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (135us total) trans 0 rc 0/0 00000020:00000080:2.0:1782759448.245811:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777deb44 00000100:00100000:3.0:1782759448.245812:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1972 00000100:00080000:2.0:1782759448.245845:0:9120:0:(import.c:65:import_set_state_nolock()) ffff9171bb692800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1782759448.245870:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759448.245874:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759448.245888:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759448.246168:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197250944 00000100:00100000:0.0:1782759448.246174:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197250944 00000100:00100000:0.0:1782759448.246202:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2780 00000100:00100000:0.0:1782759448.246210:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197250944:12345-192.168.204.31@tcp:400:kworker.0 00000001:00000004:2.0:1782759448.246214:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967403 00000100:00100000:0.0:1782759448.246247:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197250944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759448.246254:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2780 00000100:00100000:2.0:1782759448.246477:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+2:2360:x1869355197251200:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 694us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759448.246484:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 990 00010000:00010000:1.0:1782759449.196007:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759449.516058:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211942784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759449.516165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759449.516250:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942784 00000100:00100000:3.0:1782759449.516258:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942784 00000100:00100000:3.0:1782759449.516324:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1782759449.516335:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211942784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759449.516387:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759449.516440:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211942784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759449.516448:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00080000:3.0:1782759449.516469:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759449.516631:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211942784:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782759449.538146:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:0.0:1782759449.538155:0:6622:0:(genops.c:906:class_export_put()) final put ffff9171bb694800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:0.0:1782759449.538537:0:133580:0:(genops.c:865:class_export_destroy()) destroying export ffff9171bb694800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 for lustre-OST0000 00000020:00000080:0.0:1782759449.538591:0:133580:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9171bb692800 for lustre-OST0000 00000001:02000400:2.0:1782759449.598137:0:141784:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64d: Nodemap enforces byfid_ops RBAC roles ========================================================== 14:57:28 (1782759448) 00000100:00100000:3.0:1782759449.674288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759449.674328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759449.674340:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251456 00000100:00100000:3.0:1782759449.674355:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251712 00000100:00100000:0.0:1782759449.674358:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251456 00000100:00100000:3.0:1782759449.674374:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251712 00000100:00100000:0.0:1782759449.674428:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2009 00000100:00100000:0.0:1782759449.674440:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197251456:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:0.0:1782759449.674485:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:3.0:1782759449.674496:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2010 00000100:00100000:3.0:1782759449.674507:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:99300:x1869355197251712:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782759449.674553:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759449.674558:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777df133) 00010000:00010000:3.0:1782759449.674560:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759449.674601:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197251456:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 163us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759449.674609:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2009 00010000:00010000:3.0:1782759449.675123:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.675144:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.675158:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.675171:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.675179:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.675194:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759449.676646:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x7:0x0]: returning size 512 00010000:00010000:3.0:1782759449.676658:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.676664:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.676669:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.676673:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759449.676676:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.676681:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.676692:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1900) 00010000:00010000:3.0:1782759449.676694:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759449.676697:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.676701:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df3f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759449.676713:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017363c45 reply state 00000000fc647b12 transno 4294968022 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759449.676729:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759449.676849:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:99300:x1869355197251712:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2342us (2520us total) trans 4294968022 rc 0/0 00000100:00100000:3.0:1782759449.676856:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2010 00010000:00010000:1.0:1782759449.678296:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759449.678309:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759449.678316:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759449.678321:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759449.678325:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759449.678331:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759449.678342:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99302703 (ffff9171908a1500) 00010000:00010000:1.0:1782759449.678345:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759449.678348:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759449.678354:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df3fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759450.220069:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782759451.069667:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968022 is committed 00000020:00000080:2.0:1782759451.215542:0:141981:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4247a5e0 20000000:00000080:2.0:1782759451.215558:0:141981:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e5400 uarg=0000000000000000 10000000:01000000:2.0:1782759451.216005:0:141981:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759451.216024:0:141981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216041:0:141981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216050:0:141981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216087:0:141981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216107:0:141981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 18 pid: 5794 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759451.216122:0:141981:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141981:1869355211942912:0@lo:104: 00000100:00100000:2.0:1782759451.216181:0:141981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759451.216233:0:141981:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3d300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759451.216233:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211942912 00000100:00100000:1.0:1782759451.216241:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211942912 00000100:00100000:1.0:1782759451.216291:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1782759451.216302:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141981:x1869355211942912:12345-0@lo:104: 00010000:00010000:1.0:1782759451.216314:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759451.216399:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759451.216405:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:141981:x1869355211942912:12345-0@lo:104: Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759451.216412:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00010000:00010000:3.0:1782759451.216432:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759451.216440:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759451.216446:0:141981:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141981:1869355211942912:0@lo:104: 00010000:00010000:3.0:1782759451.216452:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759451.216458:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216466:0:141981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216467:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759451.216487:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759451.216493:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759451.216527:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216533:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759451.216561:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216569:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df3e8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3ef expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759451.216580:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211943040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759451.216603:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759451.216605:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759451.216607:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759451.216611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759451.216637:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943040 00000100:00100000:3.0:1782759451.216642:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943040 00010000:00010000:3.0:1782759451.216663:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 19 pid: 5794 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759451.216686:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1782759451.216693:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211943040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759451.216703:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759451.216708:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 19 pid: 5794 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216717:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 19 pid: 5794 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216727:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df3ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df3e8 expref: 19 pid: 5794 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216737:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216744:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216756:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216772:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216778:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216785:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216790:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759451.216794:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216802:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216818:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759451.216865:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759451.216902:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211943040:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759451.216909:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1782759451.216928:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211943040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759451.216962:0:141981:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216971:0:141981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.216977:0:141981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df404 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759451.244010:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759451.545412:0:142029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe53b60ad0 20000000:00000080:2.0:1782759451.545431:0:142029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e4000 uarg=0000000000000000 10000000:01000000:2.0:1782759451.545631:0:142029:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759451.545654:0:142029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545670:0:142029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545681:0:142029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545696:0:142029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545702:0:142029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545710:0:142029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545716:0:142029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759451.545720:0:142029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545729:0:142029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545742:0:142029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545750:0:142029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759451.545757:0:142029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df40b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759451.564252:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211943168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759451.564279:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211943552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759451.564344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759451.564346:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211943296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759451.564402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759451.564417:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211943680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759451.564439:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759451.564448:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211943424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759451.564456:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759451.564488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759451.564506:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943168 00000100:00100000:0.0:1782759451.564514:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943168 00000100:00100000:2.0:1782759451.564528:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943296 00000100:00100000:2.0:1782759451.564534:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943296 00000100:00100000:0.0:1782759451.564566:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1782759451.564579:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1782759451.564579:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211943168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759451.564592:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211943296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759451.564641:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211943168:12345-0@lo:400:kworker.0 Request processed in 65us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759451.564651:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1782759451.564652:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211943296:12345-0@lo:400:kworker.0 Request processed in 60us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759451.564698:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943680 00000100:00100000:3.0:1782759451.564704:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943680 00000100:00100000:3.0:1782759451.564739:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943424 00000100:00100000:3.0:1782759451.564742:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943424 00000100:00100000:2.0:1782759451.565032:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1782759451.565039:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:0.0:1782759451.565049:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211943168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759451.565051:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211943680:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759451.565057:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759451.565062:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759451.565068:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759451.565120:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211943680:12345-0@lo:400:kworker.0 Request processed in 73us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759451.565126:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1782759451.565142:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1782759451.565151:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211943424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759451.565184:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211943424:12345-0@lo:400:kworker.0 Request processed in 35us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759451.565190:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1782759451.565218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759451.565240:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211943424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759451.565243:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211943680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759451.565261:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943552 00000100:00100000:2.0:1782759451.565261:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211943296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759451.565267:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943552 00000100:00080000:0.0:1782759451.565299:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759451.565336:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:3.0:1782759451.565346:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211943552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759451.565390:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211943552:12345-0@lo:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759451.565396:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:2.0:1782759451.565538:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211943552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759452.077036:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759452.077071:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211943808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759452.077179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759452.077229:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943808 00000100:00100000:3.0:1782759452.077240:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943808 00000100:00100000:3.0:1782759452.077304:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1782759452.077325:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211943808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759452.077362:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759452.077438:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211943808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759452.077448:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1782759452.077506:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211943808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759452.269227:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759452.735323:0:142176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe75b012f0 20000000:00000080:0.0:1782759452.735350:0:142176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2e000 uarg=0000000000000000 10000000:01000000:0.0:1782759452.735813:0:142176:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759452.735918:0:142176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.735942:0:142176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.735955:0:142176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.735964:0:142176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.735970:0:142176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.735979:0:142176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.735987:0:142176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759452.735992:0:142176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.736002:0:142176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.736023:0:142176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.736042:0:142176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.736049:0:142176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99000/0xdd99f5c4777df412 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759453.130108:0:142224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffcc318a90 20000000:00000080:2.0:1782759453.130130:0:142224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e7c00 uarg=0000000000000000 10000000:01000000:2.0:1782759453.130434:0:142224:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759453.130457:0:142224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130473:0:142224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130485:0:142224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130503:0:142224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130510:0:142224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130518:0:142224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130524:0:142224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759453.130529:0:142224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130538:0:142224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130548:0:142224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130554:0:142224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.130558:0:142224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df419 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759453.163902:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759453.163909:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759453.163913:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759453.163965:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.163976:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.163987:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759453.164014:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211943936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759453.164085:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759453.164153:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759453.164350:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211943936 00000100:00100000:2.0:1782759453.164358:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211943936 00000100:00100000:2.0:1782759453.164417:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1782759453.164428:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211943936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759453.164453:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759453.164469:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df420 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.164495:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.164506:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759453.164516:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64a00, rc 0) 00000100:00100000:2.0:1782759453.164560:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211943936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.164568:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:3.0:1782759453.164685:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211943936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759453.164702:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.164712:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759453.164733:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759453.164738:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.164745:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.292213:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759453.366342:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759453.366414:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251840 00000100:00100000:2.0:1782759453.366432:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251840 00000100:00100000:3.0:1782759453.366467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759453.366528:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2782 00000100:00100000:3.0:1782759453.366540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759453.366561:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197251840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759453.366583:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197252096 00000100:00100000:3.0:1782759453.366593:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197252096 00000100:00100000:2.0:1782759453.366680:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197251840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 129us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.366691:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2782 00000100:00100000:3.0:1782759453.366785:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1975 00000100:00100000:3.0:1782759453.366799:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197252096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759453.367164:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197252096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 369us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759453.367173:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1975 00000100:00100000:3.0:1782759453.367211:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197251968 00000100:00100000:3.0:1782759453.367218:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197251968 00000100:00100000:3.0:1782759453.367270:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2523 00000100:00100000:3.0:1782759453.367278:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197251968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782759453.367710:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759453.367717:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759453.368390:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197251968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1110us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759453.368401:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2523 00000020:00000080:3.0:1782759453.525014:0:142272:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7752fec0 20000000:00000080:3.0:1782759453.525031:0:142272:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2dc00 uarg=0000000000000000 10000000:01000000:3.0:1782759453.525250:0:142272:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759453.525270:0:142272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.525316:0:142272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.525328:0:142272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.525365:0:142272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.525380:0:142272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 18 pid: 5794 timeout: 3621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759453.525392:0:142272:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142272:1869355211944064:0@lo:104: 00000100:00100000:3.0:1782759453.525442:0:142272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759453.525487:0:142272:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818b0900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759453.525490:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944064 00000100:00100000:0.0:1782759453.525500:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944064 00000100:00100000:0.0:1782759453.525550:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1782759453.525560:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:142272:x1869355211944064:12345-0@lo:104: 00010000:00010000:0.0:1782759453.525572:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.525636:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759453.525642:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:142272:x1869355211944064:12345-0@lo:104: Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759453.525650:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1782759453.525660:0:142272:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142272:1869355211944064:0@lo:104: 00010000:00010000:1.0:1782759453.525666:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759453.525673:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.525680:0:142272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759453.525681:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759453.525690:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759453.525698:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759453.525706:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759453.525712:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759453.525740:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759453.525747:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759453.525771:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759453.525778:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1782759453.525778:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df420 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df427 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759453.525790:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211944192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759453.525792:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759453.525794:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759453.525797:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759453.525819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759453.525869:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944192 00000100:00100000:0.0:1782759453.525874:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944192 00010000:00010000:0.0:1782759453.525895:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 19 pid: 5794 timeout: 3621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759453.525922:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1782759453.525928:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211944192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759453.525949:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759453.525955:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 19 pid: 5794 timeout: 3621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.525982:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 19 pid: 5794 timeout: 3621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.525994:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df427 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df420 expref: 19 pid: 5794 timeout: 3621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526006:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526013:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526025:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526032:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526038:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526044:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526050:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759453.526054:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526060:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526092:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.526101:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759453.526115:0:142272:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.526122:0:142272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759453.526126:0:142272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df42e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759453.526141:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211944192:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759453.526150:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1782759453.526186:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211944192:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1782759453.850242:0:142320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb99bce60 20000000:00000080:0.0:1782759453.850260:0:142320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb3000 uarg=0000000000000000 10000000:01000000:0.0:1782759453.850472:0:142320:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759453.850493:0:142320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850509:0:142320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850520:0:142320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850526:0:142320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850533:0:142320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850540:0:142320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850546:0:142320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759453.850550:0:142320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850565:0:142320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850578:0:142320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850585:0:142320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759453.850592:0:142320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98400/0xdd99f5c4777df435 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759454.182353:0:142368:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfc1228e0 20000000:00000080:2.0:1782759454.182366:0:142368:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e7c00 uarg=0000000000000000 00010000:00010000:2.0:1782759454.182541:0:142368:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759454.182560:0:142368:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759454.182575:0:142368:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759454.182593:0:142368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182608:0:142368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182618:0:142368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182625:0:142368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182631:0:142368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182638:0:142368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182644:0:142368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759454.182648:0:142368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182656:0:142368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182667:0:142368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182674:0:142368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.182691:0:142368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df43c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759454.316074:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759454.635992:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759454.636003:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759454.636009:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759454.636062:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.636076:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.636106:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759454.636125:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759454.636143:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211944448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759454.636146:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211944320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759454.636248:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759454.636248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759454.636349:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171878e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759454.636389:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944448 00000100:00100000:0.0:1782759454.636393:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944320 00000100:00100000:3.0:1782759454.636397:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944448 00000100:00100000:0.0:1782759454.636399:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944320 00000100:00100000:3.0:1782759454.636471:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:0.0:1782759454.636474:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1782759454.636486:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211944448:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759454.636487:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211944320:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759454.636508:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759454.636526:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df443 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1782759454.636527:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1782759454.636560:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.636574:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.636584:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00080000:2.0:1782759454.636584:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759454.636584:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211944320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759454.636594:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1782759454.636642:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211944448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759454.636650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:0.0:1782759454.636671:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211944320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759454.636716:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211944448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759454.636738:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.636753:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759454.636767:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759454.636852:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.636864:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.340070:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759455.617894:0:142565:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb701f380 20000000:00000080:1.0:1782759455.617911:0:142565:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc0400 uarg=0000000000000000 00010000:00010000:1.0:1782759455.618110:0:142565:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759455.618123:0:142565:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759455.618136:0:142565:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759455.618152:0:142565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618176:0:142565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618185:0:142565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618223:0:142565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618237:0:142565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 18 pid: 5796 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759455.618263:0:142565:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142565:1869355211944576:0@lo:104: 00000100:00100000:1.0:1782759455.618318:0:142565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759455.618372:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944576 00000100:00100000:2.0:1782759455.618380:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944576 00000100:00100000:1.0:1782759455.618390:0:142565:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759455.618428:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1782759455.618440:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:142565:x1869355211944576:12345-0@lo:104: 00010000:00010000:2.0:1782759455.618461:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759455.618527:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759455.618533:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:142565:x1869355211944576:12345-0@lo:104: Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759455.618540:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00010000:00010000:3.0:1782759455.618553:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759455.618565:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.618571:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759455.618574:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.618580:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759455.618585:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759455.618588:0:142565:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142565:1869355211944576:0@lo:104: 10000000:01000000:3.0:1782759455.618590:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759455.618610:0:142565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.618619:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.618633:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759455.618661:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.618667:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777df443 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df44a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759455.618681:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759455.618683:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759455.618685:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759455.618688:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211944704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759455.618721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759455.618767:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944704 00000100:00100000:1.0:1782759455.618772:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944704 00010000:00010000:1.0:1782759455.618791:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 19 pid: 5796 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759455.618817:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1782759455.618848:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211944704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759455.618858:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759455.618864:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 19 pid: 5796 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618879:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 19 pid: 5796 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618891:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777df44a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df443 expref: 19 pid: 5796 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618902:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618908:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618919:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618925:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618931:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618937:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618942:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759455.618947:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618953:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618977:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759455.618985:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759455.618999:0:142565:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759455.619011:0:142565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759455.619020:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211944704:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (296us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759455.619021:0:142565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030e00/0xdd99f5c4777df451 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759455.619034:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1782759455.619052:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211944704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759456.364630:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759456.683988:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211944832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759456.684052:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211944960:0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759456.684112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759456.684123:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944832 00000100:00100000:3.0:1782759456.684131:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944832 00000100:00100000:2.0:1782759456.684136:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211945344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759456.684146:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211945472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759456.684180:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784 00000100:00100000:3.0:1782759456.684193:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211944832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759456.684202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759456.684255:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211944960 00000100:00100000:2.0:1782759456.684260:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211944960 00000100:00100000:0.0:1782759456.684264:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211945088:0@lo:400:kworker.0 00000100:00100000:3.0:1782759456.684275:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211944832:12345-0@lo:400:kworker.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759456.684284:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784 00000100:00100000:2.0:1782759456.684297:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945344 00000100:00100000:0.0:1782759456.684299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759456.684302:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945344 00000100:00100000:0.0:1782759456.684329:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759456.684331:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945472 00000100:00100000:3.0:1782759456.684337:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945472 00000100:00100000:2.0:1782759456.684339:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945088 00000100:00100000:0.0:1782759456.684339:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211945216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684345:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945088 00000100:00100000:0.0:1782759456.684373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759456.684376:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1782759456.684383:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211945472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684392:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:2.0:1782759456.684403:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211944960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759456.684413:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1782759456.684426:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211945344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759456.684435:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211945472:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759456.684443:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1782759456.684450:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211944960:12345-0@lo:400:kworker.0 Request processed in 49us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.684458:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1782759456.684460:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945216 00000100:00100000:3.0:1782759456.684464:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945216 00000100:00100000:0.0:1782759456.684471:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211945344:12345-0@lo:400:kworker.0 Request processed in 48us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.684478:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1782759456.684489:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1782759456.684490:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211945088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759456.684497:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1782759456.684515:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211945216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684539:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211945088:12345-0@lo:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.684547:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:3.0:1782759456.684564:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211945216:12345-0@lo:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.684565:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211945088:0@lo:400:kworker.0 00000100:00080000:2.0:1782759456.684570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759456.684577:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759456.684581:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00080000:2.0:1782759456.684583:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759456.684604:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211945216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684631:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211944960:0@lo:400:kworker.0 00000100:00100000:3.0:1782759456.684639:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211945344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759456.684649:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211945472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759456.684657:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211944832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759456.753579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.753632:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197252224 00000100:00100000:0.0:1782759456.753642:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197252224 00000100:00100000:0.0:1782759456.753727:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2011 00000100:00100000:0.0:1782759456.753738:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:99610:x1869355197252224:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759456.753775:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759456.753799:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dc2 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.753938:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df45f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.753951:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.753964:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759456.754162:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1782759456.754167:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759456.754277:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.754306:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dc2 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.754323:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df45f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dc2 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.754333:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759456.754336:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759456.754339:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98a00, rc 0) 00000100:00100000:0.0:1782759456.754400:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:99610:x1869355197252224:12345-192.168.204.31@tcp:101:touch.0 Request processed in 663us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.754408:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2011 00000100:00080000:2.0:1782759456.755472:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759456.760800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.760859:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197252352 00000100:00100000:0.0:1782759456.760870:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197252352 00000100:00100000:0.0:1782759456.760940:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2012 00000100:00100000:0.0:1782759456.760951:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:99610:x1869355197252352:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759456.760972:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759456.760989:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777df466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dc9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761038:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761051:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761062:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761076:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761083:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761089:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761637:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df47b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761658:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df47b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761665:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df47b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759456.761793:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x7:0x0]: returning size 7680 00000004:00200000:0.0:1782759456.761797:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759456.761895:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df47b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761908:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761916:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761923:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761928:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759456.761933:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761940:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761954:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759456.761957:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759456.761961:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761965:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df46d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761974:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761986:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761989:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761992:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759456.761994:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.761998:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.762003:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99302703 (ffff917183a70200) 00010000:00010000:0.0:1782759456.762005:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759456.762006:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.762010:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.762033:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777df466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dc9 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.762043:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df47b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dc9 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.762048:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759456.762050:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759456.762056:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99800, rc 0) 00000100:00100000:0.0:1782759456.762107:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:99610:x1869355197252352:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1158us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.762115:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2012 00000100:00100000:1.0:1782759456.764124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759456.764214:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197252608 00000100:00100000:2.0:1782759456.764233:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197252608 00000100:00100000:2.0:1782759456.764282:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2013 00000100:00100000:2.0:1782759456.764292:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:99610:x1869355197252608:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759456.764317:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759456.764335:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df482 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dd0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.764596:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.764610:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.764620:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.764633:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.764640:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.764646:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759456.765393:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30:0x0], index 0: 0 00010000:00010000:2.0:1782759456.765613:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df497 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765623:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df497 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765631:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df497 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765673:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765680:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765686:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765692:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759456.765696:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765703:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765714:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70600) 00010000:00010000:2.0:1782759456.765717:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759456.765720:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765726:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df489 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759456.765736:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ea20d6c reply state 00000000aece6d14 transno 4294968023 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759456.765744:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759456.765769:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df482 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dd0 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765791:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df497 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dd0 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.765798:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:2.0:1782759456.765800:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759456.765802:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65c00, rc 0) 00000100:00100000:2.0:1782759456.765877:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99610:x1869355197252608:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1587us (1761us total) trans 4294968023 rc 0/0 00000100:00100000:2.0:1782759456.765884:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2013 00010000:00010000:2.0:1782759456.769171:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.769183:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.769190:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.769197:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759456.769201:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.769209:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.769233:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171c08f6000) 00010000:00010000:2.0:1782759456.769236:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759456.769241:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.769253:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df490 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759456.770055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.770096:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197252864 00000100:00100000:0.0:1782759456.770105:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197252864 00000100:00100000:0.0:1782759456.770161:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2014 00000100:00100000:0.0:1782759456.770171:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:99610:x1869355197252864:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782759456.770239:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759456.770258:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df497 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dd0 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.770272:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:0.0:1782759456.770278:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759456.770328:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.770340:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.770348:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759456.770505:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7d891e8 reply state 000000002828ec96 transno 4294968024 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759456.770520:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759456.770611:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99610:x1869355197252864:12345-192.168.204.31@tcp:36:touch.0 Request processed in 441us (558us total) trans 4294968024 rc 0/0 00000100:00100000:0.0:1782759456.770618:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2014 00010000:00010000:3.0:1782759456.771894:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.771905:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.771912:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.771918:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759456.771922:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.771930:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.771942:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff917183a70f00) 00010000:00010000:3.0:1782759456.771945:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759456.771949:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.771955:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777df4a5 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759456.776678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759456.776715:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197252992 00000100:00100000:1.0:1782759456.776725:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197252992 00000100:00100000:1.0:1782759456.776770:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2015 00000100:00100000:1.0:1782759456.776779:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:99610:x1869355197252992:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759456.776800:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759456.776836:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777df4ac lrc: 2/0,0 mode: --/CR res: [0x200000418:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dd7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.776890:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777df4ac lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dd7 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.776905:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777df4ac lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dd7 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.776923:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759456.776927:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759456.776936:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031400, rc 0) 00000100:00100000:1.0:1782759456.776987:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99610:x1869355197252992:12345-192.168.204.31@tcp:101:touch.0 Request processed in 209us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759456.776995:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2015 00000100:00100000:0.0:1782759456.781077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759456.781108:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197253120 00000100:00100000:2.0:1782759456.781119:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197253120 00000100:00100000:2.0:1782759456.781200:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 991 00000100:00100000:2.0:1782759456.781209:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1869355197253120:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:2.0:1782759456.781251:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp t0 exp 0000000000000000 cur 3525 last 0 00000020:00000080:2.0:1782759456.781285:0:6598:0:(genops.c:1406:class_connect()) connect: client c5e146cd-50db-4b42-b3c2-9b1f84b4ef37, cookie 0xdd99f5c4777df4b3 00002000:00100000:2.0:1782759456.781300:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5e146cd-50db-4b42-b3c2-9b1f84b4ef37/ffff917082d3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759456.781327:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759456.781599:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759456.781631:0:6598:0:(import.c:65:import_set_state_nolock()) ffff917082d3a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759456.781702:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2360:x1869355197253120:12345-192.168.204.31@tcp:8:touch.0 Request processed in 491us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.781711:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 991 00000100:00100000:2.0:1782759456.785598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.785705:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197253248 00000100:00100000:3.0:1782759456.785714:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197253248 00000100:00100000:3.0:1782759456.785810:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 992 00000100:00100000:3.0:1782759456.785843:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:0:x1869355197253248:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:2.0:1782759456.786113:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1782759456.805853:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000001:00080000:1.0:1782759456.805885:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967404 is committed 00000100:00100000:0.0:1782759456.806141:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:0:x1869355197253248:12345-192.168.204.31@tcp:2:touch.0 Request processed in 20317us (20545us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1782759456.806154:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 992 00000100:00100000:0.0:1782759456.808697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.808790:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197253504 00000100:00100000:3.0:1782759456.808800:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197253504 00000100:00100000:3.0:1782759456.808915:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 249 00000100:00100000:3.0:1782759456.808942:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99610:x1869355197253504:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759456.809251:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:99610:x1869355197253504:12345-192.168.204.31@tcp:35:touch.0 Request processed in 327us (559us total) trans 4294968025 rc 0/0 00000100:00100000:3.0:1782759456.809259:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 249 10000000:01000000:2.0:1782759456.811912:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759456.811919:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759456.811924:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759456.811968:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.811980:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.812008:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759456.812031:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211945600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759456.812089:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759456.812135:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759456.812212:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945600 00000100:00100000:3.0:1782759456.812219:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945600 00000100:00100000:3.0:1782759456.812279:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:3.0:1782759456.812289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211945600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759456.812302:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759456.812315:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df4ba expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.812337:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.812347:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.812356:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759456.812412:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211945600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759456.812423:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00100000:2.0:1782759456.812929:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211945600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759456.812944:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.812952:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759456.812970:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759456.812974:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.812981:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759456.823869:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.823925:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197253632 00000100:00100000:0.0:1782759456.823936:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197253632 00000100:00100000:0.0:1782759456.824007:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2016 00000100:00100000:0.0:1782759456.824019:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:99611:x1869355197253632:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759456.824055:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759456.824074:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df4c8 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dde expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824131:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 3/1,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824144:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824155:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824167:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824173:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824179:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824305:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/1,0 mode: --/PR res: [0x200000418:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824314:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824321:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759456.824352:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x8:0x0]: returning size 0 00000004:00200000:0.0:1782759456.824357:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759456.824376:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824387:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824395:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824402:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824408:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824414:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759456.824417:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824425:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824447:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759456.824450:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759456.824455:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824461:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df4cf lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824472:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824476:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824479:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824482:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759456.824484:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824487:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824491:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff917183a70c00) 00010000:00010000:0.0:1782759456.824492:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759456.824494:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824497:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df4d6 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824526:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df4c8 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824534:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.824539:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:0.0:1782759456.824540:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759456.824542:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98600, rc 0) 00000100:00100000:0.0:1782759456.824594:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99611:x1869355197253632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 580us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.824599:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2016 00000100:00100000:2.0:1782759456.834870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.835059:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197253760 00000100:00100000:3.0:1782759456.835070:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197253760 00000100:00100000:3.0:1782759456.835130:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1782759456.835141:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99612:x1869355197253760:12345-192.168.204.31@tcp:900:lfs.0 00000100:00100000:3.0:1782759456.835278:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99612:x1869355197253760:12345-192.168.204.31@tcp:900:lfs.0 Request processed in 137us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759456.835286:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1782759456.836989:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.837067:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197253888 00000100:00100000:0.0:1782759456.837075:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197253888 00000100:00100000:0.0:1782759456.837121:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2017 00000100:00100000:0.0:1782759456.837131:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99612:x1869355197253888:12345-192.168.204.31@tcp:53:lfs.0 00000004:00000080:0.0:1782759456.837158:0:7487:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000418:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782759456.837272:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99612:x1869355197253888:12345-192.168.204.31@tcp:53:lfs.0 Request processed in 143us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.837280:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2017 00000100:00100000:2.0:1782759456.843599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759456.846305:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197254016 00000100:00100000:1.0:1782759456.846318:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197254016 00000100:00100000:1.0:1782759456.846392:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2018 00000100:00100000:1.0:1782759456.846402:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99154:x1869355197254016:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1782759456.846424:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759456.846445:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df4e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66de5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.846507:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.846522:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.846533:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.846548:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.846555:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.846561:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847010:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777df4f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847020:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777df4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847027:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777df4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759456.847123:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782759456.847128:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759456.847212:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777df4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847236:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847243:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847250:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847256:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759456.847260:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847267:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847281:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:1.0:1782759456.847289:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759456.847294:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847300:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df4eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847313:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847319:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847325:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847330:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759456.847333:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847339:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847346:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9171889c5000) 00010000:00010000:1.0:1782759456.847349:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759456.847352:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847357:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df4f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847386:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df4e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66de5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847411:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777df4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66de5 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.847419:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759456.847421:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759456.847423:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030600, rc 0) 00000100:00100000:1.0:1782759456.847489:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99154:x1869355197254016:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1088us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759456.847496:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2018 00000100:00100000:2.0:1782759456.849192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.849278:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197254272 00000100:00100000:0.0:1782759456.849285:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197254272 00000100:00100000:0.0:1782759456.849320:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2019 00000100:00100000:0.0:1782759456.849326:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99154:x1869355197254272:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1782759456.849340:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759456.849360:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df500 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dec expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.849405:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.849413:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.849420:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.850681:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.850697:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.850708:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759456.851261:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782759456.851418:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851427:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851435:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851441:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759456.851445:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851460:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851474:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:0.0:1782759456.851476:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759456.851482:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851488:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df507 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851500:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851506:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851512:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851516:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759456.851519:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851525:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851531:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff917183a70c00) 00010000:00010000:0.0:1782759456.851534:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759456.851537:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851552:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777df50e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851594:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df500 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dec expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851602:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:0.0:1782759456.851604:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759456.851606:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777df500 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dec expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.851612:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99c00, rc 0) 00000100:00100000:0.0:1782759456.851673:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:99154:x1869355197254272:12345-192.168.204.31@tcp:101:bash.0 Request processed in 2347us (2487us total) trans 4294968026 rc 301/301 00000100:00100000:0.0:1782759456.851679:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2019 00000100:00100000:0.0:1782759456.853571:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759456.853639:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197254400 00000100:00100000:2.0:1782759456.853649:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197254400 00000100:00100000:2.0:1782759456.853725:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2020 00000100:00100000:2.0:1782759456.853745:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:99154:x1869355197254400:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1782759456.853770:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759456.853791:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df51c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66df3 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.853902:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df523 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.853916:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df523 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.853926:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df523 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759456.854107:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000004:00200000:2.0:1782759456.854112:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759456.854192:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df523 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.854217:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df51c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66df3 expref: 16 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.854246:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df523 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66df3 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.854254:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759456.854257:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759456.854260:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65e00, rc 0) 00000100:00100000:2.0:1782759456.854312:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99154:x1869355197254400:12345-192.168.204.31@tcp:101:bash.0 Request processed in 567us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.854328:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2020 00000100:00100000:2.0:1782759456.857309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.857451:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197254528 00000100:00100000:0.0:1782759456.857461:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197254528 00000100:00100000:0.0:1782759456.857597:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 250 00000100:00100000:0.0:1782759456.857608:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99154:x1869355197254528:12345-192.168.204.31@tcp:37:bash.0 00000100:00100000:0.0:1782759456.860253:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99154:x1869355197254528:12345-192.168.204.31@tcp:37:bash.0 Request processed in 2640us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.860266:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 250 00000100:00100000:1.0:1782759456.864143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.864218:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197254784 00000100:00100000:3.0:1782759456.864242:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197254784 00000100:00100000:3.0:1782759456.864292:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 251 00000100:00100000:3.0:1782759456.864300:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99154:x1869355197254784:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1782759456.864888:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99154:x1869355197254784:12345-192.168.204.31@tcp:35:bash.0 Request processed in 586us (757us total) trans 4294968027 rc 0/0 00000100:00100000:3.0:1782759456.864897:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 251 00000100:00100000:2.0:1782759456.872748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759456.873026:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197254912 00000100:00100000:1.0:1782759456.873042:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197254912 00000100:00100000:1.0:1782759456.873122:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2021 00000100:00100000:1.0:1782759456.873137:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99613:x1869355197254912:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759456.873172:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759456.873199:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df52a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66dfa expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873361:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873380:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873394:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873435:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873443:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873451:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873930:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777df53f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873942:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777df53f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.873949:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777df53f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759456.874042:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000004:00200000:1.0:1782759456.874047:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759456.874107:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777df53f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874118:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874124:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874129:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874140:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759456.874144:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874149:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874160:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759456.874163:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759456.874168:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874175:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777df531 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874190:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874197:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874203:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874209:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759456.874211:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874233:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874253:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9171889c5000) 00010000:00010000:1.0:1782759456.874255:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759456.874259:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874265:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777df538 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874298:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777df52a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dfa expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874310:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777df53f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dfa expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.874316:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:1.0:1782759456.874318:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759456.874320:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030e00, rc 0) 00000100:00100000:1.0:1782759456.874389:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:99613:x1869355197254912:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1257us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759456.874394:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2021 00000100:00100000:2.0:1782759456.879033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759456.879126:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197255168 00000100:00100000:0.0:1782759456.879139:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197255168 00000100:00100000:1.0:1782759456.879336:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2022 00000100:00100000:1.0:1782759456.879353:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:99613:x1869355197255168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759456.879382:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759456.879411:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df546 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e01 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.879546:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df54d lrc: 3/1,0 mode: --/PR res: [0x200000418:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.879585:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df54d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.879600:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df54d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759456.879616:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x8:0x0]: returning size 0 00010000:00010000:1.0:1782759456.880126:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df546 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e01 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.880148:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df54d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e01 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.880158:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759456.880161:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759456.880165:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4a00, rc 0) 00000100:00100000:1.0:1782759456.880303:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:99613:x1869355197255168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 954us (1285us total) trans 4294968028 rc 0/0 00000100:00100000:1.0:1782759456.880406:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2022 00000100:00100000:0.0:1782759456.882748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.882904:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197255296 00000100:00100000:3.0:1782759456.882917:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197255296 00000100:00100000:0.0:1782759456.882919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759456.882966:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197255424 00000100:00100000:2.0:1782759456.882973:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197255424 00000100:00100000:3.0:1782759456.883008:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 180 00000100:00100000:3.0:1782759456.883024:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:2361:x1869355197255296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759456.883037:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 993 00010000:00010000:3.0:1782759456.883046:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759456.883052:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197255424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1782759456.883071:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759456.883077:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df54d lrc: 0/0,0 mode: --/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e01 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.883094:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e08 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.883101:0:134476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:3.0:1782759456.883119:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1782759456.883127:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x6a42c01f, atime: 0x6a42c01f, ctime: 0x6a42c01f, blocks: 0x1 00010000:00010000:2.0:1782759456.883146:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=3525s v=(0 0) 00010000:00010000:2.0:1782759456.883152:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759456.883162:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759456.883179:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:2361:x1869355197255296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 160us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759456.883190:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 180 00010000:00010000:2.0:1782759456.883198:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.883212:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64e00, rc 0) 00000100:00100000:2.0:1782759456.883249:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197255424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.883255:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 993 00000100:00100000:2.0:1782759456.888337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.888420:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197255552 00000100:00100000:3.0:1782759456.888445:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197255552 00002000:00100000:3.0:1782759456.888504:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x30:0x0] (0->4095) req@ffff917084c64e00 x1869355197255552/t0(0) o3->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:617/0 lens 488/0 e 0 to 0 dl 1782759467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759456.888516:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917084c64e00 with x1869355197255552 ext(0->4095) 00002000:00010000:3.0:1782759456.888521:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917084c64e00 00000100:00100000:3.0:1782759456.888565:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:3.0:1782759456.888576:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197255552:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1782759456.888936:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197255552:12345-192.168.204.31@tcp:3:cat.0 Request processed in 360us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759456.888945:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00002000:00100000:3.0:1782759456.888953:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x30:0x0] (0->4095) req@ffff917084c64e00 x1869355197255552/t0(0) o3->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:617/0 lens 488/440 e 0 to 0 dl 1782759467 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759456.888962:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917084c64e00 with x1869355197255552 ext(0->4095) 00002000:00010000:3.0:1782759456.888965:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917084c64e00 00000100:00100000:0.0:1782759456.891636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759456.891766:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197255808 00000100:00100000:3.0:1782759456.891775:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197255808 00000100:00100000:2.0:1782759456.891909:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 252 00000100:00100000:2.0:1782759456.891935:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:99613:x1869355197255808:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1782759456.892409:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:99613:x1869355197255808:12345-192.168.204.31@tcp:35:cat.0 Request processed in 485us (779us total) trans 4294968029 rc 0/0 00000100:00100000:2.0:1782759456.892419:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 252 00000100:00100000:0.0:1782759456.903166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759456.903311:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197255936 00000100:00100000:2.0:1782759456.903324:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197255936 00000100:00100000:2.0:1782759456.903425:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2023 00000100:00100000:2.0:1782759456.903438:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:99614:x1869355197255936:12345-192.168.204.31@tcp:62:lfs.0 00010000:00010000:2.0:1782759456.903564:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903585:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903598:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903616:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903623:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903630:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903747:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903781:0:7487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903791:0:7487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 4/0,1 mode: --/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903871:0:7487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.903888:0:7487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 19 pid: 5801 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759456.903906:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355211945728:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759456.904026:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759456.906130:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355211945728:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759456.906163:0:7487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759456.906342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759456.906412:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197256064 00000100:00100000:2.0:1782759456.906418:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197256064 00010000:00010000:2.0:1782759456.906464:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 20 pid: 5801 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759456.906536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 626 00000100:00100000:2.0:1782759456.906546:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:2361:x1869355197256064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759456.906566:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759456.906584:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 20 pid: 5801 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.906596:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 20 pid: 5801 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.906624:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df4dd lrc: 0/0,0 mode: --/PR res: [0x200000418:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dde expref: 20 pid: 5801 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.906641:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:2.0:1782759456.906647:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.906657:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.906665:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 4/0,1 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.906746:0:7487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759456.906746:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759456.906753:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759456.906807:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:2361:x1869355197256064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 261us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759456.906815:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 626 00000040:00080000:3.0:1782759456.907509:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].51, 64 off11576 00000004:00080000:3.0:1782759456.907520:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3525310696716ns, next at 3526310694388ns, rc = 0 00010000:00010000:3.0:1782759456.907574:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907583:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907589:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907595:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759456.907599:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907607:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907618:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:3.0:1782759456.907621:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759456.907624:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907630:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df570 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907641:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907646:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907663:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907668:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759456.907671:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907677:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907683:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70600) 00010000:00010000:3.0:1782759456.907686:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759456.907689:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907695:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df562 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907705:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907711:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907716:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907721:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759456.907724:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907739:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907747:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171c08f6f00) 00010000:00010000:3.0:1782759456.907749:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759456.907752:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.907757:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df569 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759456.907851:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:99614:x1869355197255936:12345-192.168.204.31@tcp:62:lfs.0 Request processed in 4386us (4670us total) trans 4294968030 rc 0/0 00000100:00100000:3.0:1782759456.907861:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2023 00000100:00100000:3.0:1782759457.196232:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211945856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759457.196313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759457.196354:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945856 00000100:00100000:1.0:1782759457.196363:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945856 00000100:00100000:1.0:1782759457.196423:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1782759457.196436:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211945856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759457.196473:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759457.196536:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211945856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759457.196544:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1782759457.196581:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211945856:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759457.243901:0:142763:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff114db8f0 20000000:00000080:2.0:1782759457.243918:0:142763:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e7c00 uarg=0000000000000000 00010000:00010000:2.0:1782759457.244415:0:142763:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1782759457.244445:0:142763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70600) 00010000:00010000:2.0:1782759457.244449:0:142763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759457.244458:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df47b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dc9 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244494:0:142763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759457.244497:0:142763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759457.244501:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777df53f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dfa expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244514:0:142763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x8:0x0].0x0 (ffff9171889c5100) 00010000:00010000:2.0:1782759457.244516:0:142763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759457.244520:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777df4ac lrc: 0/0,0 mode: --/CR res: [0x200000418:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dd7 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244534:0:142763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171889c5200) 00010000:00010000:2.0:1782759457.244537:0:142763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759457.244541:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777df4f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66de5 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244553:0:142763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759457.244555:0:142763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759457.244559:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df523 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66df3 expref: 14 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244571:0:142763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70d00) 00010000:00010000:2.0:1782759457.244573:0:142763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759457.244577:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df45f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dc2 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244589:0:142763:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 6 locks, left on hash table 0. 10000000:01000000:2.0:1782759457.244606:0:142763:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759457.244625:0:142763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244638:0:142763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244646:0:142763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244681:0:142763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.244694:0:142763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 18 pid: 5796 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759457.244708:0:142763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142763:1869355211945984:0@lo:104: 00000100:00100000:2.0:1782759457.244765:0:142763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759457.244883:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211945984 00000100:00100000:2.0:1782759457.244939:0:142763:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198924840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759457.245152:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211945984 00000100:00100000:3.0:1782759457.245203:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1782759457.245213:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:142763:x1869355211945984:12345-0@lo:104: 00010000:00010000:3.0:1782759457.245237:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.245304:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759457.245311:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:142763:x1869355211945984:12345-0@lo:104: Request processed in 100us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759457.245328:0:142763:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142763:1869355211945984:0@lo:104: 00000100:00100000:3.0:1782759457.245329:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00010000:2.0:1782759457.245354:0:142763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246093:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759457.246102:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246111:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759457.246115:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246124:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759457.246131:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759457.246138:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759457.246172:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246179:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759457.246204:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246212:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65800/0xdd99f5c4777df4ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df4c1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759457.246235:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211946112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759457.246241:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759457.246245:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759457.246255:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759457.246276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759457.246320:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946112 00000100:00100000:2.0:1782759457.246327:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946112 00010000:00010000:2.0:1782759457.246349:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 19 pid: 5796 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759457.246378:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1782759457.246386:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211946112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759457.246397:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759457.246411:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 19 pid: 5796 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246422:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 19 pid: 5796 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246436:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777df4c1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df4ba expref: 19 pid: 5796 timeout: 3625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246449:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246457:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246471:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246478:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246484:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246490:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246495:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759457.246499:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246506:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246529:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.246539:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759457.246551:0:142763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246561:0:142763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.246567:0:142763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df577 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759457.246576:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211946112:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759457.246585:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1782759457.246612:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211946112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759457.389234:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759458.413070:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759458.485184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.485238:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197256192 00000100:00100000:3.0:1782759458.485247:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197256192 00000100:00100000:3.0:1782759458.485301:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2786 00000100:00100000:3.0:1782759458.485310:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197256192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759458.485386:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197256192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759458.485394:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2786 00000100:00100000:2.0:1782759458.486010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759458.486085:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197256320 00000100:00100000:1.0:1782759458.486089:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197256320 00000100:00080000:2.0:1782759458.486134:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759458.486228:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2527 00000100:00100000:1.0:1782759458.486238:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2362:x1869355197256320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759458.486293:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2362:x1869355197256320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759458.486301:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2527 00000100:00100000:3.0:1782759458.488167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.488222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.488257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.488299:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197256832 00000100:00100000:3.0:1782759458.488307:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197256832 00000100:00100000:1.0:1782759458.488310:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197256448 00000100:00100000:1.0:1782759458.488317:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197256448 00000100:00100000:3.0:1782759458.488360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2024 00000100:00100000:1.0:1782759458.488373:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197256576 00000100:00100000:3.0:1782759458.488378:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99687:x1869355197256832:12345-192.168.204.31@tcp:101:touch.0 00000100:00100000:1.0:1782759458.488378:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197256576 00010000:00010000:3.0:1782759458.488396:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782759458.488407:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1978 00010000:00010000:3.0:1782759458.488414:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df57e lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e0f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759458.488416:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197256448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759458.488476:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197256448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759458.488484:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1978 00000100:00100000:1.0:1782759458.488504:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1979 00000100:00100000:1.0:1782759458.488511:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197256576:12345-192.168.204.31@tcp:400:kworker.0 00010000:00010000:3.0:1782759458.488543:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759458.488544:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197256576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759458.488561:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1979 00010000:00010000:3.0:1782759458.488564:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.488575:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.488593:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.488599:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759458.488602:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759458.488606:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759458.488607:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782759458.489235:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30:0x0], index 1: 0 00010000:00010000:3.0:1782759458.489428:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777df593 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489437:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777df593 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489445:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777df593 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489489:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489497:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489503:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489509:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759458.489513:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489533:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489546:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171908a1300) 00010000:00010000:3.0:1782759458.489549:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759458.489554:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489561:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777df585 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759458.489574:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b02d87cf reply state 0000000055bb9fb9 transno 4294968031 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759458.489583:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759458.489615:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df57e lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e0f expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489638:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777df593 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e0f expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.489647:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171908a1100) 00010000:00010000:3.0:1782759458.489650:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759458.489652:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759458.490065:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99687:x1869355197256832:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1687us (1807us total) trans 4294968031 rc 0/0 00000100:00100000:3.0:1782759458.490072:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2024 00010000:00010000:0.0:1782759458.492006:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.492026:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.492035:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.492042:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759458.492047:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.492056:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759458.492075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1782759458.492087:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171908a1800) 00010000:00010000:0.0:1782759458.492093:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759458.492098:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.492119:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777df58c lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759458.492232:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197257088 00000100:00100000:2.0:1782759458.492241:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197257088 00000100:00100000:2.0:1782759458.492329:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2025 00000100:00100000:2.0:1782759458.492341:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99687:x1869355197257088:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782759458.492393:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759458.492415:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777df593 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e0f expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.492432:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171908a1100) 00010000:00010000:2.0:1782759458.492442:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759458.492483:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.492494:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.492504:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759458.492615:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037f3ac19 reply state 00000000109eb0c3 transno 4294968032 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759458.492632:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759458.492711:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99687:x1869355197257088:12345-192.168.204.31@tcp:36:touch.0 Request processed in 374us (654us total) trans 4294968032 rc 0/0 00000100:00100000:2.0:1782759458.492716:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2025 00010000:00010000:3.0:1782759458.493613:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.493628:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.493633:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.493637:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759458.493640:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.493645:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.493653:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171c08f6700) 00010000:00010000:3.0:1782759458.493702:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759458.493705:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.493709:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df5a1 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759458.493980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.494067:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197257216 00000100:00100000:3.0:1782759458.494074:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197257216 00000100:00100000:3.0:1782759458.494116:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2026 00000100:00100000:3.0:1782759458.494125:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99687:x1869355197257216:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759458.494142:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759458.494156:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df5a8 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e16 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.494201:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e16 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.494221:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df5a8 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e16 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.494240:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171908a1b00) 00010000:00010000:3.0:1782759458.494244:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759458.494246:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759458.494292:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99687:x1869355197257216:12345-192.168.204.31@tcp:101:touch.0 Request processed in 168us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759458.494298:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2026 00000100:00100000:2.0:1782759458.496633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.496724:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197257344 00000100:00100000:3.0:1782759458.496731:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197257344 00000100:00100000:3.0:1782759458.496788:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 994 00000100:00100000:3.0:1782759458.496800:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197257344:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:3.0:1782759458.497301:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197257344:12345-192.168.204.31@tcp:2:touch.0 Request processed in 504us (674us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1782759458.497306:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 994 00000100:00100000:0.0:1782759458.499482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.499710:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197257600 00000100:00100000:3.0:1782759458.499719:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197257600 00000100:00100000:3.0:1782759458.499773:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 253 00000100:00100000:3.0:1782759458.499784:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99687:x1869355197257600:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759458.500185:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:99687:x1869355197257600:12345-192.168.204.31@tcp:35:touch.0 Request processed in 403us (706us total) trans 4294968033 rc 0/0 00000100:00100000:3.0:1782759458.500204:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 253 00000100:00100000:2.0:1782759458.507549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759458.507589:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197257728 00000100:00100000:2.0:1782759458.507599:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197257728 00000100:00100000:2.0:1782759458.507662:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2027 00000100:00100000:2.0:1782759458.507674:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:99688:x1869355197257728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759458.507697:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759458.507720:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df5af lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e1d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507792:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507807:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507852:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507868:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507876:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507895:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.507993:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508002:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508010:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759458.508044:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x9:0x0]: returning size 0 00000004:00200000:2.0:1782759458.508048:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759458.508068:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508081:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508090:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508096:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508103:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508109:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759458.508114:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508129:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508141:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171c08f6400) 00010000:00010000:2.0:1782759458.508144:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759458.508148:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508152:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5b6 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508160:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508163:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508167:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508171:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759458.508173:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508177:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508181:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171c08f6a00) 00010000:00010000:2.0:1782759458.508182:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759458.508184:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 2/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508212:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5bd lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508246:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df5af lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e1d expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508261:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e1d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.508270:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171908a1b00) 00010000:00010000:2.0:1782759458.508272:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759458.508274:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64a00, rc 0) 00000100:00100000:2.0:1782759458.508320:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:99688:x1869355197257728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 650us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.508326:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2027 00000100:00100000:0.0:1782759458.518522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759458.518570:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197257856 00000100:00100000:2.0:1782759458.518580:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197257856 00000100:00100000:2.0:1782759458.518628:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2028 00000100:00100000:2.0:1782759458.518635:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:99689:x1869355197257856:12345-192.168.204.31@tcp:53:lfs.0 00000004:00000080:2.0:1782759458.518661:0:7487:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000418:0x9:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782759458.518757:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:99689:x1869355197257856:12345-192.168.204.31@tcp:53:lfs.0 Request processed in 123us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.518763:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2028 00000100:00100000:2.0:1782759458.522003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759458.522057:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197258112 00000100:00100000:0.0:1782759458.522067:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197258112 00000100:00100000:0.0:1782759458.522138:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2029 00000100:00100000:0.0:1782759458.522150:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:99154:x1869355197258112:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1782759458.522169:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759458.522187:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df5cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e24 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759458.522459:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782759458.522633:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df5cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e24 expref: 20 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.522648:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff917183a70200) 00010000:00010000:0.0:1782759458.522650:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759458.522653:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777df5cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e24 expref: 20 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.522666:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99e00, rc 0) 00000100:00100000:0.0:1782759458.522717:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:99154:x1869355197258112:12345-192.168.204.31@tcp:101:bash.0 Request processed in 570us (724us total) trans 4294968034 rc 301/301 00000100:00100000:0.0:1782759458.522724:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2029 00000100:00100000:0.0:1782759458.524560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759458.524616:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197258368 00000100:00100000:2.0:1782759458.524624:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197258368 00000100:00100000:2.0:1782759458.524676:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 254 00000100:00100000:2.0:1782759458.524684:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:99154:x1869355197258368:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:2.0:1782759458.525154:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99154:x1869355197258368:12345-192.168.204.31@tcp:35:bash.0 Request processed in 470us (598us total) trans 4294968035 rc 0/0 00000100:00100000:2.0:1782759458.525160:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 254 00000100:00100000:2.0:1782759458.529804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759458.529901:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197258624 00000100:00100000:3.0:1782759458.529932:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197258624 00000100:00100000:3.0:1782759458.530005:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2030 00000100:00100000:3.0:1782759458.530017:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99690:x1869355197258624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1782759458.530049:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759458.530076:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df5d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e2b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.530156:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df5d9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e2b expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.530172:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9171908a1300) 00010000:00010000:3.0:1782759458.530176:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759458.530183:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df5d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e2b expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.530218:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759458.530292:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99690:x1869355197258624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 277us (495us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759458.530299:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2030 00000100:00100000:0.0:1782759458.540074:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759458.540135:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197258752 00000100:00100000:2.0:1782759458.540152:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197258752 00000100:00100000:2.0:1782759458.540243:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2031 00000100:00100000:2.0:1782759458.540265:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99691:x1869355197258752:12345-192.168.204.31@tcp:62:lfs.0 00000100:00100000:2.0:1782759458.540399:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99691:x1869355197258752:12345-192.168.204.31@tcp:62:lfs.0 Request processed in 138us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.540408:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2031 00000100:00100000:0.0:1782759458.547432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759458.547479:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197258880 00000100:00100000:1.0:1782759458.547488:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197258880 00000100:00100000:1.0:1782759458.547542:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 995 00000100:00100000:1.0:1782759458.547548:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197258880:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759458.547564:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759458.547583:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e32 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759458.547610:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x6a42c021, atime: 0x6a42c021, ctime: 0x6a42c021, blocks: 0x1 00010000:00010000:1.0:1782759458.547630:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=3526s v=(0 0) 00010000:00010000:1.0:1782759458.547635:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759458.547642:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.547656:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.547666:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759458.547716:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197258880:12345-192.168.204.31@tcp:101:rm.0 Request processed in 168us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759458.547720:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 995 00000100:00100000:0.0:1782759458.549691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759458.549739:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259136 00000100:00100000:2.0:1782759458.549746:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259136 00000100:00100000:2.0:1782759458.549782:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2032 00000100:00100000:2.0:1782759458.549788:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99692:x1869355197259136:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759458.549856:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782759458.549893:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df5c4 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e1d expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.549919:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777df5a8 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e16 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.549930:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171908a1b00) 00010000:00010000:2.0:1782759458.549940:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759458.549990:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.549999:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550006:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550014:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550018:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550022:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550108:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550116:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550120:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759458.550702:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].46, 64 off11232 00000004:00080000:2.0:1782759458.550715:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3526953891506ns, next at 3527953888123ns, rc = 0 00010000:00010000:2.0:1782759458.550770:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 3/0,1 mode: --/PW res: [0x200000418:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550778:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550791:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550798:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550804:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550810:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550851:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759458.550872:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550880:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550886:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.550890:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759458.550893:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759458.550899:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550908:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.550909:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.550927:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759458.550928:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171c08f6600) 00010000:00010000:2.0:1782759458.550933:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759458.550943:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550944:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.550964:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df5f5 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.550964:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.550988:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x9:0x0].0x0 (ffff9171c08f6600) 00010000:00010000:0.0:1782759458.550991:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759458.550992:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.550996:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 1/0,0 mode: --/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.551004:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.551008:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df5fc lrc: 0/0,0 mode: --/PW res: [0x200000418:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.551018:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.551026:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759458.551029:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759458.551030:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759458.551033:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759458.551036:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759458.551040:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.551050:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171c08f6400) 00010000:00010000:2.0:1782759458.551052:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759458.551055:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.551061:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df5e7 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759458.551075:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ee2f3b0 reply state 000000008347ca7a transno 4294968036 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759458.551093:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759458.551164:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:99692:x1869355197259136:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1374us (1475us total) trans 4294968036 rc 0/0 00000100:00100000:2.0:1782759458.551172:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2032 00010000:00010000:2.0:1782759458.554389:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.554412:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.554422:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.554429:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759458.554435:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.554445:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.554465:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171c08f6a00) 00010000:00010000:2.0:1782759458.554469:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759458.554474:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.554480:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df5ee lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759458.859896:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759458.859904:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759458.859915:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759458.859976:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.859988:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.859997:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759458.860025:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211946240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759458.860095:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759458.860148:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759458.860148:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946240 00000100:00100000:1.0:1782759458.860158:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946240 00000100:00100000:1.0:1782759458.860226:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1782759458.860237:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211946240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759458.860257:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759458.860271:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df603 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.860295:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.860306:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.860315:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782759458.860366:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211946240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759458.860373:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:2.0:1782759458.860427:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211946240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759458.860445:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.860456:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759458.860478:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759458.860485:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.860493:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759459.218616:0:143006:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe946b0840 20000000:00000080:2.0:1782759459.218633:0:143006:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bc190000 uarg=0000000000000000 00010000:00010000:2.0:1782759459.220279:0:143006:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759459.220302:0:143006:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759459.220341:0:143006:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759459.220357:0:143006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759459.220372:0:143006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759459.220378:0:143006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759459.220407:0:143006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759459.220417:0:143006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 18 pid: 5796 timeout: 3627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759459.220428:0:143006:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143006:1869355211946368:0@lo:104: 00000100:00100000:2.0:1782759459.220484:0:143006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759459.220605:0:143006:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759459.220614:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759459.220627:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946368 00000100:00100000:1.0:1782759459.220633:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946368 00000100:00100000:1.0:1782759459.220683:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1782759459.220693:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:143006:x1869355211946368:12345-0@lo:104: 00010000:00010000:1.0:1782759459.220705:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.220756:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759459.220762:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:143006:x1869355211946368:12345-0@lo:104: Request processed in 72us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759459.220768:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1782759459.220772:0:143006:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143006:1869355211946368:0@lo:104: 00010000:00010000:2.0:1782759459.220788:0:143006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759459.220924:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759459.220931:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759459.220939:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759459.220942:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759459.220950:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759459.220963:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759459.220969:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759459.220995:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759459.221001:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759459.221051:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211946496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759459.221080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759459.221133:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759459.221141:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64c00/0xdd99f5c4777df603 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df60a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759459.221155:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759459.221157:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759459.221159:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759459.221328:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946496 00000100:00100000:1.0:1782759459.221333:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946496 00010000:00010000:1.0:1782759459.221356:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 19 pid: 5796 timeout: 3627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759459.221379:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1782759459.221386:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211946496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759459.221396:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759459.221401:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 19 pid: 5796 timeout: 3627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221411:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 19 pid: 5796 timeout: 3627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221431:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df60a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df603 expref: 19 pid: 5796 timeout: 3627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221444:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221449:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221459:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221463:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221468:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221472:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221479:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759459.221482:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221486:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221497:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.221506:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759459.221515:0:143006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759459.221523:0:143006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759459.221529:0:143006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64a00/0xdd99f5c4777df611 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759459.221537:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211946496:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759459.221544:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1782759459.221576:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211946496:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1782759459.259024:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967395 is committed 00010000:00010000:0.0:1782759459.435979:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759459.578713:0:143056:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd60c353b0 20000000:00000080:1.0:1782759459.578730:0:143056:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc1c00 uarg=0000000000000000 00010000:00010000:1.0:1782759459.578971:0:143056:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759459.578986:0:143056:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759459.579002:0:143056:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759459.579021:0:143056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579037:0:143056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579048:0:143056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579056:0:143056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579069:0:143056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579076:0:143056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579082:0:143056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759459.579087:0:143056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579095:0:143056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579108:0:143056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579116:0:143056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.579123:0:143056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777df618 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759459.756409:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3528159583469ns, next at 3529159580800ns, rc = 0 00000100:00100000:3.0:1782759459.756419:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211946624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759459.756484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759459.756607:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946624 00000100:00100000:0.0:1782759459.756616:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946624 00000100:00080000:1.0:1782759459.756679:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759459.756710:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1782759459.756722:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211946624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759459.756755:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759459.756813:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211946624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759459.756820:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1782759459.756927:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211946624:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759459.951763:0:143104:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec543ca70 20000000:00000080:0.0:1782759459.951779:0:143104:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082736000 uarg=0000000000000000 00010000:00010000:0.0:1782759459.952020:0:143104:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759459.952036:0:143104:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759459.952053:0:143104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759459.952072:0:143104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952086:0:143104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952095:0:143104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952102:0:143104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952108:0:143104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952115:0:143104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952127:0:143104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759459.952131:0:143104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952140:0:143104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952151:0:143104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952158:0:143104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.952177:0:143104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98200/0xdd99f5c4777df61f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759460.303289:0:143152:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2acda030 20000000:00000080:2.0:1782759460.303302:0:143152:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2f22c00 uarg=0000000000000000 00010000:00010000:2.0:1782759460.303993:0:143152:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759460.304008:0:143152:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759460.304026:0:143152:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759460.304046:0:143152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304062:0:143152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304073:0:143152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304085:0:143152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304092:0:143152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304099:0:143152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304106:0:143152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759460.304110:0:143152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304118:0:143152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304139:0:143152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304146:0:143152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759460.304153:0:143152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65800/0xdd99f5c4777df626 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.460095:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759461.035953:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759461.035961:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759461.035966:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759461.036011:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.036023:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.036035:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.036059:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211946752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759461.036124:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759461.036218:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759461.036952:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946752 00000100:00100000:3.0:1782759461.036962:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946752 00000100:00100000:3.0:1782759461.037013:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:3.0:1782759461.037022:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211946752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759461.037037:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759461.037052:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df62d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.037076:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.037101:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.037109:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759461.037167:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211946752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759461.037174:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1782759461.037279:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211946752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759461.037295:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.037307:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759461.037329:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759461.037335:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.037343:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759461.308682:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968034 is committed 00000004:00080000:0.0:1782759461.308701:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 121 committed 00000001:00080000:0.0:1782759461.308734:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968036 is committed 00000004:00080000:0.0:1782759461.308738:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 119 committed 00000100:00100000:2.0:1782759461.308866:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759461.308892:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211946880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782759461.308961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759461.308974:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759461.308987:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211947008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782759461.309002:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211946880 00000100:00100000:1.0:1782759461.309011:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211946880 00000100:00100000:3.0:1782759461.309029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782759461.309044:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759461.309073:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211947008 00000100:00100000:3.0:1782759461.309078:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211947008 00000100:00100000:1.0:1782759461.309082:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1782759461.309095:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211946880:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782759461.309143:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00002000:00080000:1.0:1782759461.309146:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:48 count 1 00000100:00100000:2.0:1782759461.309171:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211947008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782759461.309193:0:126932:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:48 count 1 00010000:00010000:1.0:1782759461.309195:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.309210:0:126932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759461.309213:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782759461.309228:0:126932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.309230:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.309251:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782759461.309251:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782759461.309259:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759461.309260:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759461.309268:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.309269:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.309304:0:126932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.309307:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 5 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.309332:0:126932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 6 pid: 6599 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.309332:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 5 pid: 6597 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.309361:0:126932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:126932:1869355211947136:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759461.309362:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211947264:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759461.309438:0:126932:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26780 going to sleep for 11 seconds 00000004:00080000:0.0:1782759461.309519:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 120 committed 00000100:00100000:1.0:1782759461.309603:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759461.311932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759461.311986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759461.311993:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355211947264:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759461.312010:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259264 00000100:00100000:0.0:1782759461.312015:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259264 00010000:00010000:1.0:1782759461.312020:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759461.312057:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759461.312077:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 7 pid: 6599 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759461.312116:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259392 00000100:00100000:0.0:1782759461.312119:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259392 00000100:00080000:3.0:1782759461.312152:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759461.312158:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 6 pid: 6597 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759461.312192:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:2.0:1782759461.312201:0:126932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:126932:1869355211947136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759461.312201:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197259264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759461.312214:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759461.312215:0:126932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.312220:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 7 pid: 6599 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.312231:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 7 pid: 6599 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.312237:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 630 00000100:00100000:2.0:1782759461.312253:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197259392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759461.312262:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759461.312267:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 6 pid: 6597 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.312268:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777df5e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e32 expref: 7 pid: 6599 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.312279:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 6 pid: 6597 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.312283:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759461.312287:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759461.312293:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df55b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e08 expref: 6 pid: 6597 timeout: 3629 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.312293:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.312303:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759461.312303:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.312306:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759461.312310:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.312317:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.312329:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759461.312331:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759461.312375:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197259392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 124us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.312383:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 630 00010000:00010000:3.0:1782759461.312416:0:126932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.312425:0:126932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.312433:0:126932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.312438:0:126932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.312517:0:126932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759461.313131:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759461.313149:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.313171:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759461.313175:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.313183:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.313196:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.313203:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001228d5fc/0xdd99f5c4777df642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.313221:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759461.313222:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759461.313224:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759461.314195:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197259264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1989us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.314205:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 629 00000100:00100000:3.0:1782759461.315365:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211947008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6193us (6332us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1782759461.315378:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000004:00080000:0.0:1782759461.315411:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7765c00/2, rc 0, transno 4294967396 00000100:00100000:0.0:1782759461.315421:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211947008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782759461.315423:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.315453:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.315464:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.315471:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.315497:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759461.315576:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759461.315584:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.315594:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759461.315598:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.315621:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.315641:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.315649:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d7ee6b/0xdd99f5c4777df63b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.315671:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759461.315674:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759461.315675:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759461.316186:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211946880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7094us (7225us total) trans 4294967405 rc 0/0 00000100:00100000:2.0:1782759461.316194:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000004:00080000:3.0:1782759461.316634:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917084c64a80/2, rc 0, transno 4294967405 00000100:00100000:3.0:1782759461.316641:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211946880:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782759461.484053:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759461.804877:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211947520:0@lo:400:kworker.0 00000100:00100000:0.0:1782759461.804920:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211947648:0@lo:400:kworker.0 00000100:00100000:2.0:1782759461.804986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759461.805023:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211947520 00000100:00100000:0.0:1782759461.805034:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211947520 00000100:00100000:3.0:1782759461.805035:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211947392:0@lo:400:kworker.0 00000100:00100000:2.0:1782759461.805079:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211948032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759461.805106:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1782759461.805118:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211947520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759461.805141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759461.805144:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211947904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759461.805192:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948032 00000100:00100000:2.0:1782759461.805198:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948032 00000100:00100000:0.0:1782759461.805208:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211947520:12345-0@lo:400:kworker.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.805218:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:3.0:1782759461.805231:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211947776:0@lo:400:kworker.0 00000100:00100000:0.0:1782759461.805240:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211947904 00000100:00100000:0.0:1782759461.805243:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211947904 00000100:00100000:2.0:1782759461.805247:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1782759461.805259:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211948032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759461.805284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:0.0:1782759461.805294:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211947904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759461.805312:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211948032:12345-0@lo:400:kworker.0 Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.805322:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1782759461.805331:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211947392 00000100:00100000:3.0:1782759461.805337:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211947392 00000100:00100000:2.0:1782759461.805349:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211947776 00000100:00100000:2.0:1782759461.805355:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211947776 00000100:00100000:0.0:1782759461.805356:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211947904:12345-0@lo:400:kworker.0 Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.805364:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1782759461.805373:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:3.0:1782759461.805382:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211947392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759461.805397:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1782759461.805407:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211947776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805424:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211947392:12345-0@lo:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759461.805433:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:2.0:1782759461.805463:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211947776:12345-0@lo:400:kworker.0 Request processed in 57us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.805471:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00080000:3.0:1782759461.805477:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759461.805520:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211947776:0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805526:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211947392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805544:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211947904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759461.805803:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211947648 00000100:00100000:0.0:1782759461.805807:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211947648 00000100:00100000:3.0:1782759461.805814:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211948032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759461.805851:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211947520:0@lo:400:kworker.0 00000100:00100000:0.0:1782759461.805874:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:0.0:1782759461.805883:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211947648:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759461.805895:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759461.805929:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211947648:12345-0@lo:400:kworker.0 Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.805936:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1782759461.805948:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211947648:0@lo:400:kworker.0 00000001:00080000:2.0:1782759461.826029:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967405 is committed 00000020:00000080:2.0:1782759461.967744:0:143353:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa2db5000 20000000:00000080:2.0:1782759461.967760:0:143353:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917088d83c00 uarg=0000000000000000 10000000:01000000:2.0:1782759461.968333:0:143353:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759461.968352:0:143353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.968371:0:143353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.968380:0:143353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.968418:0:143353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.968433:0:143353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 18 pid: 5794 timeout: 3630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.968448:0:143353:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143353:1869355211948160:0@lo:104: 00000100:00100000:2.0:1782759461.968512:0:143353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759461.968574:0:143353:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818e5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759461.968650:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948160 00000100:00100000:0.0:1782759461.968659:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948160 00000100:00100000:0.0:1782759461.968714:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1782759461.968725:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:143353:x1869355211948160:12345-0@lo:104: 00010000:00010000:0.0:1782759461.968738:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.968860:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759461.968867:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:143353:x1869355211948160:12345-0@lo:104: Request processed in 146us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.968874:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1782759461.968968:0:143353:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143353:1869355211948160:0@lo:104: 00010000:00010000:1.0:1782759461.968975:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759461.968985:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.968994:0:143353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.968995:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759461.969002:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969013:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759461.969032:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759461.969037:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759461.969143:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969151:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759461.969178:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969186:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d65200/0xdd99f5c4777df62d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df634 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759461.969203:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211948288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759461.969208:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759461.969211:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759461.969213:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759461.969232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759461.969315:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948288 00000100:00100000:1.0:1782759461.969320:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948288 00010000:00010000:1.0:1782759461.969346:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 19 pid: 5794 timeout: 3630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759461.969373:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1782759461.969380:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211948288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759461.969390:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759461.969396:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 19 pid: 5794 timeout: 3630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969407:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 19 pid: 5794 timeout: 3630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969428:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777df634 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df62d expref: 19 pid: 5794 timeout: 3630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969440:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969454:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969467:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969474:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969480:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969487:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969492:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759461.969496:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969503:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969524:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.969544:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759461.969596:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211948288:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.969604:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00010000:00010000:2.0:1782759461.969606:0:143353:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759461.969613:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211948288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759461.969620:0:143353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.969629:0:143353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df649 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759462.317094:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211948416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759462.317183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759462.317281:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948416 00000100:00100000:3.0:1782759462.317291:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948416 00000100:00100000:3.0:1782759462.317343:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1782759462.317356:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211948416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759462.317394:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759462.317460:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211948416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759462.317468:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:1.0:1782759462.317534:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211948416:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1782759462.324342:0:143401:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7e5788e0 20000000:00000080:0.0:1782759462.324364:0:143401:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b70c00 uarg=0000000000000000 10000000:01000000:0.0:1782759462.324609:0:143401:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759462.324635:0:143401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324664:0:143401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324676:0:143401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324684:0:143401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324692:0:143401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324698:0:143401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324704:0:143401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759462.324708:0:143401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324716:0:143401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324731:0:143401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324738:0:143401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.324745:0:143401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df650 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.507979:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759462.686645:0:143449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc072e9650 20000000:00000080:0.0:1782759462.686665:0:143449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917083b71400 uarg=0000000000000000 00010000:00010000:0.0:1782759462.687213:0:143449:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759462.687228:0:143449:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759462.687245:0:143449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759462.687266:0:143449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687281:0:143449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687293:0:143449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687300:0:143449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687307:0:143449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687314:0:143449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687321:0:143449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759462.687326:0:143449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687334:0:143449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687358:0:143449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687366:0:143449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.687373:0:143449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777df657 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.532048:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759463.603644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759463.603691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759463.603733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759463.603765:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259520 00000100:00100000:1.0:1782759463.603776:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259520 00000100:00100000:3.0:1782759463.603801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759463.603854:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2790 00000100:00100000:1.0:1782759463.603866:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197259520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759463.603871:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259904 00000100:00100000:3.0:1782759463.603876:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259904 00000100:00100000:3.0:1782759463.603919:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259776 00000100:00100000:3.0:1782759463.603923:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259776 00000100:00100000:1.0:1782759463.603943:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197259520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.603952:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2790 00000100:00100000:3.0:1782759463.603958:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1982 00000100:00100000:3.0:1782759463.603969:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197259904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759463.604018:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197259904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759463.604026:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1982 00000100:00100000:3.0:1782759463.604042:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1983 00000100:00100000:3.0:1782759463.604048:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197259776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759463.604070:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197259776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759463.604076:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1983 00000100:00080000:3.0:1782759463.604110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759463.604115:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759463.604377:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197259648 00000100:00100000:0.0:1782759463.604383:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197259648 00000100:00080000:3.0:1782759463.604432:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759463.604439:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2531 00000100:00100000:0.0:1782759463.604449:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197259648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759463.604502:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197259648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 55us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.604509:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2531 10000000:01000000:0.0:1782759463.724250:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759463.724257:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759463.724261:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759463.724307:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.724320:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.724331:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759463.724357:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211948544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759463.724457:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759463.724533:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948544 00000100:00100000:0.0:1782759463.724533:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759463.724542:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948544 00000100:00100000:3.0:1782759463.724588:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:3.0:1782759463.724595:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211948544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759463.724606:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759463.724625:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df65e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.724645:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.724652:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.724659:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759463.724700:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211948544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759463.724713:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:0.0:1782759463.725101:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211948544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759463.725117:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.725127:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759463.725144:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759463.725149:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.725155:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759463.996359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759463.996435:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197260160 00000100:00100000:2.0:1782759463.996448:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197260160 00000100:00100000:2.0:1782759463.996701:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2033 00000100:00100000:2.0:1782759463.996712:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:99890:x1869355197260160:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759463.996735:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759463.996758:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df66c lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e39 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.997183:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.997199:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.997213:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.997227:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.997242:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.997250:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759463.998252:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31:0x0], index 0: 0 00010000:00010000:2.0:1782759463.998553:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df681 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998565:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df681 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998575:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df681 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998611:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998618:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998623:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998628:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759463.998632:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998637:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998655:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171c08f6900) 00010000:00010000:2.0:1782759463.998657:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759463.998661:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998665:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df673 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759463.998678:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a7921f8 reply state 000000006bcc5c78 transno 4294968037 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759463.998687:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759463.998718:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df66c lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e39 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998741:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df681 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e39 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.998749:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759463.998752:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759463.998754:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64800, rc 0) 00000100:00100000:2.0:1782759463.998819:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99890:x1869355197260160:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2108us (2467us total) trans 4294968037 rc 0/0 00000100:00100000:2.0:1782759463.999939:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2033 00010000:00010000:2.0:1782759464.000447:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.000458:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.000545:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.000551:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759464.000555:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.000562:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.000575:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759464.000578:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759464.000582:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.000588:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777df67a lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759464.001244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759464.001449:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197260416 00000100:00100000:1.0:1782759464.001459:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197260416 00000100:00100000:1.0:1782759464.001621:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2034 00000100:00100000:1.0:1782759464.001634:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:99890:x1869355197260416:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782759464.001691:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759464.001712:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df681 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e39 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.001727:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:1.0:1782759464.001738:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759464.002437:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,1 mode: --/PW res: [0x200000418:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.002452:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.002463:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759464.002608:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000859ecfc7 reply state 00000000244ecc7c transno 4294968038 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759464.002627:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759464.002711:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99890:x1869355197260416:12345-192.168.204.31@tcp:36:touch.0 Request processed in 1080us (1468us total) trans 4294968038 rc 0/0 00000100:00100000:1.0:1782759464.002733:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2034 00010000:00010000:1.0:1782759464.003673:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.003682:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.003689:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.003694:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759464.003699:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.003706:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.003728:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759464.003736:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759464.003740:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 2/0,0 mode: --/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.003745:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df68f lrc: 0/0,0 mode: --/PW res: [0x200000418:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759464.003915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759464.003943:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197260544 00000100:00100000:1.0:1782759464.003949:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197260544 00000100:00100000:1.0:1782759464.003978:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2035 00000100:00100000:1.0:1782759464.003984:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:99890:x1869355197260544:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759464.003997:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759464.004007:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df696 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e40 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.004039:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df696 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e40 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.004047:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df696 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e40 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.004060:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759464.004063:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759464.004066:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4200, rc 0) 00000100:00100000:1.0:1782759464.004110:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99890:x1869355197260544:12345-192.168.204.31@tcp:101:touch.0 Request processed in 125us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759464.004117:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2035 00000100:00100000:1.0:1782759464.005220:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759464.005253:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197260672 00000100:00100000:1.0:1782759464.005267:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197260672 00000100:00100000:1.0:1782759464.005304:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 998 00000100:00100000:1.0:1782759464.005315:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197260672:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:1.0:1782759464.005635:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197260672:12345-192.168.204.31@tcp:2:touch.0 Request processed in 325us (419us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1782759464.005641:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 998 00000100:00100000:0.0:1782759464.007264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759464.007344:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197260928 00000100:00100000:1.0:1782759464.007350:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197260928 00000100:00100000:1.0:1782759464.007390:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 255 00000100:00100000:1.0:1782759464.007398:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99890:x1869355197260928:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782759464.007631:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:99890:x1869355197260928:12345-192.168.204.31@tcp:35:touch.0 Request processed in 233us (371us total) trans 4294968039 rc 0/0 00000100:00100000:1.0:1782759464.007638:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 255 00000100:00100000:0.0:1782759464.016040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759464.016134:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197261056 00000100:00100000:1.0:1782759464.016144:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197261056 00000100:00100000:1.0:1782759464.016194:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2036 00000100:00100000:1.0:1782759464.016206:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:99891:x1869355197261056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759464.016230:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759464.016254:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df69d lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e47 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016331:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016345:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016373:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016388:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016396:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016403:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016496:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016505:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016511:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759464.016544:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xa:0x0]: returning size 0 00000004:00200000:1.0:1782759464.016548:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759464.016576:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016588:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016595:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016618:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016626:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016632:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759464.016636:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016642:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016652:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759464.016654:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759464.016657:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016661:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777df6a4 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016668:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016673:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016679:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016684:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759464.016691:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016702:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016711:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171889c5100) 00010000:00010000:1.0:1782759464.016714:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759464.016716:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 2/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016721:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df6ab lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016750:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df69d lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e47 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016766:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e47 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.016773:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759464.016776:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759464.016778:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782759464.016857:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99891:x1869355197261056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 654us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759464.016865:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2036 00000001:00080000:3.0:1782759464.381818:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967396 is committed 00000020:00000080:0.0:1782759464.395704:0:143646:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff3f7243b0 20000000:00000080:0.0:1782759464.395721:0:143646:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b353e400 uarg=0000000000000000 00010000:00010000:0.0:1782759464.396371:0:143646:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782759464.396403:0:143646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:0.0:1782759464.396406:0:143646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759464.396417:0:143646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df6b2 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e47 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.396435:0:143646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:0.0:1782759464.396437:0:143646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759464.396449:0:143646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df696 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e40 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.396467:0:143646:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 2 locks, left on hash table 0. 10000000:01000000:0.0:1782759464.396488:0:143646:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759464.396501:0:143646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.396512:0:143646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.396520:0:143646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.396551:0:143646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.396563:0:143646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 18 pid: 5794 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759464.396578:0:143646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143646:1869355211948672:0@lo:104: 00000100:00100000:0.0:1782759464.396635:0:143646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759464.396732:0:143646:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759464.396812:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948672 00000100:00100000:2.0:1782759464.396819:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948672 00000100:00100000:2.0:1782759464.397072:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1782759464.397091:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:143646:x1869355211948672:12345-0@lo:104: 00010000:00010000:2.0:1782759464.397103:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397169:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759464.397175:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:143646:x1869355211948672:12345-0@lo:104: Request processed in 87us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759464.397181:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:3.0:1782759464.397227:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759464.397233:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.397238:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759464.397240:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.397246:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759464.397251:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759464.397254:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759464.397274:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.397278:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759464.397292:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.397296:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99400/0xdd99f5c4777df65e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df665 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.397305:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759464.397311:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759464.397312:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759464.397320:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211948800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759464.397342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759464.397414:0:143646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143646:1869355211948672:0@lo:104: 00010000:00010000:0.0:1782759464.397427:0:143646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759464.397506:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948800 00000100:00100000:2.0:1782759464.397511:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948800 00010000:00010000:2.0:1782759464.397528:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 19 pid: 5794 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759464.397587:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1782759464.397593:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211948800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759464.397600:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759464.397604:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 19 pid: 5794 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397610:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 19 pid: 5794 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397618:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777df665 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df65e expref: 19 pid: 5794 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397626:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397631:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397640:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397644:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397649:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397660:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397663:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759464.397666:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.397670:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.397758:0:143646:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759464.397763:0:143646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.398135:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.398143:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99800/0xdd99f5c4777df6b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.398153:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759464.398184:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211948800:12345-0@lo:103:ldlm_bl.0 Request processed in 591us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759464.398191:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1782759464.399036:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211948800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759464.556062:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759464.876076:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211948928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759464.876145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759464.876197:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211948928 00000100:00100000:0.0:1782759464.876206:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211948928 00000100:00080000:3.0:1782759464.876248:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759464.876262:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1782759464.876274:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211948928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759464.876308:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759464.876351:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211948928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759464.876359:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1782759464.876386:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967405 gen 2 00000004:00080000:3.0:1782759464.876392:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917084c64a80, transno 4294967405 00000100:00100000:3.0:1782759464.876416:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211948928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759465.580971:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759465.641370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.641460:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197261184 00000100:00100000:1.0:1782759465.641470:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197261184 00000100:00080000:3.0:1782759465.641515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759465.641543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2037 00000100:00100000:1.0:1782759465.641562:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99966:x1869355197261184:12345-192.168.204.31@tcp:53:lfs.0 00000004:00000080:1.0:1782759465.641591:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000418:0xa:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782759465.641707:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99966:x1869355197261184:12345-192.168.204.31@tcp:53:lfs.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.641715:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2037 00000100:00100000:0.0:1782759465.645586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.645631:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197261440 00000100:00100000:1.0:1782759465.645649:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197261440 00000100:00100000:1.0:1782759465.645696:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2038 00000100:00100000:1.0:1782759465.645707:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:99154:x1869355197261440:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:1.0:1782759465.645988:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759465.646010:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777df6c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e4e expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759465.646237:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782759465.646467:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777df6c0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e4e expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.646483:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759465.646486:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759465.646491:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777df6c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e4e expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.646504:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782759465.646549:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:99154:x1869355197261440:12345-192.168.204.31@tcp:101:bash.0 Request processed in 845us (970us total) trans 4294968040 rc 301/301 00000100:00100000:1.0:1782759465.646554:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2038 00000100:00100000:0.0:1782759465.648118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759465.648278:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197261696 00000100:00100000:3.0:1782759465.648287:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197261696 00000100:00100000:3.0:1782759465.648337:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 256 00000100:00100000:3.0:1782759465.648346:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:99154:x1869355197261696:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:3.0:1782759465.648857:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99154:x1869355197261696:12345-192.168.204.31@tcp:35:bash.0 Request processed in 475us (707us total) trans 4294968041 rc 0/0 00000100:00100000:3.0:1782759465.648866:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 256 00000100:00100000:3.0:1782759465.654094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.654130:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197261952 00000100:00100000:1.0:1782759465.654145:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197261952 00000100:00100000:1.0:1782759465.654204:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2039 00000100:00100000:1.0:1782759465.654215:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:99967:x1869355197261952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759465.654315:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759465.654340:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df6ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e55 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.654452:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df6d5 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.654465:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.654478:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759465.654490:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xa:0x0]: returning size 0 00010000:00010000:1.0:1782759465.654621:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df6ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e55 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.654641:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e55 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.654650:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759465.654653:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759465.654656:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759465.654710:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99967:x1869355197261952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 498us (623us total) trans 4294968042 rc 0/0 00000100:00100000:1.0:1782759465.654718:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2039 00000100:00100000:1.0:1782759465.657598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759465.657745:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197262080 00000100:00100000:3.0:1782759465.657754:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197262080 00000100:00100000:1.0:1782759465.657801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.657858:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197262208 00000100:00100000:1.0:1782759465.657862:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197262208 00000100:00100000:3.0:1782759465.657873:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 181 00000100:00100000:3.0:1782759465.657882:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2363:x1869355197262080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782759465.657896:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 999 00010000:00010000:3.0:1782759465.657897:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782759465.657903:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197262208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1782759465.657916:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759465.657926:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df6d5 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e55 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.657930:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e5c expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759465.657940:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff9171889c5100) 00010000:00010000:3.0:1782759465.657950:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1782759465.657952:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x6a42c027, atime: 0x6a42c027, ctime: 0x6a42c027, blocks: 0x1 00010000:00010000:1.0:1782759465.657966:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=3534s v=(0 0) 00010000:00010000:1.0:1782759465.657970:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759465.657977:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759465.657993:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:2363:x1869355197262080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (401us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759465.657993:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759465.658001:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 181 00010000:00010000:1.0:1782759465.658005:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5600, rc 0) 00000100:00100000:1.0:1782759465.658025:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197262208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 123us (225us total) trans 0 rc 0/0 00000100:00080000:3.0:1782759465.658026:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759465.658030:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 999 00000100:00100000:1.0:1782759465.662008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759465.662064:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197262336 00000100:00100000:3.0:1782759465.662074:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197262336 00002000:00100000:3.0:1782759465.662115:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31:0x0] (0->4095) req@ffff9171b3180000 x1869355197262336/t0(0) o3->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:626/0 lens 488/0 e 0 to 0 dl 1782759476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759465.662123:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b3180000 with x1869355197262336 ext(0->4095) 00002000:00010000:3.0:1782759465.662128:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171b3180000 00000100:00100000:3.0:1782759465.662152:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:3.0:1782759465.662161:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197262336:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1782759465.662473:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197262336:12345-192.168.204.31@tcp:3:cat.0 Request processed in 312us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759465.662480:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00002000:00100000:3.0:1782759465.662486:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x31:0x0] (0->4095) req@ffff9171b3180000 x1869355197262336/t0(0) o3->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:626/0 lens 488/440 e 0 to 0 dl 1782759476 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759465.662495:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9171b3180000 with x1869355197262336 ext(0->4095) 00002000:00010000:3.0:1782759465.662499:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9171b3180000 00000100:00100000:3.0:1782759465.664960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759465.665019:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197262592 00000100:00100000:0.0:1782759465.665027:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197262592 00000100:00100000:0.0:1782759465.665105:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 257 00000100:00100000:0.0:1782759465.665116:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:99967:x1869355197262592:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1782759465.665445:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99967:x1869355197262592:12345-192.168.204.31@tcp:35:cat.0 Request processed in 331us (490us total) trans 4294968043 rc 0/0 00000100:00100000:0.0:1782759465.665453:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 257 00000100:00100000:1.0:1782759465.679212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759465.679265:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197262720 00000100:00100000:0.0:1782759465.679276:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197262720 00000100:00100000:0.0:1782759465.679337:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2040 00000100:00100000:0.0:1782759465.679348:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:99968:x1869355197262720:12345-192.168.204.31@tcp:62:lfs.0 00010000:00010000:0.0:1782759465.679465:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679481:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679507:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679522:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679529:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679536:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679645:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 3/0,1 mode: --/EX res: [0x200000418:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679654:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.679670:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759465.680407:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].52, 64 off11640 00000004:00080000:0.0:1782759465.680418:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3534083594616ns, next at 3535083592322ns, rc = 0 00010000:00010000:0.0:1782759465.680470:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680478:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680485:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680500:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759465.680505:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680513:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680526:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xa:0x0].0x0 (ffff917183a70500) 00010000:00010000:0.0:1782759465.680529:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759465.680533:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 2/0,0 mode: --/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680538:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df6f8 lrc: 0/0,0 mode: --/EX res: [0x200000418:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680555:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680562:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680568:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680573:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759465.680576:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680582:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680602:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759465.680604:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759465.680608:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680614:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df6ea lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680627:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680633:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680639:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680644:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759465.680647:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680653:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680660:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff917183a70700) 00010000:00010000:0.0:1782759465.680662:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759465.680665:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.680671:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df6f1 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759465.680765:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99968:x1869355197262720:12345-192.168.204.31@tcp:62:lfs.0 Request processed in 1418us (1561us total) trans 4294968044 rc 0/0 00000100:00100000:0.0:1782759465.680774:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2040 00000100:00100000:0.0:1782759465.688231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.688280:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197262976 00000100:00100000:1.0:1782759465.688305:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197262976 00000100:00100000:1.0:1782759465.688362:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2041 00000100:00100000:1.0:1782759465.688371:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99969:x1869355197262976:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759465.688394:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759465.688416:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df6ff lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e63 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.688586:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df6ff lrc: 1/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e63 expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.688599:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:1.0:1782759465.688602:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759465.688607:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df6ff lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e63 expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.688624:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782759465.688680:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99969:x1869355197262976:12345-192.168.204.31@tcp:101:touch.0 Request processed in 311us (468us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759465.688686:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2041 00000100:00100000:3.0:1782759465.690289:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.690572:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197263232 00000100:00100000:1.0:1782759465.690581:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197263232 00000100:00100000:1.0:1782759465.690627:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2042 00000100:00100000:1.0:1782759465.690635:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:99969:x1869355197263232:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759465.690652:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759465.690669:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df706 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e6a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.690787:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 3/0,1 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.690800:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.690812:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.690869:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.690878:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.690887:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759465.691358:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31:0x0], index 1: 0 00010000:00010000:1.0:1782759465.691513:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777df71b lrc: 3/1,0 mode: --/PR res: [0x200000418:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691523:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777df71b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691534:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777df71b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691568:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691585:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691592:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691598:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759465.691602:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691610:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691622:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759465.691625:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759465.691630:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 2/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691636:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df70d lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759465.691649:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed7397cd reply state 0000000037c03a2b transno 4294968045 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759465.691658:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759465.691684:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df706 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e6a expref: 16 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691703:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777df71b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e6a expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.691721:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff9171889c5600) 00010000:00010000:1.0:1782759465.691724:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759465.691726:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759465.691903:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99969:x1869355197263232:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1267us (1618us total) trans 4294968045 rc 0/0 00000100:00100000:1.0:1782759465.691911:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2042 00000100:00100000:3.0:1782759465.694152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759465.694237:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197263488 00000100:00100000:0.0:1782759465.694244:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197263488 00000100:00100000:0.0:1782759465.694553:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2043 00000100:00100000:0.0:1782759465.694564:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99969:x1869355197263488:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782759465.694608:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759465.694630:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777df71b lrc: 0/0,0 mode: --/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e6a expref: 16 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.694644:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff9171889c5600) 00010000:00010000:0.0:1782759465.694653:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759465.694689:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.694701:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.694711:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694714:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694732:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694739:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694745:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759465.694762:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694770:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694778:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171889c5a00) 00010000:00010000:2.0:1782759465.694782:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759465.694795:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.694802:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777df714 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759465.694853:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000feff6374 reply state 0000000023ebe795 transno 4294968046 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759465.694862:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759465.694939:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99969:x1869355197263488:12345-192.168.204.31@tcp:36:touch.0 Request processed in 376us (794us total) trans 4294968046 rc 0/0 00000100:00100000:0.0:1782759465.694964:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2043 00010000:00010000:1.0:1782759465.695878:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.695893:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.695901:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.695907:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759465.695911:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.695917:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.695927:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff917183a70700) 00010000:00010000:1.0:1782759465.695930:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759465.695933:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.695939:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df729 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759465.696924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.696957:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197263616 00000100:00100000:1.0:1782759465.696963:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197263616 00000100:00100000:1.0:1782759465.697014:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2044 00000100:00100000:1.0:1782759465.697023:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:99969:x1869355197263616:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759465.697042:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759465.697073:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777df730 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e71 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.697125:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777df730 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e71 expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.697139:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777df730 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e71 expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.697157:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759465.697161:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759465.697163:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759465.697219:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99969:x1869355197263616:12345-192.168.204.31@tcp:101:touch.0 Request processed in 197us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.697225:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2044 00000100:00100000:0.0:1782759465.698521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759465.698575:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197263744 00000100:00100000:3.0:1782759465.698580:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197263744 00000100:00100000:3.0:1782759465.698623:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1000 00000100:00100000:3.0:1782759465.698629:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197263744:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:0.0:1782759465.698632:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759465.698965:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197263744:12345-192.168.204.31@tcp:2:touch.0 Request processed in 335us (445us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1782759465.698970:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1000 00000100:00100000:0.0:1782759465.701126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759465.701189:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197264000 00000100:00100000:3.0:1782759465.701197:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197264000 00000100:00100000:3.0:1782759465.701237:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 258 00000100:00100000:3.0:1782759465.701243:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:99969:x1869355197264000:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759465.701566:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:99969:x1869355197264000:12345-192.168.204.31@tcp:35:touch.0 Request processed in 320us (444us total) trans 4294968047 rc 0/0 00000100:00100000:3.0:1782759465.701574:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 258 00000100:00100000:0.0:1782759465.711499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759465.711584:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197264128 00000100:00100000:1.0:1782759465.711595:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197264128 00000100:00100000:1.0:1782759465.711654:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2045 00000100:00100000:1.0:1782759465.711665:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:99970:x1869355197264128:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759465.711687:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759465.711711:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df737 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e78 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711799:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 3/1,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711813:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711856:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711879:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711887:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711894:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711980:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 3/1,0 mode: --/PR res: [0x200000418:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711989:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.711996:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759465.712030:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782759465.712034:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759465.712063:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712084:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712093:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712099:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712106:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712112:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759465.712115:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712123:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712134:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759465.712137:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759465.712141:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 2/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712146:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777df73e lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712159:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712164:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712178:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712182:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759465.712185:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712191:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712198:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x75c56fc0 (ffff9171889c5d00) 00010000:00010000:1.0:1782759465.712200:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759465.712202:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712207:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777df745 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712236:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777df737 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e78 expref: 19 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712251:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e78 expref: 18 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759465.712258:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759465.712260:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759465.712262:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782759465.712316:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:99970:x1869355197264128:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 654us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.712332:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2045 00000020:00000080:1.0:1782759466.088286:0:143841:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff81630340 20000000:00000080:1.0:1782759466.088303:0:143841:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317d800 uarg=0000000000000000 00010000:00010000:1.0:1782759466.088518:0:143841:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782759466.088549:0:143841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759466.088553:0:143841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759466.088562:0:143841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777df74c lrc: 0/0,0 mode: --/PR res: [0x200000418:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e78 expref: 17 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088577:0:143841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xb:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759466.088579:0:143841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759466.088581:0:143841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777df730 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e71 expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088593:0:143841:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 2 locks, left on hash table 0. 10000000:01000000:1.0:1782759466.088612:0:143841:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759466.088626:0:143841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088640:0:143841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088650:0:143841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088657:0:143841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088664:0:143841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088677:0:143841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088684:0:143841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759466.088688:0:143841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088697:0:143841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088707:0:143841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088714:0:143841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.088721:0:143841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df753 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759466.220131:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759466.220139:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759466.220144:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759466.220194:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.220206:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.220217:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759466.220243:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211949056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759466.220316:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759466.220387:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759466.220392:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949056 00000100:00100000:1.0:1782759466.220402:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949056 00000100:00100000:1.0:1782759466.220461:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:1.0:1782759466.220471:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211949056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759466.220485:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759466.220498:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df75a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.220522:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.220551:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.220561:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782759466.220611:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211949056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759466.220618:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:0.0:1782759466.220665:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211949056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759466.220680:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.220691:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759466.220712:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759466.220737:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.220745:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759466.425816:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968046 is committed 00000004:00080000:1.0:1782759466.425851:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 122 committed 00000001:00080000:1.0:1782759466.425892:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968047 is committed 00000100:00100000:3.0:1782759466.426135:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211949184:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782759466.426205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759466.426246:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949184 00000100:00100000:1.0:1782759466.426253:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949184 00000100:00100000:1.0:1782759466.426315:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00080000:2.0:1782759466.426326:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759466.426327:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211949184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782759466.426356:0:126932:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:49 count 1 00010000:00010000:1.0:1782759466.426381:0:126932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.426402:0:126932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.426411:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759466.426416:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759466.426419:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.426441:0:126932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.426464:0:126932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 6 pid: 6599 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759466.426475:0:126932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:126932:1869355211949312:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759466.426526:0:126932:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171878e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759466.428659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759466.428795:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197264256 00000100:00100000:2.0:1782759466.428803:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197264256 00010000:00010000:2.0:1782759466.428859:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 7 pid: 6599 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759466.428896:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 633 00000100:00100000:2.0:1782759466.428906:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197264256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759466.428920:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759466.428926:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 7 pid: 6599 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.428940:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 7 pid: 6599 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.428973:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759466.428977:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759466.428983:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.428993:0:134476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.429011:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759466.429067:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197264256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 161us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759466.429074:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 633 00010000:00010000:1.0:1782759466.429724:0:126932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893eb381/0xdd99f5c4777df6e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e5c expref: 6 pid: 6599 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759466.429738:0:126932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:126932:1869355211949312:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759466.429758:0:126932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.429769:0:126932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.429777:0:126932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.429787:0:126932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.429795:0:126932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759466.429860:0:126932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759466.430066:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759466.430074:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.430085:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759466.430090:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.430101:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.430117:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.430124:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029c1a895/0xdd99f5c4777df768 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.430146:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759466.430149:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759466.430151:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759466.430507:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211949184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4182us (4300us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1782759466.430516:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000004:00080000:3.0:1782759466.430532:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082715180/2, rc 0, transno 4294967407 00000100:00100000:3.0:1782759466.430541:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211949184:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782759466.604227:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759466.925796:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211949824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759466.925871:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211949440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759466.925884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759466.925900:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211949696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759466.925920:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211949568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759466.925925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759466.925955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759466.925966:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211949952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759466.925994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759466.926017:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949696 00000100:00100000:3.0:1782759466.926023:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949696 00000100:00100000:1.0:1782759466.926045:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949824 00000100:00100000:1.0:1782759466.926051:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949824 00000100:00100000:3.0:1782759466.926096:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949952 00000100:00100000:1.0:1782759466.926099:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1782759466.926102:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949952 00000100:00100000:1.0:1782759466.926109:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211949824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759466.926136:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1782759466.926145:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211949696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759466.926168:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211949824:12345-0@lo:400:kworker.0 Request processed in 59us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759466.926177:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1782759466.926190:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211949696:12345-0@lo:400:kworker.0 Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759466.926196:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:1.0:1782759466.926206:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949440 00000100:00100000:1.0:1782759466.926211:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949440 00000100:00100000:3.0:1782759466.926212:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1782759466.926219:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211949952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759466.926243:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:1.0:1782759466.926253:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211949440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759466.926260:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211949952:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759466.926268:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1782759466.926273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759466.926287:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211949440:12345-0@lo:400:kworker.0 Request processed in 37us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759466.926295:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1782759466.926296:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211949568 00000100:00100000:3.0:1782759466.926301:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211949568 00000100:00100000:0.0:1782759466.926303:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211950080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759466.926330:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1782759466.926334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759466.926343:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211949568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759466.926365:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211949824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759466.926370:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950080 00000100:00100000:0.0:1782759466.926373:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950080 00000100:00100000:3.0:1782759466.926390:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211949568:12345-0@lo:400:kworker.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759466.926397:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1782759466.926405:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:0.0:1782759466.926414:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211950080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759466.926420:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759466.926427:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759466.926448:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211950080:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759466.926455:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1782759466.926460:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211949440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759466.926477:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211949952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759466.926488:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211949568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759466.926505:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967396 gen 2 00000004:00080000:0.0:1782759466.926509:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7765c00, transno 4294967396 00000100:00100000:3.0:1782759466.926520:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211949696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759466.926524:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211950080:0@lo:400:kworker.0 00000001:00080000:2.0:1782759466.943186:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967407 is committed 00000001:00080000:2.0:1782759466.943204:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967406 is committed 00000100:00100000:0.0:1782759467.361076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759467.361159:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197264384 00000100:00100000:2.0:1782759467.361171:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197264384 00000100:00100000:2.0:1782759467.361249:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2046 00000100:00100000:2.0:1782759467.361261:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:100043:x1869355197264384:12345-192.168.204.31@tcp:53:lfs.0 00000004:00000080:2.0:1782759467.361308:0:7487:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000418:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782759467.361448:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:100043:x1869355197264384:12345-192.168.204.31@tcp:53:lfs.0 Request processed in 188us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759467.361457:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2046 00000100:00080000:3.0:1782759467.362101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759467.365938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759467.366037:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197264640 00000100:00100000:3.0:1782759467.366064:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197264640 00000100:00100000:3.0:1782759467.366194:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2047 00000100:00100000:3.0:1782759467.366204:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:99154:x1869355197264640:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1782759467.366229:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759467.366265:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777df76f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e7f expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759467.366617:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1782759467.366918:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777df76f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e7f expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759467.366936:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759467.366939:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759467.366944:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777df76f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e7f expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759467.366963:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759467.367051:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:99154:x1869355197264640:12345-192.168.204.31@tcp:101:bash.0 Request processed in 847us (1122us total) trans 4294968048 rc 301/301 00000100:00100000:3.0:1782759467.367058:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2047 00000100:00100000:3.0:1782759467.368658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759467.368722:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197264896 00000100:00100000:1.0:1782759467.368733:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197264896 00000100:00100000:1.0:1782759467.369039:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 259 00000100:00100000:1.0:1782759467.369054:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:99154:x1869355197264896:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:1.0:1782759467.369482:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:99154:x1869355197264896:12345-192.168.204.31@tcp:35:bash.0 Request processed in 432us (829us total) trans 4294968049 rc 0/0 00000100:00100000:1.0:1782759467.369490:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 259 00000100:00100000:1.0:1782759467.376715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759467.376981:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265152 00000100:00100000:0.0:1782759467.376997:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265152 00000100:00100000:0.0:1782759467.377136:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2048 00000100:00100000:0.0:1782759467.377150:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:100044:x1869355197265152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1782759467.377175:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759467.377196:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777df77d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e86 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759467.377266:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777df77d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e86 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759467.377281:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759467.377295:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759467.377303:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777df77d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e86 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759467.377323:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759467.377457:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:100044:x1869355197265152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 311us (753us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759467.377464:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2048 00000100:00100000:3.0:1782759467.387589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759467.387660:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265280 00000100:00100000:2.0:1782759467.387683:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265280 00000100:00100000:2.0:1782759467.387750:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2049 00000100:00100000:2.0:1782759467.387759:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:100045:x1869355197265280:12345-192.168.204.31@tcp:62:lfs.0 00000100:00100000:2.0:1782759467.387922:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:100045:x1869355197265280:12345-192.168.204.31@tcp:62:lfs.0 Request processed in 164us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759467.387927:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2049 00000100:00100000:1.0:1782759467.436313:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759467.436348:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211950208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759467.436429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759467.436618:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950208 00000100:00100000:3.0:1782759467.436631:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950208 00000100:00100000:3.0:1782759467.436692:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1782759467.436699:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb528850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211950208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759467.436742:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759467.436848:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb528850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211950208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759467.436854:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1782759467.436950:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211950208:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759467.628046:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759468.652019:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759468.728846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759468.728890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759468.728914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759468.728917:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265408 00000100:00100000:2.0:1782759468.728929:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265408 00000100:00100000:1.0:1782759468.728930:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265664 00000100:00100000:1.0:1782759468.728937:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265664 00000100:00100000:3.0:1782759468.728986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759468.729013:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2794 00000100:00100000:2.0:1782759468.729028:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197265408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759468.729028:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265792 00000100:00100000:3.0:1782759468.729032:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265536 00000100:00100000:1.0:1782759468.729033:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265792 00000100:00100000:3.0:1782759468.729040:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265536 00000100:00100000:1.0:1782759468.729070:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1986 00000100:00100000:1.0:1782759468.729081:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b47c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197265664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759468.729088:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2535 00000100:00100000:2.0:1782759468.729115:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197265408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.729121:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b47c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197265664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759468.729130:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2794 00000100:00100000:1.0:1782759468.729132:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1986 00000100:00100000:3.0:1782759468.729151:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197265536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759468.729195:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197265536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759468.729204:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2535 00000100:00100000:0.0:1782759468.729290:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1987 00000100:00080000:2.0:1782759468.729297:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759468.729303:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759468.729304:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197265792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759468.729356:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197265792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759468.729364:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1987 00000001:00080000:3.0:1782759469.504033:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967397 is committed 00010000:00010000:0.0:1782759469.675937:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759469.866085:0:144185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb108e230 20000000:00000080:1.0:1782759469.866101:0:144185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317e800 uarg=0000000000000000 00010000:00010000:1.0:1782759469.866424:0:144185:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759469.866439:0:144185:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759469.866464:0:144185:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759469.866481:0:144185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.866496:0:144185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.866504:0:144185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.866542:0:144185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.866556:0:144185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 18 pid: 5796 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759469.866570:0:144185:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144185:1869355211950336:0@lo:104: 00000100:00100000:1.0:1782759469.866629:0:144185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759469.866730:0:144185:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759469.866775:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950336 00000100:00100000:3.0:1782759469.866783:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950336 00000100:00100000:3.0:1782759469.866943:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1782759469.866955:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:144185:x1869355211950336:12345-0@lo:104: 00010000:00010000:3.0:1782759469.866979:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.867055:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759469.867061:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:144185:x1869355211950336:12345-0@lo:104: Request processed in 110us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759469.867069:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00010000:00010000:2.0:1782759469.867088:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759469.867097:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867106:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759469.867110:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867119:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759469.867127:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759469.867143:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1782759469.867144:0:144185:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144185:1869355211950336:0@lo:104: 00010000:00010000:1.0:1782759469.867165:0:144185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867177:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867185:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759469.867216:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867223:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df75a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df761 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867238:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759469.867240:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759469.867241:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759469.867256:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211950464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759469.867288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759469.867341:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950464 00000100:00100000:2.0:1782759469.867346:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950464 00010000:00010000:2.0:1782759469.867367:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 19 pid: 5796 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759469.867392:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1782759469.867399:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211950464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759469.867410:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759469.867415:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 19 pid: 5796 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867425:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 19 pid: 5796 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867436:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777df761 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df75a expref: 19 pid: 5796 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867453:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867460:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867472:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867479:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867485:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867491:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867496:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759469.867500:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867507:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867526:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.867536:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759469.867565:0:144185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759469.867576:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211950464:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (287us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759469.867579:0:144185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759469.867598:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00010000:00010000:1.0:1782759469.867609:0:144185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777df784 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759469.867620:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211950464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759469.996187:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211950592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759469.996256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759469.996303:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950592 00000100:00100000:0.0:1782759469.996312:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950592 00000100:00100000:0.0:1782759469.996384:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:0.0:1782759469.996395:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211950592:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759469.996432:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782759469.996432:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759469.996486:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211950592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759469.996494:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1782759469.996747:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967407 gen 2 00000004:00080000:2.0:1782759469.996752:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082715180, transno 4294967407 00000100:00100000:2.0:1782759469.996784:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211950592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759470.700923:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759471.557426:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968049 is committed 10000000:01000000:3.0:1782759471.723899:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759471.723906:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 00010000:00010000:0.0:1782759471.723909:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759471.723911:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759471.723968:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759471.723979:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759471.723990:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759471.724014:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211950720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759471.724083:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759471.724128:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170827483c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759471.724163:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950720 00000100:00100000:1.0:1782759471.724170:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950720 00000100:00100000:1.0:1782759471.724213:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1782759471.724221:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211950720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759471.724237:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759471.724251:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df78b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759471.724274:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759471.724285:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759471.724293:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759471.724483:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211950720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759471.724486:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211950720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759471.724494:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00010000:00010000:3.0:1782759471.724506:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759471.724516:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759471.724534:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759471.724538:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759471.724546:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759471.901952:0:144429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc07a87b60 20000000:00000080:2.0:1782759471.902036:0:144429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7a90400 uarg=0000000000000000 00010000:00010000:2.0:1782759471.902502:0:144429:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759471.902518:0:144429:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759471.902534:0:144429:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759471.902552:0:144429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759471.902567:0:144429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759471.902577:0:144429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759471.902612:0:144429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759471.902627:0:144429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 18 pid: 5796 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759471.902653:0:144429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144429:1869355211950848:0@lo:104: 00000100:00100000:2.0:1782759471.902710:0:144429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759471.902851:0:144429:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759471.902920:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950848 00000100:00100000:1.0:1782759471.902936:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950848 00000100:00100000:1.0:1782759471.903094:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1782759471.903105:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:144429:x1869355211950848:12345-0@lo:104: 00010000:00010000:1.0:1782759471.903118:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759471.903198:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759471.903205:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:144429:x1869355211950848:12345-0@lo:104: Request processed in 102us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759471.903211:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1782759471.903298:0:144429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144429:1869355211950848:0@lo:104: 00010000:00010000:3.0:1782759471.903316:0:144429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904018:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759471.904027:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904059:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759471.904063:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904072:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759471.904079:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759471.904085:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759471.904127:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904134:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759471.904162:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904169:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777df78b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df792 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904184:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759471.904186:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759471.904188:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759471.904250:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759471.904260:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211950976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759471.904293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759471.904339:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211950976 00000100:00100000:0.0:1782759471.904344:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211950976 00010000:00010000:0.0:1782759471.904367:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 19 pid: 5796 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759471.904444:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1782759471.904461:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211950976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759471.904485:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759471.904491:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 19 pid: 5796 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904502:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 19 pid: 5796 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904515:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5400/0xdd99f5c4777df792 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df78b expref: 19 pid: 5796 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904527:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904536:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904552:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904565:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904572:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904578:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904583:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759471.904587:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904600:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904621:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759471.904631:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759471.904681:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211950976:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759471.904687:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1782759471.904721:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211950976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759471.904748:0:144429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759471.904758:0:144429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759471.904764:0:144429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65c00/0xdd99f5c4777df799 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759472.044253:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211951104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759472.044331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759472.044373:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951104 00000100:00100000:3.0:1782759472.044383:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951104 00000100:00100000:3.0:1782759472.044434:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:3.0:1782759472.044443:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211951104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759472.044523:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211951488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759472.044555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759472.044594:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951488 00000100:00100000:0.0:1782759472.044599:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951488 00000100:00100000:0.0:1782759472.044634:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1782759472.044640:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211951488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759472.044692:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211951360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759472.044700:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211951488:12345-0@lo:400:kworker.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759472.044708:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:3.0:1782759472.044719:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211951104:12345-0@lo:400:kworker.0 Request processed in 274us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759472.044727:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1782759472.044740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759472.044757:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211951488:0@lo:400:kworker.0 00000100:00100000:2.0:1782759472.044782:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759472.044791:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211951232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759472.044817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759472.044870:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951232 00000100:00100000:3.0:1782759472.044875:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951232 00000100:00080000:2.0:1782759472.044885:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759472.044902:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951360 00000100:00100000:2.0:1782759472.044907:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951360 00000100:00100000:3.0:1782759472.044908:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1782759472.044915:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211951232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759472.044974:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211951232:12345-0@lo:400:kworker.0 Request processed in 58us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759472.044982:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1782759472.044985:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1782759472.044995:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211951360:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759472.045028:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759472.045040:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211951360:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759472.045049:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1782759472.045055:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211951104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759472.045087:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211951232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759472.045286:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211951360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759472.047191:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759472.047206:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211951616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759472.047259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759472.047305:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951616 00000100:00100000:1.0:1782759472.047313:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951616 00000100:00100000:1.0:1782759472.047379:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:1.0:1782759472.047397:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211951616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759472.047462:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211951616:12345-0@lo:400:kworker.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759472.047470:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00080000:3.0:1782759472.047481:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759472.047518:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211951616:0@lo:400:kworker.0 00000020:00000080:2.0:1782759472.299335:0:144478:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc784b3d00 20000000:00000080:2.0:1782759472.299350:0:144478:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928e800 uarg=0000000000000000 00010000:00010000:2.0:1782759472.299561:0:144478:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759472.299577:0:144478:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759472.299603:0:144478:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759472.299623:0:144478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299636:0:144478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299646:0:144478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299653:0:144478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299660:0:144478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299667:0:144478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299673:0:144478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759472.299677:0:144478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299685:0:144478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299697:0:144478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299704:0:144478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.299719:0:144478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df7a0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759472.555986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759472.556007:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211951744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759472.556076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759472.557788:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951744 00000100:00100000:1.0:1782759472.557799:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951744 00000100:00100000:1.0:1782759472.557859:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1782759472.557870:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211951744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759472.557905:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759472.557979:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211951744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759472.557987:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1782759472.558026:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211951744:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759472.718344:0:144526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc426b710 20000000:00000080:2.0:1782759472.718362:0:144526:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928e800 uarg=0000000000000000 00010000:00010000:2.0:1782759472.718577:0:144526:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759472.718592:0:144526:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759472.718609:0:144526:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759472.718628:0:144526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718643:0:144526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718654:0:144526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718661:0:144526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718667:0:144526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718673:0:144526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718680:0:144526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759472.718684:0:144526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718699:0:144526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718711:0:144526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718719:0:144526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.718725:0:144526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777df7a7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.747959:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759473.451976:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759473.451986:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759473.451992:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759473.452038:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.452050:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.452061:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759473.452085:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211951872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759473.452144:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759473.452200:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759473.452536:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211951872 00000100:00100000:2.0:1782759473.452544:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211951872 00000100:00100000:2.0:1782759473.452593:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:2.0:1782759473.452602:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211951872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759473.452615:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759473.452628:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df7ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.452651:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.452662:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.452675:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64c00, rc 0) 00000100:00100000:2.0:1782759473.452724:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211951872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759473.452739:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1782759473.453326:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211951872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759473.453353:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759473.453363:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759473.453384:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759473.453389:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759473.453397:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759473.774075:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759473.843741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759473.843792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759473.843819:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266048 00000100:00100000:1.0:1782759473.843851:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197265920 00000100:00100000:1.0:1782759473.843857:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197265920 00000100:00100000:0.0:1782759473.843858:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266048 00000100:00100000:3.0:1782759473.843863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759473.843920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759473.843951:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266304 00000100:00100000:0.0:1782759473.843958:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2539 00000100:00100000:2.0:1782759473.843965:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266304 00000100:00100000:0.0:1782759473.843974:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197266048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759473.843980:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2797 00000100:00100000:1.0:1782759473.843994:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197265920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759473.843997:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266176 00000100:00100000:3.0:1782759473.844004:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266176 00000100:00100000:2.0:1782759473.844050:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1990 00000100:00100000:2.0:1782759473.844068:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197266304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759473.844069:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1991 00000100:00100000:1.0:1782759473.844084:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197265920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759473.844085:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197266048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759473.844092:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197266176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759473.844103:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2539 00000100:00100000:1.0:1782759473.844109:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2797 00000100:00080000:0.0:1782759473.844135:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759473.844142:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759473.844147:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759473.844165:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197266304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759473.844166:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197266176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759473.844201:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1990 00000100:00100000:3.0:1782759473.844212:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1991 00010000:00010000:1.0:1782759474.795985:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759474.900316:0:144721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64e: Nodemap enforces chlg_ops RBAC roles ========================================================== 14:57:53 (1782759473) 00000100:00100000:3.0:1782759474.958897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759474.958955:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266560 00000100:00100000:0.0:1782759474.958971:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266560 00000100:00100000:0.0:1782759474.959050:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2050 00000100:00100000:0.0:1782759474.959067:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:100792:x1869355197266560:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759474.959166:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759474.959172:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777df45f) 00010000:00010000:0.0:1782759474.959175:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759474.959558:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.959578:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.959594:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.959610:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.959617:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.959624:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759474.961009:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xc:0x0]: returning size 512 00010000:00010000:0.0:1782759474.961026:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.961037:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.961046:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.961055:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759474.961069:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.961079:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.961099:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70200) 00010000:00010000:0.0:1782759474.961103:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759474.961109:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759474.961117:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df7bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759474.961219:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020698eb3 reply state 00000000011f07ab transno 4294968050 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759474.961231:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759474.961359:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:100792:x1869355197266560:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2294us (2468us total) trans 4294968050 rc 0/0 00000100:00100000:0.0:1782759474.961370:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2050 00010000:00010000:3.0:1782759474.963225:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759474.963241:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759474.963249:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759474.963256:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759474.963261:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759474.963269:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759474.963285:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc65a5b3 (ffff917183a70c00) 00010000:00010000:3.0:1782759474.963289:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759474.963293:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759474.963385:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df7c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759475.116464:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211952000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759475.116548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759475.116651:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952000 00000100:00100000:0.0:1782759475.116660:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952000 00000100:00080000:3.0:1782759475.116785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759475.117629:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1782759475.117642:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211952000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759475.117693:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759475.117761:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211952000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759475.117770:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1782759475.117801:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211952000:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759475.820757:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759476.587493:0:144917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee3ad0110 20000000:00000080:2.0:1782759476.587509:0:144917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc1800 uarg=0000000000000000 10000000:01000000:2.0:1782759476.587701:0:144917:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759476.587717:0:144917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.587730:0:144917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.587736:0:144917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.587766:0:144917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.587776:0:144917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 18 pid: 5794 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759476.587797:0:144917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144917:1869355211952128:0@lo:104: 00000100:00100000:2.0:1782759476.587888:0:144917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759476.588027:0:144917:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759476.588067:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952128 00000100:00100000:0.0:1782759476.588080:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952128 00000100:00100000:0.0:1782759476.588124:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1782759476.588133:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:144917:x1869355211952128:12345-0@lo:104: 00010000:00010000:0.0:1782759476.588142:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759476.588205:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759476.588211:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:144917:x1869355211952128:12345-0@lo:104: Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759476.588218:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1782759476.588223:0:144917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144917:1869355211952128:0@lo:104: 00010000:00010000:2.0:1782759476.588239:0:144917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588275:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759476.588282:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588288:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759476.588291:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588296:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759476.588301:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759476.588304:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759476.588359:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588366:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759476.588424:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782759476.588445:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588453:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777df7ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df7b5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588466:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759476.588468:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759476.588470:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759476.588532:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211952256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759476.588566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759476.588649:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952256 00000100:00100000:1.0:1782759476.588654:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952256 00010000:00010000:1.0:1782759476.588673:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 19 pid: 5794 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759476.588731:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1782759476.588738:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211952256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759476.588748:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759476.588753:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 19 pid: 5794 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588761:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 19 pid: 5794 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588772:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df7ae expref: 19 pid: 5794 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588784:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588791:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588804:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588811:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588819:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588877:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588883:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759476.588886:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.588894:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.589052:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.589061:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759476.589079:0:144917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.589087:0:144917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.589094:0:144917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777df7ca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759476.589134:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211952256:12345-0@lo:103:ldlm_bl.0 Request processed in 396us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759476.589141:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1782759476.589252:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211952256:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1782759476.671633:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968050 is committed 00010000:00010000:2.0:1782759476.844164:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759476.983379:0:144968:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffec236fd0 20000000:00000080:3.0:1782759476.983396:0:144968:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082ca9400 uarg=0000000000000000 10000000:01000000:3.0:1782759476.983935:0:144968:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759476.983957:0:144968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.983973:0:144968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.983984:0:144968:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.983991:0:144968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.983997:0:144968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.984005:0:144968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.984012:0:144968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759476.984022:0:144968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.984030:0:144968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.984047:0:144968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.984055:0:144968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.984061:0:144968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777df7d1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759477.164109:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211952384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759477.164182:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211952512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759477.164204:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211952640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.164285:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211952768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759477.164322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759477.164378:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759477.164384:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211953024:0@lo:400:kworker.0 00000100:00100000:1.0:1782759477.164400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759477.164423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759477.164443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759477.164452:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952640 00000100:00100000:1.0:1782759477.164459:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952640 00000100:00100000:0.0:1782759477.164479:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211952896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.164488:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952384 00000100:00100000:3.0:1782759477.164494:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952384 00000100:00100000:0.0:1782759477.164517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759477.164540:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1782759477.164540:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952512 00000100:00100000:1.0:1782759477.164544:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952512 00000100:00100000:3.0:1782759477.164551:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211952384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759477.164572:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952896 00000100:00100000:1.0:1782759477.164577:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1782759477.164579:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952896 00000100:00100000:1.0:1782759477.164587:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211952640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.164609:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211952384:12345-0@lo:400:kworker.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759477.164617:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:3.0:1782759477.164621:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1782759477.164623:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211952640:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759477.164632:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1782759477.164633:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211952512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.164657:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211952768 00000100:00100000:1.0:1782759477.164659:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:3.0:1782759477.164661:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211952768 00000100:00100000:1.0:1782759477.164666:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211952896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759477.164687:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211952512:12345-0@lo:400:kworker.0 Request processed in 59us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759477.164692:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1782759477.164698:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211952896:12345-0@lo:400:kworker.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759477.164700:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:3.0:1782759477.164702:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211952768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759477.164708:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:3.0:1782759477.164736:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211952768:12345-0@lo:400:kworker.0 Request processed in 36us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759477.164747:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1782759477.164754:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211952512:0@lo:400:kworker.0 00000100:00080000:0.0:1782759477.164764:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759477.164771:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759477.164779:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211952768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.164813:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211952896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.164851:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211952384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759477.164928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759477.164960:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211952640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759477.164963:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953024 00000100:00100000:0.0:1782759477.164969:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953024 00000100:00080000:3.0:1782759477.165496:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759477.165521:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1782759477.165539:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211953024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759477.165588:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211953024:12345-0@lo:400:kworker.0 Request processed in 51us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759477.165595:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1782759477.165620:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211953024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759477.675994:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211953152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759477.676074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759477.676114:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953152 00000100:00100000:0.0:1782759477.676124:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953152 00000100:00100000:0.0:1782759477.676184:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1782759477.676194:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211953152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759477.676245:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759477.676301:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211953152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759477.676310:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1782759477.676444:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211953152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759477.867963:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759477.871163:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759477.871169:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759477.871173:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759477.871219:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.871231:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.871243:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759477.871270:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211953280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759477.871335:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759477.871435:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953280 00000100:00100000:2.0:1782759477.871448:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953280 00000100:00100000:2.0:1782759477.871489:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759477.871497:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211953280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759477.871509:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759477.871521:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df7d8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759477.871544:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759477.871554:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759477.871564:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64c00, rc 0) 00000100:00100000:2.0:1782759477.871597:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211953280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759477.871605:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1782759477.871661:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759477.871682:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211953280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759477.871696:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.871710:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759477.871728:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759477.871734:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.871741:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759478.463695:0:145115:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdae5b7610 20000000:00000080:1.0:1782759478.463714:0:145115:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b317d000 uarg=0000000000000000 10000000:01000000:1.0:1782759478.464099:0:145115:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759478.464118:0:145115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.464136:0:145115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.464145:0:145115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.464181:0:145115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.464195:0:145115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 18 pid: 5794 timeout: 3646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759478.464210:0:145115:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145115:1869355211953408:0@lo:104: 00000100:00100000:1.0:1782759478.464273:0:145115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759478.464384:0:145115:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759478.464390:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953408 00000100:00100000:2.0:1782759478.464399:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953408 00000100:00100000:2.0:1782759478.464462:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1782759478.464474:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145115:x1869355211953408:12345-0@lo:104: 00010000:00010000:2.0:1782759478.464487:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.464560:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759478.464566:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145115:x1869355211953408:12345-0@lo:104: Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759478.464573:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1782759478.464607:0:145115:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145115:1869355211953408:0@lo:104: 00010000:00010000:1.0:1782759478.464630:0:145115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.464681:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759478.464688:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.464696:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759478.464700:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.464709:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759478.464716:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759478.464722:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759478.464757:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.464768:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759478.464855:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211953536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759478.464886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759478.464966:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.464974:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df7df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.464989:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759478.464990:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759478.464992:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759478.465043:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953536 00000100:00100000:2.0:1782759478.465054:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953536 00010000:00010000:2.0:1782759478.465071:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 19 pid: 5794 timeout: 3646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759478.465098:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1782759478.465105:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211953536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759478.465115:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759478.465121:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 19 pid: 5794 timeout: 3646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465131:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 19 pid: 5794 timeout: 3646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465145:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df7d8 expref: 19 pid: 5794 timeout: 3646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465156:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465164:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465175:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465181:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465186:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465192:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465202:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759478.465206:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465213:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465233:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.465242:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759478.465307:0:145115:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.465314:0:145115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.465321:0:145115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777df7e6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759478.466133:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211953536:12345-0@lo:103:ldlm_bl.0 Request processed in 1025us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759478.466133:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211953536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759478.466147:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00010000:00010000:2.0:1782759478.891913:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759478.905668:0:145163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3c8460a0 20000000:00000080:2.0:1782759478.905686:0:145163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc0c00 uarg=0000000000000000 10000000:01000000:2.0:1782759478.906023:0:145163:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759478.906048:0:145163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906065:0:145163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906076:0:145163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906082:0:145163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906099:0:145163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906107:0:145163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906113:0:145163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759478.906118:0:145163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906126:0:145163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906140:0:145163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906148:0:145163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.906154:0:145163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777df7ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759478.970016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759478.970055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759478.970083:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266688 00000100:00100000:1.0:1782759478.970092:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266688 00000100:00100000:1.0:1782759478.970149:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2800 00000100:00100000:1.0:1782759478.970160:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197266688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759478.970216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759478.970226:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197266688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759478.970234:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2800 00000100:00100000:1.0:1782759478.970280:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266816 00000100:00100000:1.0:1782759478.970283:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266816 00000100:00100000:3.0:1782759478.970317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759478.970329:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2543 00000100:00100000:1.0:1782759478.970338:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197266816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759478.970351:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197267072 00000100:00100000:3.0:1782759478.970356:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197267072 00000100:00100000:1.0:1782759478.970379:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197266816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759478.970387:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2543 00000100:00100000:3.0:1782759478.970394:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197266944 00000100:00100000:3.0:1782759478.970399:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197266944 00000100:00100000:2.0:1782759478.970409:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1994 00000100:00100000:2.0:1782759478.970418:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197267072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759478.970431:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1995 00000100:00100000:3.0:1782759478.970442:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197266944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759478.970452:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197267072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759478.970459:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1994 00000100:00100000:3.0:1782759478.970477:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197266944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759478.970485:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1995 00000100:00080000:2.0:1782759478.970530:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759478.970540:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759478.970543:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782759479.298028:0:145211:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa562c460 20000000:00000080:1.0:1782759479.298047:0:145211:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081257c00 uarg=0000000000000000 10000000:01000000:1.0:1782759479.298271:0:145211:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759479.298294:0:145211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298317:0:145211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298328:0:145211:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298335:0:145211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298342:0:145211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298351:0:145211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298358:0:145211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759479.298362:0:145211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298369:0:145211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298381:0:145211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298389:0:145211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.298396:0:145211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777df7f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759479.596014:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759479.596023:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759479.596028:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759479.596084:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759479.596097:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759479.596135:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759479.596164:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211953664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759479.596247:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759479.596333:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759479.596353:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953664 00000100:00100000:0.0:1782759479.596363:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953664 00000100:00100000:0.0:1782759479.596419:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1782759479.596437:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211953664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759479.596452:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759479.596467:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df7fb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.596492:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.596515:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.596525:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98e00, rc 0) 00000100:00100000:0.0:1782759479.596577:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211953664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759479.596584:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:3.0:1782759479.596615:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211953664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759479.596633:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759479.596644:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759479.596663:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759479.596669:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759479.596677:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759479.674745:0:145259:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde336b420 20000000:00000080:2.0:1782759479.674762:0:145259:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfd9400 uarg=0000000000000000 10000000:01000000:2.0:1782759479.675206:0:145259:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759479.675226:0:145259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.675245:0:145259:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.675254:0:145259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.675291:0:145259:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.675305:0:145259:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 18 pid: 5793 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759479.675321:0:145259:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145259:1869355211953792:0@lo:104: 00000100:00100000:2.0:1782759479.675385:0:145259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759479.675484:0:145259:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759479.675536:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759479.675549:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953792 00000100:00100000:3.0:1782759479.675555:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953792 00000100:00100000:3.0:1782759479.675639:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1782759479.675649:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2363450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145259:x1869355211953792:12345-0@lo:104: 00010000:00010000:3.0:1782759479.675663:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759479.675740:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759479.675747:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2363450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145259:x1869355211953792:12345-0@lo:104: Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.675755:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00010000:00010000:1.0:1782759479.675852:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759479.675858:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.675866:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759479.675870:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.675880:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759479.675887:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759479.675893:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759479.675923:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.675930:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759479.675949:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.675956:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777df7fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df802 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.675970:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759479.675972:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759479.675974:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759479.675982:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759479.675999:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211953920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759479.676029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.676078:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211953920 00000100:00100000:1.0:1782759479.676082:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211953920 00010000:00010000:1.0:1782759479.676108:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 19 pid: 5793 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759479.676132:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1782759479.676140:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211953920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759479.676151:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759479.676156:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 19 pid: 5793 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676168:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 19 pid: 5793 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759479.676175:0:145259:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145259:1869355211953792:0@lo:104: 00010000:00010000:1.0:1782759479.676184:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98e00/0xdd99f5c4777df802 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df7fb expref: 19 pid: 5793 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.676196:0:145259:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676199:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676215:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676437:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.676439:0:145259:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676454:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.676469:0:145259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676474:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676491:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676499:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759479.676503:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676512:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676522:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676529:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64800/0xdd99f5c4777df809 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.676540:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759479.676622:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211953920:12345-0@lo:103:ldlm_bl.0 Request processed in 482us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.676629:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1782759479.676691:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211953920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759479.917994:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759480.075079:0:145307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc597423c0 20000000:00000080:3.0:1782759480.075098:0:145307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082caa000 uarg=0000000000000000 00010000:00010000:3.0:1782759480.075337:0:145307:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759480.075349:0:145307:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759480.075362:0:145307:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759480.075379:0:145307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075394:0:145307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075404:0:145307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075410:0:145307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075416:0:145307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075422:0:145307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075428:0:145307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759480.075431:0:145307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075445:0:145307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075457:0:145307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075465:0:145307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759480.075471:0:145307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777df810 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759480.236181:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759480.236205:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211954048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759480.236274:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759480.236314:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954048 00000100:00100000:1.0:1782759480.236322:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954048 00000100:00100000:1.0:1782759480.236377:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1782759480.236383:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211954048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759480.236412:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759480.236467:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211954048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759480.236471:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00080000:0.0:1782759480.236528:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759480.236872:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211954048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759480.940270:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759481.387878:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759481.387887:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759481.387892:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759481.387947:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759481.387960:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759481.387969:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759481.387993:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211954176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759481.388060:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759481.388117:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759481.388183:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954176 00000100:00100000:1.0:1782759481.388191:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954176 00000100:00100000:1.0:1782759481.388278:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:1.0:1782759481.388288:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211954176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759481.388301:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759481.388313:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df817 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759481.388333:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759481.388344:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759481.388353:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759481.388390:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211954176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759481.388396:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1782759481.388735:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211954176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759481.388761:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759481.388782:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759481.388802:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759481.388807:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759481.388814:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759481.964264:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782759482.161317:0:145552:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759482.161326:0:145552:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1782759482.161920:0:145552:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1782759482.161929:0:145552:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1782759482.284464:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211954304:0@lo:400:kworker.0 00000100:00100000:3.0:1782759482.284531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759482.284586:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211954816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759482.284592:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211954688:0@lo:400:kworker.0 00000100:00100000:3.0:1782759482.284614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759482.284639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759482.284658:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211954432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759482.284682:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211954560:0@lo:400:kworker.0 00000100:00100000:1.0:1782759482.284696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759482.284722:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211954944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759482.284756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759482.284798:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954688 00000100:00100000:1.0:1782759482.284806:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954688 00000100:00100000:0.0:1782759482.284841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759482.284858:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954816 00000100:00100000:3.0:1782759482.284863:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954816 00000100:00100000:0.0:1782759482.284879:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954432 00000100:00100000:0.0:1782759482.284885:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954432 00000100:00100000:1.0:1782759482.284913:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954944 00000100:00100000:2.0:1782759482.284917:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954304 00000100:00100000:1.0:1782759482.284919:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954944 00000100:00100000:2.0:1782759482.284923:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954304 00000100:00100000:0.0:1782759482.284926:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211954560 00000100:00100000:0.0:1782759482.284931:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211954560 00000100:00100000:2.0:1782759482.284961:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1782759482.284973:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211954304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759482.285021:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211954304:12345-0@lo:400:kworker.0 Request processed in 49us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759482.285027:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1782759482.285058:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1782759482.285065:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211954688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759482.285097:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211954688:12345-0@lo:400:kworker.0 Request processed in 33us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759482.285103:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1782759482.285236:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211954688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759482.285276:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211954304:0@lo:400:kworker.0 00000100:00080000:2.0:1782759482.285654:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759482.285659:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759482.285663:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759482.285685:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1782759482.285688:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1782759482.285698:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211954944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759482.285699:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211954432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759482.285701:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:2.0:1782759482.285767:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211954432:12345-0@lo:400:kworker.0 Request processed in 70us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759482.285773:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211954944:12345-0@lo:400:kworker.0 Request processed in 77us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759482.285789:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1782759482.285790:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1782759482.285859:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211954432:0@lo:400:kworker.0 00000100:00100000:2.0:1782759482.285876:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211954944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759482.285886:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211954560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759482.285894:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:3.0:1782759482.285906:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211954816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759482.285938:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211954560:12345-0@lo:400:kworker.0 Request processed in 225us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759482.285946:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1782759482.285951:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211954560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759482.286016:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211954816:12345-0@lo:400:kworker.0 Request processed in 113us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759482.286027:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211954816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759482.286037:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000020:00000080:3.0:1782759482.541066:0:145600:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffcd2bc9dd0 00000004:00000080:3.0:1782759482.541084:0:145600:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9171bbfc2800 uarg=0000000000000000 00000004:00000080:3.0:1782759482.541122:0:145600:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9171bbfc2800 00000040:00080000:3.0:1782759482.541583:0:145600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 80 off8352 00000004:00000080:3.0:1782759482.541610:0:145600:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl2', mask 0x0 00000004:02000000:3.0:1782759482.541613:0:145600:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1782759482.796069:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211955072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759482.796147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759482.796282:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955072 00000100:00100000:1.0:1782759482.796291:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955072 00000100:00100000:1.0:1782759482.796347:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1782759482.796359:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211955072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759482.796416:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759482.796484:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211955072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759482.796494:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1782759482.796623:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211955072:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1782759482.963065:0:145648:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759482.963073:0:145648:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1782759482.963106:0:145648:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:1.0:1782759482.963113:0:145648:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1782759482.989008:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759483.611125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759483.611210:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197267200 00000100:00100000:2.0:1782759483.611223:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197267200 00000100:00100000:2.0:1782759483.611342:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2051 00000100:00100000:2.0:1782759483.611355:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:101136:x1869355197267200:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:2.0:1782759483.611392:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759483.611420:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e8d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.611498:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df82c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.611516:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df82c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.611531:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df82c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759483.611800:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1782759483.611806:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759483.611920:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df82c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.611958:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e8d expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.611978:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df82c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e8d expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.611988:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759483.611991:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759483.611995:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65e00, rc 0) 00000100:00100000:2.0:1782759483.612069:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:101136:x1869355197267200:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 716us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759483.612077:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2051 00000100:00080000:0.0:1782759483.612462:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759483.614025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759483.614090:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197267328 00000100:00100000:3.0:1782759483.614104:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197267328 00000100:00100000:3.0:1782759483.614168:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2052 00000100:00100000:3.0:1782759483.614178:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:101136:x1869355197267328:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:3.0:1782759483.614200:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759483.614222:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777df833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e94 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614286:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614302:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614314:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614330:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614355:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614363:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614974:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df848 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614985:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df848 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.614992:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df848 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759483.615104:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xc:0x0]: returning size 7680 00000004:00200000:3.0:1782759483.615109:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759483.615207:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df848 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615221:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615228:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615235:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615242:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759483.615247:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615263:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615281:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:3.0:1782759483.615284:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759483.615290:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615297:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df83a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615315:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615321:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615328:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615334:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759483.615337:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615343:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615351:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc65a5b3 (ffff9171908a1d00) 00010000:00010000:3.0:1782759483.615353:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759483.615356:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615374:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777df841 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615412:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777df833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e94 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615429:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df848 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e94 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.615437:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1900) 00010000:00010000:3.0:1782759483.617624:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759483.617635:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759483.618171:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:101136:x1869355197267328:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 3987us (4148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759483.618184:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2052 00000100:00100000:2.0:1782759483.621372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759483.621443:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197267584 00000100:00100000:1.0:1782759483.621457:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197267584 00000100:00100000:1.0:1782759483.621516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2053 00000100:00100000:1.0:1782759483.621526:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:101136:x1869355197267584:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782759483.621881:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.621899:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.621911:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.621926:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.621933:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.621940:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759483.623132:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xd:0x0]: returning size 512 00010000:00010000:1.0:1782759483.623145:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.623153:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.623160:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.623165:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759483.623169:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.623184:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.623197:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1900) 00010000:00010000:1.0:1782759483.623200:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759483.623204:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.623209:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df84f lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759483.623219:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014426919 reply state 00000000e657777b transno 4294968051 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759483.623228:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759483.623315:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101136:x1869355197267584:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1787us (1955us total) trans 4294968051 rc 0/0 00000100:00100000:1.0:1782759483.623324:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2053 00010000:00010000:2.0:1782759483.628408:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.628431:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.628442:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.628451:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759483.628457:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.628467:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.628501:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171889c5d00) 00010000:00010000:2.0:1782759483.628505:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759483.628510:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.628518:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777df856 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759483.634180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759483.634493:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197267840 00000100:00100000:1.0:1782759483.634503:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197267840 00000100:00100000:1.0:1782759483.634562:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2054 00000100:00100000:1.0:1782759483.634574:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:101137:x1869355197267840:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759483.634598:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759483.634617:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df85d lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66e9b expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.634763:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.634789:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.634800:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.634815:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.634852:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.634861:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759483.635124:0:6790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6790:1869355211955200:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1782759483.635172:0:6790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759483.635227:0:6790:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759483.635270:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955200 00000100:00100000:0.0:1782759483.635276:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955200 00000100:00100000:0.0:1782759483.635319:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1782759483.635329:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6790:x1869355211955200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782759483.635368:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000004:00080000:1.0:1782759483.635541:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32:0x0], index 0: 0 00010000:00010000:1.0:1782759483.635764:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777df872 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.635773:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777df872 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.635779:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777df872 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759483.636032:0:19544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968052 00010000:00010000:1.0:1782759483.636114:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636123:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636141:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636149:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759483.636153:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636161:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636171:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1900) 00010000:00010000:1.0:1782759483.636173:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759483.636176:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636180:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777df864 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759483.636190:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dff399e8 reply state 00000000bc3ba903 transno 4294968053 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759483.636196:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759483.636222:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777df85d lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e9b expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636234:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777df872 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e9b expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.636239:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171889c5900) 00010000:00010000:1.0:1782759483.636246:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759483.636248:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4000, rc 0) 00000100:00100000:1.0:1782759483.636305:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101137:x1869355197267840:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1733us (2130us total) trans 4294968053 rc 0/0 00000100:00100000:1.0:1782759483.636313:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2054 00000020:00080000:1.0:1782759483.636320:0:19544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782759483.639745:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.639763:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.639771:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.639777:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759483.639782:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.639789:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.639805:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171889c5b00) 00010000:00010000:2.0:1782759483.639808:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759483.639812:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.639818:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777df86b lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759483.641781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759483.641886:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268096 00000100:00100000:2.0:1782759483.641895:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268096 00000100:00100000:2.0:1782759483.641943:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2055 00000100:00100000:2.0:1782759483.641954:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101137:x1869355197268096:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782759483.642006:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759483.642028:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777df872 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e9b expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.642046:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171889c5900) 00010000:00010000:2.0:1782759483.642061:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759483.642105:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.642118:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.642128:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759483.642394:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f68918d7 reply state 00000000da90c379 transno 4294968054 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759483.642403:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759483.642495:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101137:x1869355197268096:12345-192.168.204.31@tcp:36:touch.0 Request processed in 543us (720us total) trans 4294968054 rc 0/0 00000100:00100000:2.0:1782759483.642505:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2055 00000100:00100000:2.0:1782759483.643935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782759483.643968:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.643982:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.643988:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.643992:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759483.643996:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.644002:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.644016:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6700) 00010000:00010000:2.0:1782759483.644019:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759483.644023:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.644030:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df880 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759483.644065:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268224 00000100:00100000:2.0:1782759483.644070:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268224 00000100:00100000:2.0:1782759483.644159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2056 00000100:00100000:2.0:1782759483.644167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101137:x1869355197268224:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759483.644184:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759483.644202:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df887 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ea2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.644247:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df887 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ea2 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.645291:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df887 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ea2 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.645332:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759483.645336:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759483.645340:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64c00, rc 0) 00000100:00100000:2.0:1782759483.645405:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101137:x1869355197268224:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1236us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759483.645413:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2056 00000100:00100000:0.0:1782759483.649050:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6790:x1869355211955200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13718us (13871us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1782759483.649063:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1782759483.649144:0:6790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6790:1869355211955200:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782759483.649158:0:6790:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x32:0x0]-[0x240000400:0x61:0x0] 00000100:00100000:1.0:1782759483.653088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759483.653120:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268352 00000100:00100000:1.0:1782759483.653129:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268352 00000100:00100000:1.0:1782759483.653186:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1003 00000100:00100000:1.0:1782759483.653196:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197268352:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:1.0:1782759483.653476:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197268352:12345-192.168.204.31@tcp:2:touch.0 Request processed in 280us (393us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1782759483.653484:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1003 00000100:00080000:1.0:1782759483.653515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759483.657371:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759483.657437:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268608 00000100:00100000:2.0:1782759483.657447:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268608 00000100:00100000:2.0:1782759483.657502:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 260 00000100:00100000:2.0:1782759483.657511:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101137:x1869355197268608:12345-192.168.204.31@tcp:35:touch.0 00000001:00080000:2.0:1782759483.658062:0:121722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968055 00000100:00100000:2.0:1782759483.658193:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101137:x1869355197268608:12345-192.168.204.31@tcp:35:touch.0 Request processed in 682us (829us total) trans 4294968056 rc 0/0 00000100:00100000:2.0:1782759483.658201:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 260 00000020:00080000:2.0:1782759483.658206:0:121722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782759484.012914:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759484.080246:0:145745:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee371aa00 20000000:00000080:0.0:1782759484.080264:0:145745:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be2000 uarg=0000000000000000 00010000:00010000:0.0:1782759484.080640:0:145745:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1782759484.080671:0:145745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1900) 00010000:00010000:0.0:1782759484.080674:0:145745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759484.080684:0:145745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777df848 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e94 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080721:0:145745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:0.0:1782759484.080724:0:145745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759484.080729:0:145745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df887 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ea2 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080744:0:145745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:0.0:1782759484.080747:0:145745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759484.080750:0:145745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df82c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66e8d expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080762:0:145745:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 3 locks, left on hash table 0. 10000000:01000000:0.0:1782759484.080776:0:145745:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759484.080790:0:145745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080803:0:145745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080819:0:145745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080891:0:145745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.080905:0:145745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 18 pid: 5794 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759484.080921:0:145745:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145745:1869355211955328:0@lo:104: 00000100:00100000:0.0:1782759484.080980:0:145745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759484.081098:0:145745:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759484.081168:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955328 00000100:00100000:1.0:1782759484.081175:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955328 00000100:00100000:1.0:1782759484.081219:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1782759484.081229:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145745:x1869355211955328:12345-0@lo:104: 00010000:00010000:1.0:1782759484.081243:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.081310:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759484.081317:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145745:x1869355211955328:12345-0@lo:104: Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759484.081323:0:145745:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145745:1869355211955328:0@lo:104: 00000100:00100000:1.0:1782759484.081337:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00010000:00010000:0.0:1782759484.081343:0:145745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759484.081439:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759484.081447:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759484.081455:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759484.081581:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759484.081601:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759484.081609:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759484.081614:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759484.081648:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759484.081654:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759484.081716:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1782759484.081734:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759484.081741:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98600/0xdd99f5c4777df817 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df81e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759484.081756:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759484.081758:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759484.081760:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759484.081810:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211955456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759484.082102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759484.082193:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955456 00000100:00100000:1.0:1782759484.082198:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955456 00010000:00010000:1.0:1782759484.082218:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 19 pid: 5794 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759484.082293:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1782759484.082300:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211955456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759484.082310:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759484.082314:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 19 pid: 5794 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082325:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 19 pid: 5794 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082337:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777df81e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df817 expref: 19 pid: 5794 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082348:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082357:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082370:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082376:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082389:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082396:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082401:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759484.082405:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082413:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082514:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759484.082524:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759484.082545:0:145745:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.082554:0:145745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.082561:0:145745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99200/0xdd99f5c4777df88e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759484.082741:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211955456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759484.083628:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211955456:12345-0@lo:103:ldlm_bl.0 Request processed in 1325us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759484.083638:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1782759484.085117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759484.085150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759484.085185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759484.085230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759484.085251:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268736 00000100:00100000:1.0:1782759484.085258:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268736 00000100:00100000:1.0:1782759484.085292:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2804 00000100:00100000:1.0:1782759484.085299:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197268736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759484.085388:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197268736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759484.085396:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2804 00000100:00100000:2.0:1782759484.085620:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269120 00000100:00100000:2.0:1782759484.085624:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269120 00000100:00100000:2.0:1782759484.085662:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268992 00000100:00100000:2.0:1782759484.085670:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268992 00000100:00100000:2.0:1782759484.085707:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1998 00000100:00100000:2.0:1782759484.085715:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197269120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759484.085763:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197269120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.085771:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1998 00000100:00100000:2.0:1782759484.085786:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1999 00000100:00100000:3.0:1782759484.085792:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197268864 00000100:00100000:2.0:1782759484.085794:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197268992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759484.085798:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197268864 00000100:00100000:2.0:1782759484.085845:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197268992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.085851:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1999 00000100:00080000:2.0:1782759484.085870:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759484.086746:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2547 00000100:00100000:3.0:1782759484.086755:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:2363:x1869355197268864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759484.086805:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:2363:x1869355197268864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759484.086812:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2547 00010000:00010000:1.0:1782759485.036940:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759485.355934:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759485.355940:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759485.355944:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759485.356001:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.356011:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.356019:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759485.356052:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211955584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759485.356117:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759485.356167:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955584 00000100:00100000:0.0:1782759485.356169:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759485.356177:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955584 00000100:00100000:2.0:1782759485.356228:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1782759485.356238:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211955584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759485.356253:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759485.356267:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df895 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.356291:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.356302:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.356311:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64200, rc 0) 00000100:00100000:2.0:1782759485.356378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211955584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.356385:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:0.0:1782759485.356443:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211955584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759485.356459:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.356467:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759485.356483:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759485.356487:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.356493:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759485.357124:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211955712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759485.357159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759485.358353:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955712 00000100:00100000:2.0:1782759485.358360:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955712 00000100:00080000:3.0:1782759485.358417:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759485.358422:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1782759485.358434:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211955712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759485.358465:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759485.358524:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211955712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.358531:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1782759485.358580:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211955712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759485.430927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759485.430968:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269248 00000100:00100000:1.0:1782759485.430980:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269248 00000100:00080000:3.0:1782759485.431034:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759485.431050:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2057 00000100:00100000:1.0:1782759485.431062:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269248:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1782759485.431401:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269248:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 340us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759485.431410:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2057 00000100:00100000:1.0:1782759485.434043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759485.434194:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269376 00000100:00100000:3.0:1782759485.434203:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269376 00000100:00100000:3.0:1782759485.434270:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2058 00000100:00100000:3.0:1782759485.434281:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269376:12345-192.168.204.31@tcp:503:chlg_load_threa.0 00000040:00080000:3.0:1782759485.434649:0:5803:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1782759485.434733:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269376:12345-192.168.204.31@tcp:503:chlg_load_threa.0 Request processed in 454us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.434744:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2058 00000100:00100000:1.0:1782759485.435993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759485.436125:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269504 00000100:00100000:3.0:1782759485.436133:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269504 00000100:00100000:3.0:1782759485.436187:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2059 00000100:00100000:3.0:1782759485.436199:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269504:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1782759485.436345:0:19544:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1782759485.436434:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269504:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 239us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.436441:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2059 00000100:00100000:1.0:1782759485.437956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.438006:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269632 00000100:00100000:2.0:1782759485.438013:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269632 00000100:00100000:2.0:1782759485.438058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2060 00000100:00100000:2.0:1782759485.438069:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269632:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1782759485.438224:0:5802:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759485.438297:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269632:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 230us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.438304:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2060 00000100:00100000:1.0:1782759485.439590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.439999:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269760 00000100:00100000:2.0:1782759485.440008:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269760 00000100:00100000:2.0:1782759485.440053:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2061 00000100:00100000:2.0:1782759485.440063:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269760:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759485.440154:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269760:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 93us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.440161:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2061 00000100:00100000:1.0:1782759485.441335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759485.441385:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197269888 00000100:00100000:3.0:1782759485.441392:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197269888 00000100:00100000:3.0:1782759485.441434:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2062 00000100:00100000:3.0:1782759485.441443:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269888:12345-192.168.204.31@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1782759485.441586:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197269888:12345-192.168.204.31@tcp:503:chlg_load_threa.0 Request processed in 143us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.441593:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2062 00000100:00100000:0.0:1782759485.443854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759485.444055:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197270016 00000100:00100000:3.0:1782759485.444069:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197270016 00000100:00100000:3.0:1782759485.444145:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2063 00000100:00100000:3.0:1782759485.444161:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197270016:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1782759485.444480:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197270016:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 323us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.444500:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2063 00000100:00100000:0.0:1782759485.446716:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.446766:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197270144 00000100:00100000:2.0:1782759485.446775:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197270144 00000100:00100000:2.0:1782759485.446865:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2064 00000100:00100000:2.0:1782759485.446877:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197270144:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1782759485.447030:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101213:x1869355197270144:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 156us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.447038:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2064 00000100:00100000:1.0:1782759485.481240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.482738:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197270272 00000100:00100000:2.0:1782759485.482751:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197270272 00000100:00100000:2.0:1782759485.482862:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2065 00000100:00100000:2.0:1782759485.482874:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101222:x1869355197270272:12345-192.168.204.31@tcp:46:lfs.0 00000004:00000080:2.0:1782759485.482914:0:5801:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9171980ea3b8 uarg=0000000000000000 00000004:00000080:2.0:1782759485.482951:0:5801:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9171980ea3b8 00000004:00000080:2.0:1782759485.482957:0:5801:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:2.0:1782759485.483037:0:5801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759485.483041:0:5801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1782759485.483075:0:5801:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 8 00000040:00080000:2.0:1782759485.483135:0:5801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:2.0:1782759485.483141:0:5801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1782759485.483144:0:5801:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:2.0:1782759485.483165:0:5801:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759485.483166:0:5801:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1782759485.483483:0:5801:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 8 count 1 00000040:00080000:2.0:1782759485.483487:0:5801:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:2.0:1782759485.483565:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101222:x1869355197270272:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 694us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.483571:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2065 00000100:00100000:0.0:1782759485.490689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.490883:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197270400 00000100:00100000:2.0:1782759485.490893:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197270400 00000100:00100000:2.0:1782759485.490944:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2066 00000100:00100000:2.0:1782759485.490955:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:101223:x1869355197270400:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759485.490975:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759485.490998:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8a3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ea9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491166:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491181:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491194:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491208:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491215:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491351:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491448:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df8b8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491473:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491481:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759485.491535:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xd:0x0]: returning size 512 00000004:00200000:2.0:1782759485.491539:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759485.491563:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491575:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491591:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491598:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491605:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.491609:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491617:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491629:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6f00) 00010000:00010000:2.0:1782759485.491632:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.491636:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491653:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8aa lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491677:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491684:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491690:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491695:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.491698:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491704:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491713:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171c08f6000) 00010000:00010000:2.0:1782759485.491716:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.491718:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491723:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8b1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491756:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8a3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ea9 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491771:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ea9 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.491784:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xd:0x0].0x0 (ffff9171c08f6700) 00010000:00010000:2.0:1782759485.491786:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759485.491788:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64c00, rc 0) 00000100:00100000:2.0:1782759485.491898:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101223:x1869355197270400:12345-192.168.204.31@tcp:101:rm.0 Request processed in 945us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.491905:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2066 00000100:00100000:0.0:1782759485.494659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.494883:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197270656 00000100:00100000:2.0:1782759485.494893:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197270656 00000100:00100000:2.0:1782759485.494936:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2067 00000100:00100000:2.0:1782759485.494957:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101223:x1869355197270656:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759485.494982:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759485.495002:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8bf lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66eb0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759485.495144:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xd:0x0]: returning size 512 00010000:00010000:2.0:1782759485.495518:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8bf lrc: 1/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eb0 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.495533:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759485.495536:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759485.495540:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8bf lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eb0 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.495556:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65e00, rc 0) 00000100:00100000:2.0:1782759485.495625:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101223:x1869355197270656:12345-192.168.204.31@tcp:101:rm.0 Request processed in 680us (974us total) trans 4294968057 rc 301/301 00000100:00100000:2.0:1782759485.495642:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2067 00000100:00100000:1.0:1782759485.499036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759485.499085:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197270784 00000100:00100000:3.0:1782759485.499333:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197270784 00000100:00100000:3.0:1782759485.499448:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 261 00000100:00100000:3.0:1782759485.499460:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101223:x1869355197270784:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:3.0:1782759485.502381:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101223:x1869355197270784:12345-192.168.204.31@tcp:37:rm.0 Request processed in 2915us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.502394:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 261 00000100:00100000:0.0:1782759485.505811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.505880:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197271040 00000100:00100000:2.0:1782759485.505890:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197271040 00000100:00100000:2.0:1782759485.505944:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 262 00000100:00100000:2.0:1782759485.505959:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101223:x1869355197271040:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:2.0:1782759485.506462:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101223:x1869355197271040:12345-192.168.204.31@tcp:35:rm.0 Request processed in 508us (656us total) trans 4294968058 rc 0/0 00000100:00100000:2.0:1782759485.506471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 262 00000100:00100000:1.0:1782759485.509539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.509635:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197271296 00000100:00100000:2.0:1782759485.509653:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197271296 00000100:00100000:2.0:1782759485.509714:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2068 00000100:00100000:2.0:1782759485.509725:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101223:x1869355197271296:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759485.509776:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759485.509803:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df8b8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ea9 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.509819:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xd:0x0].0x0 (ffff9171c08f6700) 00010000:00010000:2.0:1782759485.509872:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759485.509893:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.509904:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.509912:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.509937:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.509944:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.509951:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510050:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 3/0,1 mode: --/EX res: [0x200000418:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510058:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510064:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759485.510685:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xd:0x0]: returning size 512 00010000:00010000:2.0:1782759485.510703:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510710:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 2/0,0 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510717:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510723:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.510727:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510743:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 4/0,0 mode: EX/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510752:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xd:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:2.0:1782759485.510754:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759485.510758:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 2/0,0 mode: --/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510763:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df8db lrc: 0/0,0 mode: --/EX res: [0x200000418:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510779:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510784:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510790:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510795:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.510798:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510804:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510811:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759485.510813:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.510816:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.510866:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df8cd lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759485.510878:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004186494f reply state 00000000a4dacdd6 transno 4294968059 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.510887:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759485.510955:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101223:x1869355197271296:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1231us (1422us total) trans 4294968059 rc 0/0 00000100:00100000:2.0:1782759485.510961:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2068 00010000:00010000:2.0:1782759485.512510:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.512521:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.512527:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.512532:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.512535:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.512542:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.512553:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171c08f6f00) 00010000:00010000:2.0:1782759485.512555:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.512558:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.512574:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df8d4 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759485.513453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.513497:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197271424 00000100:00100000:2.0:1782759485.513505:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197271424 00000100:00100000:2.0:1782759485.513551:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2069 00000100:00100000:2.0:1782759485.513560:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101223:x1869355197271424:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759485.513581:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759485.513596:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8e2 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66eb7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513660:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513680:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513688:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513698:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513704:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513710:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513790:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513805:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513813:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759485.513878:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782759485.513883:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759485.513902:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513912:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513920:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513925:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513931:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513936:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.513939:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513945:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513953:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759485.513956:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.513964:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513970:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df8e9 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513981:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513987:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513992:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.513997:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.514000:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.514006:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.514013:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6600) 00010000:00010000:2.0:1782759485.514015:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.514017:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.514023:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df8f0 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.514048:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df8e2 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eb7 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.514075:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eb7 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.514082:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6500) 00010000:00010000:2.0:1782759485.514085:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759485.514087:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64e00, rc 0) 00000100:00100000:2.0:1782759485.514139:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101223:x1869355197271424:12345-192.168.204.31@tcp:101:rm.0 Request processed in 579us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.514146:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2069 00000100:00100000:0.0:1782759485.517226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759485.517281:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197271552 00000100:00100000:1.0:1782759485.517290:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197271552 00000100:00100000:1.0:1782759485.517355:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00100000:1.0:1782759485.517364:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197271552:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759485.517381:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759485.517398:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ebe expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759485.517434:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x6a42c03a, atime: 0x6a42c03a, ctime: 0x6a42c03a, blocks: 0x1 00010000:00010000:1.0:1782759485.517456:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=3553s v=(0 0) 00010000:00010000:1.0:1782759485.517461:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759485.517469:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.517487:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.517500:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4a00, rc 0) 00000100:00100000:1.0:1782759485.517556:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197271552:12345-192.168.204.31@tcp:101:rm.0 Request processed in 193us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759485.517564:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1004 00000100:00080000:3.0:1782759485.517633:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759485.520177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759485.520315:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197271808 00000100:00100000:2.0:1782759485.520323:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197271808 00000100:00100000:2.0:1782759485.520377:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2070 00000100:00100000:2.0:1782759485.520388:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101223:x1869355197271808:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759485.520430:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782759485.520452:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df8f7 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eb7 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520466:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777df887) 00010000:00010000:2.0:1782759485.520469:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6500) 00010000:00010000:2.0:1782759485.520477:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759485.520495:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520503:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520510:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520534:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520541:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520547:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520653:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 3/0,1 mode: --/EX res: [0x200000418:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520674:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.520683:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759485.521383:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].53, 64 off11704 00000004:00080000:2.0:1782759485.521394:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3553924570286ns, next at 3554924567713ns, rc = 0 00010000:00010000:2.0:1782759485.521480:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 3/0,1 mode: --/PW res: [0x200000418:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521491:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521498:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521504:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 4/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521520:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 4/0,1 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521525:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521544:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759485.521565:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521572:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521578:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521584:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759485.521586:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759485.521589:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521595:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521598:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521610:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759485.521618:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6f00) 00010000:00010000:1.0:1782759485.521618:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521625:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759485.521631:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 2/0,0 mode: --/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521632:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521647:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777df913 lrc: 0/0,0 mode: --/EX res: [0x200000418:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521653:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xe:0x0].0x0 (ffff9171c08f6f00) 00010000:00010000:2.0:1782759485.521676:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521677:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782759485.521682:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 1/0,0 mode: --/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521699:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777df91a lrc: 0/0,0 mode: --/PW res: [0x200000418:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521701:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521715:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521721:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759485.521722:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759485.521725:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.521726:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759485.521730:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759485.521737:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521746:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759485.521748:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.521751:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.521756:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777df905 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759485.521768:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd1164de reply state 0000000075cd7b58 transno 4294968060 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.521776:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759485.521878:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101223:x1869355197271808:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1490us (1703us total) trans 4294968060 rc 0/0 00000100:00100000:2.0:1782759485.521887:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2070 00010000:00010000:2.0:1782759485.523319:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.523356:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.523362:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.523367:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759485.523370:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.523376:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.523387:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6600) 00010000:00010000:2.0:1782759485.523389:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759485.523392:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.523398:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777df90c lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759485.874464:0:145941:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf2d718f0 20000000:00000080:3.0:1782759485.874479:0:145941:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081256000 uarg=0000000000000000 00010000:00010000:3.0:1782759485.874701:0:145941:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759485.874715:0:145941:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759485.874729:0:145941:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759485.874745:0:145941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.874761:0:145941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.874770:0:145941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.874803:0:145941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.874860:0:145941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 18 pid: 5796 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759485.874875:0:145941:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145941:1869355211955840:0@lo:104: 00000100:00100000:3.0:1782759485.874933:0:145941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759485.874978:0:145941:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759485.875054:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955840 00000100:00100000:0.0:1782759485.875061:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955840 00000100:00100000:0.0:1782759485.875105:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1782759485.875114:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145941:x1869355211955840:12345-0@lo:104: 00010000:00010000:0.0:1782759485.875125:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.875182:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759485.875189:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:145941:x1869355211955840:12345-0@lo:104: Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759485.875197:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00010000:00010000:2.0:1782759485.875204:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759485.875211:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875217:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759485.875220:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875227:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759485.875229:0:145941:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145941:1869355211955840:0@lo:104: 10000000:00010000:2.0:1782759485.875241:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759485.875245:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759485.875252:0:145941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875273:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875278:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759485.875300:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875305:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98000/0xdd99f5c4777df895 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df89c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875316:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759485.875319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1782759485.875319:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759485.875320:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759485.875333:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211955968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759485.875359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759485.875387:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211955968 00000100:00100000:2.0:1782759485.875391:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211955968 00010000:00010000:2.0:1782759485.875407:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 19 pid: 5796 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.875426:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1782759485.875430:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211955968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759485.875438:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759485.875442:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 19 pid: 5796 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875449:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 19 pid: 5796 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875463:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64200/0xdd99f5c4777df89c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df895 expref: 19 pid: 5796 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875471:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875476:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875484:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875488:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875492:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875498:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875503:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759485.875508:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875515:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875536:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.875553:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759485.875571:0:145941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.875581:0:145941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.875586:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211955968:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759485.875598:0:145941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777df921 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.875603:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1782759485.875615:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211955968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759486.060956:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759486.913062:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968053 is committed 00000001:00080000:3.0:1782759486.913073:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968060 is committed 00000004:00080000:3.0:1782759486.913077:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 123 committed 00000100:00100000:3.0:1782759486.913261:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211956096:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782759486.913328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759486.913361:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956096 00000100:00100000:2.0:1782759486.913370:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956096 00000100:00100000:2.0:1782759486.913430:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1782759486.913440:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211956096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782759486.913467:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:50 count 1 00010000:00010000:2.0:1782759486.913492:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.913513:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.913523:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782759486.913527:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759486.913532:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.913557:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.913570:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 6 pid: 9120 timeout: 3655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759486.913595:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211956224:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759486.913663:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759486.915718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759486.916039:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1869355211956224:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759486.916057:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197271936 00010000:00010000:2.0:1782759486.916061:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759486.916063:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197271936 00010000:00010000:0.0:1782759486.916091:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 7 pid: 9120 timeout: 3655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759486.916121:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 641 00000100:00100000:0.0:1782759486.916131:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197271936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759486.916144:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759486.916151:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 7 pid: 9120 timeout: 3655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759486.916179:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 7 pid: 9120 timeout: 3655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759486.916202:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777df8fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ebe expref: 7 pid: 9120 timeout: 3655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759486.916215:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759486.916219:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759486.916224:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759486.916233:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759486.916256:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759486.916276:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.916285:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.916295:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759486.916295:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197271936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 166us (581us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759486.916303:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759486.916304:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 641 00010000:00010000:2.0:1782759486.916322:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759486.916347:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759486.916356:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.916368:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759486.916373:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.916384:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.916408:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.916416:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777df928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.916473:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759486.916475:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759486.916477:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759486.916559:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1869355211956096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3119us (3229us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1782759486.916567:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000004:00080000:3.0:1782759486.916582:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917190265f80/2, rc 0, transno 4294967410 00000100:00100000:3.0:1782759486.916590:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211956096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782759487.055953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.056129:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197272192 00000100:00100000:2.0:1782759487.056140:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197272192 00000100:00080000:3.0:1782759487.056212:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759487.056230:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2071 00000100:00100000:2.0:1782759487.056239:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:101296:x1869355197272192:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759487.056701:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.056723:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.056739:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.056753:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.056760:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.056766:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759487.058026:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xf:0x0]: returning size 512 00010000:00010000:2.0:1782759487.058039:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.058048:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.058055:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.058062:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759487.058066:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.058081:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.058094:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6500) 00010000:00010000:2.0:1782759487.058097:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759487.058101:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.058107:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df92f lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759487.058124:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000845e5e4b reply state 00000000647cf1c8 transno 4294968061 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759487.058132:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759487.058206:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:101296:x1869355197272192:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1968us (2262us total) trans 4294968061 rc 0/0 00000100:00100000:2.0:1782759487.058211:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2071 00010000:00010000:2.0:1782759487.059893:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.059909:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.059916:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.059922:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759487.059926:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.059945:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.059972:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171c08f6100) 00010000:00010000:2.0:1782759487.059977:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759487.059987:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.059994:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df936 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759487.065540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.065596:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197272448 00000100:00100000:2.0:1782759487.065613:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197272448 00000100:00100000:2.0:1782759487.065678:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2072 00000100:00100000:2.0:1782759487.065689:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:101297:x1869355197272448:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759487.065713:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759487.065748:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df93d lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ec5 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.065900:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.065918:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.065930:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.065942:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.065955:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.065963:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759487.066265:0:7941:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1869355211956352:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782759487.066313:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759487.066368:0:7941:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759487.066561:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956352 00000100:00100000:1.0:1782759487.066567:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956352 00000100:00100000:1.0:1782759487.066645:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1782759487.066656:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:7941:x1869355211956352:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1782759487.066696:0:126932:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:3.0:1782759487.066708:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1782759487.066729:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32:0x0], index 1: 0 00010000:00010000:2.0:1782759487.067042:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df952 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067050:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df952 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067056:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df952 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759487.067251:0:7487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968062 00010000:00010000:2.0:1782759487.067307:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067315:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067321:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067329:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759487.067333:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067340:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067358:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759487.067362:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759487.067366:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067372:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df944 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759487.067384:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036e47d9d reply state 00000000dcbbcf0e transno 4294968063 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759487.067393:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759487.067423:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df93d lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ec5 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067445:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df952 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ec5 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.067453:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759487.067456:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759487.067458:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65800, rc 0) 00000100:00100000:2.0:1782759487.067529:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101297:x1869355197272448:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1841us (1995us total) trans 4294968063 rc 0/0 00000100:00100000:2.0:1782759487.067539:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2072 00000020:00080000:2.0:1782759487.067544:0:7487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782759487.068384:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.068395:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.068404:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.068410:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759487.068414:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.068427:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.068448:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6500) 00010000:00010000:3.0:1782759487.068451:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759487.068455:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.068468:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777df94b lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759487.070092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.070123:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197272704 00000100:00100000:2.0:1782759487.070132:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197272704 00000100:00100000:2.0:1782759487.070175:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2073 00000100:00100000:2.0:1782759487.070184:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101297:x1869355197272704:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782759487.070234:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759487.070253:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df952 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ec5 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.070267:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759487.070276:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759487.070314:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.070325:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.070334:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759487.070664:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd0fbce9 reply state 000000006d47acac transno 4294968064 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759487.070673:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759487.070752:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101297:x1869355197272704:12345-192.168.204.31@tcp:36:touch.0 Request processed in 568us (663us total) trans 4294968064 rc 0/0 00000100:00100000:2.0:1782759487.070760:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2073 00010000:00010000:3.0:1782759487.071656:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.071667:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.071675:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.071682:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759487.071687:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.071694:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.071706:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:3.0:1782759487.071709:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759487.071712:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.071730:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64e00/0xdd99f5c4777df960 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759487.072022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759487.072053:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197272832 00000100:00100000:3.0:1782759487.072059:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197272832 00000100:00100000:3.0:1782759487.072103:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2074 00000100:00100000:3.0:1782759487.072113:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101297:x1869355197272832:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759487.072132:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759487.072193:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df967 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ecc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.072237:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df967 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ecc expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.072251:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df967 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ecc expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.072270:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759487.072273:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759487.072277:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759487.072309:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101297:x1869355197272832:12345-192.168.204.31@tcp:101:touch.0 Request processed in 198us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759487.072316:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2074 00000100:00100000:3.0:1782759487.073442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759487.073474:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197272960 00000100:00100000:3.0:1782759487.073480:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197272960 00000100:00100000:3.0:1782759487.073535:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00100000:3.0:1782759487.073546:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197272960:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:3.0:1782759487.073940:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197272960:12345-192.168.204.31@tcp:2:touch.0 Request processed in 397us (499us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1782759487.073948:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1007 00000100:00080000:3.0:1782759487.073968:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759487.075143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759487.075181:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197273216 00000100:00100000:0.0:1782759487.075189:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197273216 00000100:00100000:0.0:1782759487.075237:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 263 00000100:00100000:0.0:1782759487.075247:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101297:x1869355197273216:12345-192.168.204.31@tcp:35:touch.0 00000001:00080000:0.0:1782759487.075759:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968065 00000100:00100000:0.0:1782759487.075899:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101297:x1869355197273216:12345-192.168.204.31@tcp:35:touch.0 Request processed in 652us (758us total) trans 4294968066 rc 0/0 00000100:00100000:0.0:1782759487.075915:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 263 00000020:00080000:0.0:1782759487.075920:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782759487.083417:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:7941:x1869355211956352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16760us (17099us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1782759487.083429:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1782759487.083458:0:7941:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1869355211956352:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782759487.083475:0:7941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x32:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:2.0:1782759487.084914:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759487.092993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.093160:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197273344 00000100:00100000:2.0:1782759487.093170:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197273344 00000100:00100000:2.0:1782759487.093437:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2075 00000100:00100000:2.0:1782759487.093448:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101301:x1869355197273344:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759487.093564:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101301:x1869355197273344:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 117us (583us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759487.093593:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2075 00000100:00100000:3.0:1782759487.129509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.129581:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197273472 00000100:00100000:2.0:1782759487.129591:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197273472 00000100:00100000:2.0:1782759487.129650:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2076 00000100:00100000:2.0:1782759487.129659:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101308:x1869355197273472:12345-192.168.204.31@tcp:46:lfs.0 00000100:00100000:2.0:1782759487.129753:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101308:x1869355197273472:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 95us (254us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759487.129761:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2076 00000100:00100000:3.0:1782759487.136357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759487.136559:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197273600 00000100:00100000:0.0:1782759487.136567:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197273600 00000100:00100000:0.0:1782759487.136664:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2077 00000100:00100000:0.0:1782759487.136676:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101309:x1869355197273600:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782759487.136695:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759487.136717:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df96e lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ed3 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136774:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136788:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136800:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136812:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136819:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136876:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136959:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df983 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136977:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df983 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.136982:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df983 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759487.137012:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xf:0x0]: returning size 512 00000004:00200000:0.0:1782759487.137015:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759487.137031:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df983 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137039:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137044:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137048:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137051:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759487.137054:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137058:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137066:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70500) 00010000:00010000:0.0:1782759487.137068:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759487.137070:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137080:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df975 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137090:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137093:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137098:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137103:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759487.137106:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137112:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137120:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff917183a70c00) 00010000:00010000:0.0:1782759487.137123:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759487.137125:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137130:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df97c lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137160:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df96e lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ed3 expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137186:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df983 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ed3 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.137193:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xf:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759487.137196:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759487.137198:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759487.137261:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101309:x1869355197273600:12345-192.168.204.31@tcp:101:rm.0 Request processed in 588us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759487.137267:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2077 00000100:00100000:3.0:1782759487.139351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759487.139419:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197273856 00000100:00100000:0.0:1782759487.139427:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197273856 00000100:00100000:0.0:1782759487.139503:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2078 00000100:00100000:0.0:1782759487.139513:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101309:x1869355197273856:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782759487.139530:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759487.139548:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df98a lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66eda expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759487.139644:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xf:0x0]: returning size 512 00010000:00010000:0.0:1782759487.140051:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df98a lrc: 1/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eda expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.140063:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759487.140066:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759487.140069:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df98a lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eda expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.140096:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99800, rc 0) 00000100:00100000:0.0:1782759487.140157:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101309:x1869355197273856:12345-192.168.204.31@tcp:101:rm.0 Request processed in 645us (809us total) trans 4294968067 rc 301/301 00000100:00100000:0.0:1782759487.140164:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2078 00000100:00100000:3.0:1782759487.142706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.142863:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197273984 00000100:00100000:2.0:1782759487.142872:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197273984 00000100:00100000:2.0:1782759487.142923:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 264 00000100:00100000:2.0:1782759487.142935:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101309:x1869355197273984:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:2.0:1782759487.146199:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101309:x1869355197273984:12345-192.168.204.31@tcp:37:rm.0 Request processed in 3257us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759487.146213:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 264 00000100:00100000:3.0:1782759487.148309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759487.148387:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197274240 00000100:00100000:0.0:1782759487.148398:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197274240 00000100:00100000:0.0:1782759487.148452:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 265 00000100:00100000:0.0:1782759487.148461:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101309:x1869355197274240:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1782759487.149012:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101309:x1869355197274240:12345-192.168.204.31@tcp:35:rm.0 Request processed in 550us (713us total) trans 4294968068 rc 0/0 00000100:00100000:0.0:1782759487.149025:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 265 00000100:00100000:3.0:1782759487.151126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.151219:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197274496 00000100:00100000:2.0:1782759487.151226:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197274496 00000100:00100000:2.0:1782759487.151263:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2079 00000100:00100000:2.0:1782759487.151269:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101309:x1869355197274496:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759487.151306:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759487.151335:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777df983 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ed3 expref: 15 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151354:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xf:0x0].0x0 (ffff917183a70400) 00010000:00010000:2.0:1782759487.151365:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759487.151397:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151410:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151421:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151435:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151442:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151448:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151541:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 3/0,1 mode: --/EX res: [0x200000418:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151549:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.151556:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759487.152177:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xf:0x0]: returning size 512 00010000:00010000:2.0:1782759487.152192:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152199:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152214:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152221:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759487.152225:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152232:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152241:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xf:0x0].0x0 (ffff9171c08f6700) 00010000:00010000:2.0:1782759487.152244:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759487.152247:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 2/0,0 mode: --/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152252:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777df9a6 lrc: 0/0,0 mode: --/EX res: [0x200000418:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152267:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152274:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152279:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152284:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759487.152286:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152300:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152307:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6300) 00010000:00010000:2.0:1782759487.152309:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759487.152312:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.152317:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777df998 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759487.152328:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9408189 reply state 000000002a11f25a transno 4294968069 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759487.152336:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759487.152394:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101309:x1869355197274496:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1123us (1276us total) trans 4294968069 rc 0/0 00000100:00100000:2.0:1782759487.152401:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2079 00010000:00010000:3.0:1782759487.153657:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.153670:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.153677:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.153683:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759487.153687:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.153707:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.153718:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171c08f6100) 00010000:00010000:3.0:1782759487.153720:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759487.153725:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.153730:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777df99f lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759487.154097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759487.154163:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197274624 00000100:00100000:0.0:1782759487.154173:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197274624 00000100:00100000:0.0:1782759487.154219:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2080 00000100:00100000:0.0:1782759487.154230:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101309:x1869355197274624:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782759487.154250:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759487.154267:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df9ad lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ee1 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154315:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154327:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154336:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154355:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154363:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154380:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154458:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154467:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154475:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759487.154510:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x10:0x0]: returning size 0 00000004:00200000:0.0:1782759487.154515:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759487.154533:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154543:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154551:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154556:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154567:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154571:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759487.154573:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154576:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154582:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759487.154584:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759487.154586:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154590:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777df9b4 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154596:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154600:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154604:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154609:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759487.154612:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154626:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154646:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff917183a70500) 00010000:00010000:0.0:1782759487.154649:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759487.154652:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154658:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777df9bb lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154684:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777df9ad lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee1 expref: 17 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154695:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee1 expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.154699:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff9171908a1700) 00010000:00010000:0.0:1782759487.154701:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759487.154702:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98a00, rc 0) 00000100:00100000:0.0:1782759487.154738:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101309:x1869355197274624:12345-192.168.204.31@tcp:101:rm.0 Request processed in 511us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759487.154743:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2080 00000100:00100000:1.0:1782759487.156573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759487.156618:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197274752 00000100:00100000:2.0:1782759487.156626:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197274752 00000100:00100000:2.0:1782759487.156686:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1008 00000100:00100000:2.0:1782759487.156696:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197274752:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759487.156712:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759487.156730:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ee8 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759487.156755:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x6a42c03e, atime: 0x6a42c03e, ctime: 0x6a42c03e, blocks: 0x1 00010000:00010000:2.0:1782759487.156775:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=3555s v=(0 0) 00010000:00010000:2.0:1782759487.156789:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759487.156798:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.156817:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.156857:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64800, rc 0) 00000100:00100000:2.0:1782759487.156902:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197274752:12345-192.168.204.31@tcp:101:rm.0 Request processed in 207us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759487.156909:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1008 00000100:00100000:3.0:1782759487.159211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759487.159260:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275008 00000100:00100000:0.0:1782759487.159269:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275008 00000100:00100000:0.0:1782759487.159325:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2081 00000100:00100000:0.0:1782759487.159334:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101309:x1869355197275008:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782759487.159393:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782759487.159422:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777df9c2 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee1 expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159443:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777df967 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ecc expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159453:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff9171908a1700) 00010000:00010000:0.0:1782759487.159462:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759487.159482:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159493:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159500:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159511:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159517:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159523:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159625:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 3/0,1 mode: --/EX res: [0x200000418:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159645:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.159658:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759487.160380:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].47, 64 off11296 00000004:00080000:0.0:1782759487.160393:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3555563569198ns, next at 3556563566449ns, rc = 0 00010000:00010000:0.0:1782759487.160492:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160502:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160510:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160518:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160524:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160529:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160556:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759487.160575:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160581:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160587:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160599:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759487.160603:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160609:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160619:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759487.160621:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759487.160624:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 2/0,0 mode: --/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160629:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777df9de lrc: 0/0,0 mode: --/EX res: [0x200000418:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160656:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160661:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160666:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160670:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759487.160673:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160678:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160697:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759487.160700:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759487.160703:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.160708:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777df9d0 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759487.160722:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000af1e86a reply state 00000000583640c3 transno 4294968070 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759487.160730:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759487.160808:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101309:x1869355197275008:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1473us (1602us total) trans 4294968070 rc 0/0 00000100:00100000:0.0:1782759487.160815:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2081 00010000:00010000:1.0:1782759487.161066:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759487.161072:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759487.161079:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759487.161082:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759487.161089:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759487.161097:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x10:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759487.161100:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782759487.161102:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 1/0,0 mode: --/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759487.161107:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777df9e5 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759487.161120:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759487.161121:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759487.161124:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759487.162470:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.162485:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.162492:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.162499:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759487.162503:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.162510:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.162522:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff917183a70700) 00010000:00010000:2.0:1782759487.162525:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759487.162541:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.162548:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777df9d7 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759487.404076:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211956608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759487.404104:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211956736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759487.404173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759487.404198:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211956480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759487.404243:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759487.404244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759487.404255:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211956864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759487.404292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759487.404414:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956480 00000100:00100000:0.0:1782759487.404415:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956736 00000100:00100000:1.0:1782759487.404420:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956864 00000100:00100000:2.0:1782759487.404424:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956480 00000100:00100000:0.0:1782759487.404424:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956736 00000100:00100000:1.0:1782759487.404427:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956864 00000100:00100000:1.0:1782759487.404518:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1782759487.404528:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211956864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759487.404540:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1782759487.404548:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211956736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759487.404556:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1782759487.404569:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211956480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759487.404597:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211956864:12345-0@lo:400:kworker.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759487.404600:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211956736:12345-0@lo:400:kworker.0 Request processed in 52us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759487.404613:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1782759487.404620:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1782759487.404639:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211956480:12345-0@lo:400:kworker.0 Request processed in 63us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759487.404647:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00080000:0.0:1782759487.404672:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759487.404733:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211956864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759487.404748:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211956736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759487.404770:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211956480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759487.404918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759487.404969:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956608 00000100:00100000:3.0:1782759487.404973:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956608 00000100:00100000:3.0:1782759487.405006:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1782759487.405016:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211956608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759487.405061:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211956608:12345-0@lo:400:kworker.0 Request processed in 48us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759487.405069:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1782759487.405101:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211956608:0@lo:400:kworker.0 00000001:00080000:3.0:1782759487.427179:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967408 is committed 00000001:00080000:3.0:1782759487.427238:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967409 is committed 00000001:00080000:3.0:1782759487.427253:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967410 is committed 00000020:00000080:2.0:1782759487.498472:0:146140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9528c2d0 20000000:00000080:2.0:1782759487.498489:0:146140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb1400 uarg=0000000000000000 00010000:00010000:2.0:1782759487.499098:0:146140:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759487.499113:0:146140:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759487.499125:0:146140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759487.499142:0:146140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499157:0:146140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499168:0:146140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499175:0:146140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499191:0:146140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499198:0:146140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499205:0:146140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759487.499209:0:146140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499217:0:146140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499229:0:146140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499236:0:146140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.499242:0:146140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777df9ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759487.659937:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759487.659944:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759487.659949:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759487.659992:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.660004:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759487.660016:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759487.660041:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708903e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211956992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759487.660108:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759487.660162:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759487.660691:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211956992 00000100:00100000:2.0:1782759487.660700:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211956992 00000100:00100000:2.0:1782759487.660765:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:2.0:1782759487.660775:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211956992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759487.660789:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759487.660801:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777df9f3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.660865:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.660878:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759487.660893:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65400, rc 0) 00000100:00100000:2.0:1782759487.661136:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211956992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759487.661147:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:3.0:1782759487.661159:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708903e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211956992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759487.661174:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.661187:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759487.661203:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759487.661207:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759487.661211:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759487.916099:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211957120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759487.916172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759487.916590:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211957120 00000100:00100000:2.0:1782759487.916598:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211957120 00000100:00100000:2.0:1782759487.916684:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1782759487.916694:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708903e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211957120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759487.916716:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759487.916761:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708903e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211957120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759487.916767:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1782759487.916850:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211957120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759488.107910:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759489.133100:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759489.204807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759489.204863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759489.204869:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275136 00000100:00100000:1.0:1782759489.204878:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275136 00000100:00100000:3.0:1782759489.204887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759489.204907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759489.204923:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2808 00000100:00100000:3.0:1782759489.204933:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275392 00000100:00100000:1.0:1782759489.204933:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197275136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759489.204937:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275392 00000100:00100000:3.0:1782759489.204966:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275520 00000100:00100000:3.0:1782759489.204969:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275520 00000100:00100000:3.0:1782759489.204986:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2000 00000100:00100000:3.0:1782759489.204992:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197275392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759489.204995:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197275136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.205001:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2808 00000100:00100000:3.0:1782759489.205017:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197275392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.205023:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2000 00000100:00100000:3.0:1782759489.205033:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2001 00000100:00100000:3.0:1782759489.205038:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197275520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759489.205074:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197275520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.205081:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2001 00000100:00100000:3.0:1782759489.205099:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275264 00000100:00100000:3.0:1782759489.205102:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275264 00000100:00100000:3.0:1782759489.205127:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2551 00000100:00100000:3.0:1782759489.205133:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2364:x1869355197275264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759489.205161:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2364:x1869355197275264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.205167:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2551 00000100:00080000:3.0:1782759489.205186:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759489.205189:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759489.205191:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782759489.533056:0:146383:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffddbd2360 20000000:00000080:2.0:1782759489.533074:0:146383:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb0800 uarg=0000000000000000 00010000:00010000:2.0:1782759489.536350:0:146383:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759489.536371:0:146383:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759489.536428:0:146383:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759489.536448:0:146383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.536491:0:146383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.536500:0:146383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.536539:0:146383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.536560:0:146383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 18 pid: 5796 timeout: 3657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759489.536574:0:146383:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146383:1869355211957248:0@lo:104: 00000100:00100000:2.0:1782759489.536812:0:146383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759489.536866:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211957248 00000100:00100000:1.0:1782759489.536873:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211957248 00000100:00100000:2.0:1782759489.536883:0:146383:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719192c000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759489.536916:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1782759489.536924:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:146383:x1869355211957248:12345-0@lo:104: 00010000:00010000:1.0:1782759489.536934:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.536980:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759489.536985:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:146383:x1869355211957248:12345-0@lo:104: Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.536990:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00010000:00010000:0.0:1782759489.537004:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759489.537005:0:146383:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146383:1869355211957248:0@lo:104: 00010000:00010000:0.0:1782759489.537011:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537017:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759489.537021:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.537022:0:146383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537029:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759489.537044:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759489.537050:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759489.537082:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537087:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759489.537183:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537191:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f98a00/0xdd99f5c4777df9f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759489.537196:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211957376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759489.537207:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759489.537209:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759489.537211:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759489.537223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759489.537302:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211957376 00000100:00100000:0.0:1782759489.537307:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211957376 00010000:00010000:0.0:1782759489.537325:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 19 pid: 5796 timeout: 3657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759489.537351:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1782759489.537356:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211957376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759489.537364:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759489.537367:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 19 pid: 5796 timeout: 3657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537374:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 19 pid: 5796 timeout: 3657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537387:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65400/0xdd99f5c4777df9fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df9f3 expref: 19 pid: 5796 timeout: 3657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537398:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537405:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537418:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537425:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537433:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537439:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537445:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759489.537449:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537457:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537474:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759489.537494:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759489.537513:0:146383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.537521:0:146383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759489.537527:0:146383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65200/0xdd99f5c4777dfa01 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759489.537536:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211957376:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759489.537542:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1782759489.537602:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211957376:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1782759489.938949:0:146431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd658b1650 20000000:00000080:1.0:1782759489.938964:0:146431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb93c400 uarg=0000000000000000 00010000:00010000:1.0:1782759489.939170:0:146431:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759489.939183:0:146431:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759489.939198:0:146431:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759489.939216:0:146431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939231:0:146431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939241:0:146431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939247:0:146431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939252:0:146431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939258:0:146431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939265:0:146431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759489.939269:0:146431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939277:0:146431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939288:0:146431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939301:0:146431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759489.939308:0:146431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777dfa08 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759489.989061:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967399 is committed 00000001:00080000:3.0:1782759489.989080:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967398 is committed 00010000:00010000:2.0:1782759490.156480:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759490.306958:0:146481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdad05f960 20000000:00000080:3.0:1782759490.306976:0:146481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b3471000 uarg=0000000000000000 00010000:00010000:3.0:1782759490.307234:0:146481:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759490.307250:0:146481:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759490.307272:0:146481:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759490.307293:0:146481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307310:0:146481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307321:0:146481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307338:0:146481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307345:0:146481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307352:0:146481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307359:0:146481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759490.307363:0:146481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307371:0:146481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307384:0:146481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307392:0:146481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759490.307398:0:146481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777dfa0f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759490.476094:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211957504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759490.476200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759490.476256:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211957504 00000100:00100000:0.0:1782759490.476267:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211957504 00000100:00100000:0.0:1782759490.476467:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1782759490.476478:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211957504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759490.476516:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782759490.476545:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759490.476614:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211957504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759490.476626:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1782759490.476676:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967410 gen 2 00000004:00080000:1.0:1782759490.476697:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917190265f80, transno 4294967410 00000100:00100000:1.0:1782759490.476732:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211957504:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782759490.659082:0:146530:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5165f790 20000000:00000080:2.0:1782759490.659098:0:146530:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbc400 uarg=0000000000000000 00010000:00010000:2.0:1782759490.659303:0:146530:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759490.659316:0:146530:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759490.659331:0:146530:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759490.659349:0:146530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659365:0:146530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659374:0:146530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659381:0:146530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659389:0:146530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659396:0:146530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659403:0:146530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759490.659407:0:146530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659415:0:146530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659434:0:146530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659441:0:146530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759490.659448:0:146530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64e00/0xdd99f5c4777dfa16 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.180018:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759491.307950:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759491.307957:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759491.307961:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759491.308009:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308020:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308044:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759491.308075:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211957632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759491.308154:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759491.308206:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170812ab000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759491.308228:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211957632 00000100:00100000:2.0:1782759491.308235:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211957632 00000100:00100000:2.0:1782759491.308282:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:2.0:1782759491.308291:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211957632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759491.308303:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759491.308323:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfa1d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308346:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308357:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308366:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65e00, rc 0) 00000100:00100000:2.0:1782759491.308405:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211957632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759491.308413:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:2.0:1782759491.308465:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211957632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759491.308480:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308489:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759491.308528:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759491.308534:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.308542:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759492.029491:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968070 is committed 00000004:00080000:3.0:1782759492.029501:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 120 committed 00000100:00100000:1.0:1782759492.029786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759492.029801:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211957760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782759492.029885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759492.030049:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211957760 00000100:00100000:2.0:1782759492.030057:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211957760 00000100:00080000:3.0:1782759492.030114:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759492.030133:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1782759492.030143:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211957760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782759492.030166:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:50 count 1 00010000:00010000:2.0:1782759492.030187:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.030207:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.030215:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782759492.030218:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759492.030223:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.030245:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.030258:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 6 pid: 6599 timeout: 3660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759492.030269:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211957888:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759492.030323:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170827483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759492.033041:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355211957888:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759492.033076:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.033694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759492.033773:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275648 00000100:00100000:0.0:1782759492.033780:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275648 00010000:00010000:0.0:1782759492.033850:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 7 pid: 6599 timeout: 3660 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.033885:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 643 00000100:00100000:0.0:1782759492.033894:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197275648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759492.033908:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759492.033914:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 7 pid: 6599 timeout: 3660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.033926:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 7 pid: 6599 timeout: 3660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.033963:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4ff52db/0xdd99f5c4777df9c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ee8 expref: 7 pid: 6599 timeout: 3660 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.033976:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759492.033980:0:5785:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759492.033986:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.033994:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034019:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759492.034064:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197275648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.034071:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 643 00010000:00010000:0.0:1782759492.034188:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034198:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034207:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034214:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034236:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782759492.034666:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355211957760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4524us (4780us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1782759492.034674:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00010000:00010000:0.0:1782759492.034693:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759492.034699:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034706:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759492.034710:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034718:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034730:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034737:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000199eb850/0xdd99f5c4777dfa2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.034752:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759492.034753:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759492.034755:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759492.034856:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967399 gen 2 00000100:00100000:1.0:1782759492.034872:0:3305:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9171b7765c00 x1869355211957760/t4294967400(4294967400) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782759508 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782759492.034882:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7765c00/2, rc 0, transno 4294967400 00000100:00100000:1.0:1782759492.034887:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211957760:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1782759492.034987:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782759492.203920:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759492.247111:0:146727:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7c4e4fe0 20000000:00000080:3.0:1782759492.247131:0:146727:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc0800 uarg=0000000000000000 10000000:01000000:3.0:1782759492.247586:0:146727:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759492.247605:0:146727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.247623:0:146727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.247632:0:146727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.247672:0:146727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.247683:0:146727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 18 pid: 5796 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.247694:0:146727:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146727:1869355211958016:0@lo:104: 00000100:00100000:3.0:1782759492.247743:0:146727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759492.247783:0:146727:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759492.247794:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958016 00000100:00100000:0.0:1782759492.247808:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958016 00000100:00100000:0.0:1782759492.247893:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1782759492.247902:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:146727:x1869355211958016:12345-0@lo:104: 00010000:00010000:0.0:1782759492.247915:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.247983:0:146727:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146727:1869355211958016:0@lo:104: 00010000:00010000:0.0:1782759492.247984:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759492.247994:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:146727:x1869355211958016:12345-0@lo:104: Request processed in 92us (248us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759492.248000:0:146727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.248001:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:2.0:1782759492.248082:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759492.248090:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.248110:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759492.248114:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.248123:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759492.248131:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759492.248136:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759492.248173:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.248180:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759492.248208:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.248216:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d64200/0xdd99f5c4777dfa1d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfa24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.248230:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211958144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759492.248233:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759492.248238:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759492.248240:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759492.248264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759492.248295:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958144 00000100:00100000:0.0:1782759492.248301:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958144 00010000:00010000:0.0:1782759492.248321:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 19 pid: 5796 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.248347:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1782759492.248356:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211958144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759492.248367:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759492.248372:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 19 pid: 5796 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248382:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 19 pid: 5796 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248394:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65e00/0xdd99f5c4777dfa24 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfa1d expref: 19 pid: 5796 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248406:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248424:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248436:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248442:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248448:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248454:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248511:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759492.248515:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248520:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248541:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.248555:0:146727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.248557:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759492.248563:0:146727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.248568:0:146727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa32 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.248603:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211958144:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.248613:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1782759492.248639:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211958144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759492.524629:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759492.524666:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211958400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759492.524695:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211958656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759492.524782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759492.524886:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759492.524906:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958400 00000100:00100000:1.0:1782759492.524916:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759492.524917:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958400 00000100:00100000:1.0:1782759492.524932:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211958528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759492.524973:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211958272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759492.525015:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958656 00000100:00100000:2.0:1782759492.525021:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958656 00000100:00100000:0.0:1782759492.525027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759492.525074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759492.525076:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958272 00000100:00100000:2.0:1782759492.525082:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958272 00000100:00100000:0.0:1782759492.525117:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:0.0:1782759492.525130:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211958400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759492.525158:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1782759492.525177:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211958656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759492.525217:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1782759492.525225:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211958400:12345-0@lo:400:kworker.0 Request processed in 94us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.525232:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1782759492.525235:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211958272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759492.525243:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1782759492.525250:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1782759492.525269:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211958656:12345-0@lo:400:kworker.0 Request processed in 97us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.525281:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:3.0:1782759492.525284:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958528 00000100:00100000:3.0:1782759492.525292:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958528 00000100:00080000:0.0:1782759492.525312:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759492.525319:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759492.525322:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211958272:12345-0@lo:400:kworker.0 Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.525338:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1782759492.525365:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1782759492.525370:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211958656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759492.525381:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211958528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759492.525398:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211958400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759492.525415:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211958272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759492.525470:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211958528:12345-0@lo:400:kworker.0 Request processed in 91us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.525480:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1782759492.525488:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211958528:0@lo:400:kworker.0 00000020:00000080:3.0:1782759492.618222:0:146776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0f880a60 20000000:00000080:3.0:1782759492.618241:0:146776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c7000 uarg=0000000000000000 10000000:01000000:3.0:1782759492.618421:0:146776:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759492.618438:0:146776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618451:0:146776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618466:0:146776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618470:0:146776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618475:0:146776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618480:0:146776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618483:0:146776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759492.618486:0:146776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618491:0:146776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618499:0:146776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618503:0:146776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.618507:0:146776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dfa39 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759492.985739:0:146824:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe37e5b70 20000000:00000080:2.0:1782759492.985761:0:146824:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbe000 uarg=0000000000000000 00010000:00010000:2.0:1782759492.986251:0:146824:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759492.986264:0:146824:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759492.986280:0:146824:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759492.986299:0:146824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986314:0:146824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986324:0:146824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986331:0:146824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986339:0:146824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986347:0:146824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986353:0:146824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759492.986357:0:146824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986372:0:146824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986385:0:146824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986394:0:146824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.986401:0:146824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64c00/0xdd99f5c4777dfa40 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759493.035970:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759493.035993:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211958784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759493.036061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759493.036119:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958784 00000100:00100000:2.0:1782759493.036128:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958784 00000100:00100000:2.0:1782759493.036191:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1782759493.036200:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211958784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759493.036250:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759493.036315:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211958784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759493.036323:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1782759493.036376:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211958784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759493.228044:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759493.804448:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759493.804458:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759493.804469:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759493.804580:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.804592:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.804603:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759493.804628:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211958912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759493.804697:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759493.804970:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211958912 00000100:00100000:1.0:1782759493.804979:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211958912 00000100:00100000:3.0:1782759493.805004:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818e59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759493.805037:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:1.0:1782759493.805049:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211958912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759493.805064:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759493.805079:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfa47 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.805106:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.805118:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.805127:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4a00, rc 0) 00000100:00100000:1.0:1782759493.805178:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211958912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759493.805185:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:3.0:1782759493.805660:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211958912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759493.805677:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.805687:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759493.805709:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759493.805715:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.805723:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.252052:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759494.324456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759494.324507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759494.324508:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275776 00000100:00100000:2.0:1782759494.324518:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275776 00000100:00100000:2.0:1782759494.324566:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2811 00000100:00100000:2.0:1782759494.324577:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197275776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759494.324587:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759494.324631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759494.324645:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197275776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.324657:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2811 00000100:00100000:1.0:1782759494.324805:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197275904 00000100:00100000:1.0:1782759494.324810:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197275904 00000100:00080000:2.0:1782759494.324871:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759494.324883:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2555 00000100:00100000:1.0:1782759494.324894:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197275904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759494.324940:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197275904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.324948:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2555 00000100:00100000:0.0:1782759494.325129:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197276032 00000100:00100000:0.0:1782759494.325134:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197276032 00000100:00100000:0.0:1782759494.325188:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197276160 00000100:00100000:0.0:1782759494.325192:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197276160 00000100:00100000:0.0:1782759494.325217:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2003 00000100:00100000:0.0:1782759494.325225:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197276032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759494.325266:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197276032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759494.325273:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2003 00000100:00080000:2.0:1782759494.325290:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759494.325294:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2004 00000100:00080000:2.0:1782759494.325296:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759494.325311:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197276160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759494.325341:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197276160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759494.325350:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2004 00000020:00000080:0.0:1782759494.702644:0:147019:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0f29e930 20000000:00000080:0.0:1782759494.702662:0:147019:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfec400 uarg=0000000000000000 00010000:00010000:0.0:1782759494.702946:0:147019:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759494.702960:0:147019:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759494.702974:0:147019:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759494.702990:0:147019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.703005:0:147019:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.703012:0:147019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.703048:0:147019:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.703064:0:147019:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 18 pid: 5793 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759494.703079:0:147019:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147019:1869355211959040:0@lo:104: 00000100:00100000:0.0:1782759494.703140:0:147019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759494.703195:0:147019:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759494.703261:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959040 00000100:00100000:2.0:1782759494.703268:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959040 00000100:00100000:2.0:1782759494.703311:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1782759494.703319:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:147019:x1869355211959040:12345-0@lo:104: 00010000:00010000:2.0:1782759494.703331:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.703421:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759494.703428:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:147019:x1869355211959040:12345-0@lo:104: Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.703435:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00010000:00010000:3.0:1782759494.703448:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759494.703457:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.703473:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759494.703477:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.703499:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759494.703506:0:147019:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147019:1869355211959040:0@lo:104: 10000000:00010000:3.0:1782759494.703509:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759494.703518:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759494.703526:0:147019:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.703555:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.703564:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759494.703592:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.703600:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777dfa47 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfa4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.703618:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1782759494.703619:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759494.703622:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759494.703626:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759494.703633:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211959168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759494.703661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.703699:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959168 00000100:00100000:1.0:1782759494.703705:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959168 00010000:00010000:1.0:1782759494.703728:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 19 pid: 5793 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.703753:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1782759494.703761:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211959168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759494.703771:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759494.703777:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 19 pid: 5793 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703786:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 19 pid: 5793 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703797:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777dfa4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfa47 expref: 19 pid: 5793 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703809:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703837:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703850:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703857:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703864:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703870:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703876:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759494.703880:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703887:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703900:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.703923:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759494.703940:0:147019:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.703949:0:147019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.703956:0:147019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98600/0xdd99f5c4777dfa55 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.703977:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211959168:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.703985:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1782759494.704139:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211959168:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1782759495.104029:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967400 is committed 00010000:00010000:1.0:1782759495.276036:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759495.596055:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759495.596083:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211959296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759495.596157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759495.596204:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959296 00000100:00100000:1.0:1782759495.596214:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959296 00000100:00100000:1.0:1782759495.596286:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00080000:3.0:1782759495.596289:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759495.596314:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211959296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759495.596356:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759495.596433:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211959296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759495.596448:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1782759495.597061:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211959296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759495.969791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759495.969910:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197276416 00000100:00100000:0.0:1782759495.969919:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197276416 00000100:00100000:0.0:1782759495.969970:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2082 00000100:00100000:0.0:1782759495.969989:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:101653:x1869355197276416:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759495.970364:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.970382:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.970396:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.970410:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.970428:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.970435:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759495.971681:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x11:0x0]: returning size 512 00010000:00010000:0.0:1782759495.971696:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.971705:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.971711:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.971717:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759495.971721:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.971728:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.971742:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759495.971745:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759495.971750:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.971756:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa5c lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759495.971783:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe593e4e reply state 000000001278789b transno 4294968071 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759495.971791:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759495.971894:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:101653:x1869355197276416:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1913us (2118us total) trans 4294968071 rc 0/0 00000100:00100000:0.0:1782759495.971902:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2082 00010000:00010000:3.0:1782759495.974280:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.974301:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.974309:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.974315:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759495.974320:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.974328:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.974342:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff917183a70d00) 00010000:00010000:3.0:1782759495.974345:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759495.974349:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.974355:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfa63 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759495.980030:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759495.980081:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197276672 00000100:00100000:0.0:1782759495.980093:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197276672 00000100:00100000:0.0:1782759495.980159:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2083 00000100:00100000:0.0:1782759495.980171:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:101654:x1869355197276672:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759495.980203:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759495.980227:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfa6a lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66eef expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.980346:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.980361:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.980372:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.980384:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.980391:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.980410:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759495.981232:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33:0x0], index 0: 0 00010000:00010000:0.0:1782759495.981469:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa7f lrc: 3/1,0 mode: --/PR res: [0x200000418:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981481:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa7f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981489:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa7f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759495.981699:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968072 00010000:00010000:0.0:1782759495.981778:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981786:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981794:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981801:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759495.981806:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981812:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981846:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759495.981855:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759495.981861:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981868:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfa71 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759495.981884:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f903053b reply state 000000008c3b6741 transno 4294968073 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759495.981893:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759495.981923:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfa6a lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eef expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981951:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa7f lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eef expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759495.981959:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759495.981962:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759495.981965:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98800, rc 0) 00000100:00100000:0.0:1782759495.982027:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101654:x1869355197276672:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1859us (2005us total) trans 4294968073 rc 0/0 00000100:00100000:0.0:1782759495.982035:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2083 00000020:00080000:0.0:1782759495.982040:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782759495.982971:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.982982:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.982989:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.982995:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759495.983006:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.983013:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.983025:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff917183a70c00) 00010000:00010000:3.0:1782759495.983028:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759495.983031:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.983037:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777dfa78 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759495.985349:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759495.985443:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197276928 00000100:00100000:3.0:1782759495.985452:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197276928 00000100:00100000:3.0:1782759495.985518:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2084 00000100:00100000:3.0:1782759495.985529:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101654:x1869355197276928:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:3.0:1782759495.985579:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759495.985598:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfa7f lrc: 0/0,0 mode: --/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66eef expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.985610:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff917183a70f00) 00010000:00010000:3.0:1782759495.985619:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759495.985654:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,1 mode: --/PW res: [0x200000418:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.985664:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.985679:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759495.986063:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000931c290e reply state 00000000230fc4b3 transno 4294968074 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759495.986073:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759495.986457:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101654:x1869355197276928:12345-192.168.204.31@tcp:36:touch.0 Request processed in 928us (1112us total) trans 4294968074 rc 0/0 00000100:00100000:3.0:1782759495.986477:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2084 00010000:00010000:3.0:1782759495.987301:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.987309:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.987314:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.987318:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759495.987321:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.987325:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.987335:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759495.987337:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759495.987340:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 2/0,0 mode: --/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759495.987352:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfa8d lrc: 0/0,0 mode: --/PW res: [0x200000418:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759495.987755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759495.987921:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277056 00000100:00100000:2.0:1782759495.987929:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277056 00000100:00100000:2.0:1782759495.987976:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2085 00000100:00100000:2.0:1782759495.987987:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101654:x1869355197277056:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759495.988006:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759495.988022:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777dfa94 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ef6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.988080:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777dfa94 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ef6 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.988095:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777dfa94 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ef6 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.988115:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759495.988118:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759495.988120:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64200, rc 0) 00000100:00100000:2.0:1782759495.988162:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101654:x1869355197277056:12345-192.168.204.31@tcp:101:touch.0 Request processed in 176us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759495.988170:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2085 00000100:00100000:3.0:1782759495.989262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759495.989303:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277184 00000100:00100000:0.0:1782759495.989308:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277184 00000100:00100000:0.0:1782759495.989351:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1010 00000100:00100000:0.0:1782759495.989360:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197277184:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:0.0:1782759495.989788:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197277184:12345-192.168.204.31@tcp:2:touch.0 Request processed in 428us (525us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1782759495.989802:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1010 00000100:00100000:3.0:1782759495.992401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759495.992436:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277440 00000100:00100000:3.0:1782759495.992445:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277440 00000100:00100000:3.0:1782759495.992516:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 266 00000100:00100000:3.0:1782759495.992527:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101654:x1869355197277440:12345-192.168.204.31@tcp:35:touch.0 00000001:00080000:3.0:1782759495.993079:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968075 00000100:00100000:3.0:1782759495.993194:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101654:x1869355197277440:12345-192.168.204.31@tcp:35:touch.0 Request processed in 668us (798us total) trans 4294968076 rc 0/0 00000100:00100000:3.0:1782759495.993203:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 266 00000020:00080000:3.0:1782759495.993208:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782759496.008588:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.008638:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277568 00000100:00100000:2.0:1782759496.008646:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277568 00000100:00080000:3.0:1782759496.008700:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759496.008721:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2086 00000100:00100000:2.0:1782759496.008731:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277568:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759496.009059:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277568:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 328us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.009068:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2086 00000100:00100000:0.0:1782759496.010358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.010454:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277696 00000100:00100000:2.0:1782759496.010474:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277696 00000100:00100000:2.0:1782759496.010508:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2087 00000100:00100000:2.0:1782759496.010519:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277696:12345-192.168.204.31@tcp:503:chlg_load_threa.0 00000040:00080000:2.0:1782759496.010684:0:19544:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759496.010740:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277696:12345-192.168.204.31@tcp:503:chlg_load_threa.0 Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.010748:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2087 00000100:00100000:3.0:1782759496.012896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759496.012977:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277824 00000100:00100000:0.0:1782759496.012984:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277824 00000100:00100000:0.0:1782759496.013175:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2088 00000100:00100000:0.0:1782759496.013183:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277824:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1782759496.013292:0:5802:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1782759496.013358:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277824:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 176us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759496.013370:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2088 00000100:00100000:3.0:1782759496.015603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759496.015851:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197277952 00000100:00100000:0.0:1782759496.015858:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197277952 00000100:00100000:0.0:1782759496.015899:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2089 00000100:00100000:0.0:1782759496.015906:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277952:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1782759496.016020:0:5801:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1782759496.016079:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197277952:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 174us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759496.016085:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2089 00000100:00100000:3.0:1782759496.018020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759496.018415:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278080 00000100:00100000:1.0:1782759496.018423:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278080 00000100:00100000:1.0:1782759496.018495:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2090 00000100:00100000:1.0:1782759496.018504:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278080:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1782759496.018597:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278080:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 94us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759496.018605:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2090 00000100:00100000:3.0:1782759496.020218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.020265:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278208 00000100:00100000:2.0:1782759496.020270:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278208 00000100:00100000:2.0:1782759496.020306:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2091 00000100:00100000:2.0:1782759496.020313:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278208:12345-192.168.204.31@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1782759496.020443:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278208:12345-192.168.204.31@tcp:503:chlg_load_threa.0 Request processed in 131us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.020448:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2091 00000100:00100000:3.0:1782759496.021316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.021356:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278336 00000100:00100000:2.0:1782759496.021362:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278336 00000100:00100000:2.0:1782759496.021397:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2092 00000100:00100000:2.0:1782759496.021406:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278336:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1782759496.021518:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278336:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 111us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.021526:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2092 00000100:00100000:3.0:1782759496.023186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759496.023230:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278464 00000100:00100000:1.0:1782759496.023237:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278464 00000100:00100000:1.0:1782759496.023278:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2093 00000100:00100000:1.0:1782759496.023285:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278464:12345-192.168.204.31@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1782759496.023399:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101658:x1869355197278464:12345-192.168.204.31@tcp:502:chlg_load_threa.0 Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759496.023407:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2093 00000100:00100000:3.0:1782759496.065632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759496.065742:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278592 00000100:00100000:0.0:1782759496.065755:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278592 00000100:00100000:0.0:1782759496.065881:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2094 00000100:00100000:0.0:1782759496.065895:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101667:x1869355197278592:12345-192.168.204.31@tcp:46:lfs.0 00000004:00000080:0.0:1782759496.065953:0:5802:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9171980ee0e0 uarg=0000000000000000 00000004:00000080:0.0:1782759496.066012:0:5802:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9171980ee0e0 00000004:00000080:0.0:1782759496.066020:0:5802:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:0.0:1782759496.066172:0:5802:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782759496.066178:0:5802:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1782759496.066220:0:5802:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 24 00000040:00080000:0.0:1782759496.066332:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:0.0:1782759496.066338:0:5802:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1782759496.066345:0:5802:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:0.0:1782759496.066377:0:5802:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782759496.066380:0:5802:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1782759496.067995:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 24 count 1 00000040:00080000:0.0:1782759496.068005:0:5802:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:0.0:1782759496.068158:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101667:x1869355197278592:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 2262us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759496.068169:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2094 00000100:00100000:3.0:1782759496.075039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759496.075189:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278720 00000100:00100000:0.0:1782759496.075203:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278720 00000100:00100000:0.0:1782759496.075285:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2095 00000100:00100000:0.0:1782759496.075297:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101668:x1869355197278720:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782759496.075321:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759496.075355:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777dfa9b lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66efd expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075421:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075435:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075446:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075490:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075497:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075504:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075596:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfab0 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075603:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfab0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x11:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075610:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfab0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x11:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759496.075644:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x11:0x0]: returning size 512 00000004:00200000:0.0:1782759496.075647:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759496.075670:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfab0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x11:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075681:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075687:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075694:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075708:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759496.075712:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075720:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075732:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759496.075735:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759496.075739:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075745:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777dfaa2 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075758:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075763:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075768:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075773:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759496.075775:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075781:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075798:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff917183a70500) 00010000:00010000:0.0:1782759496.075800:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759496.075802:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075808:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfaa9 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075884:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777dfa9b lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66efd expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075904:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfab0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x11:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66efd expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.075912:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x11:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759496.075915:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759496.075917:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98800, rc 0) 00000100:00100000:0.0:1782759496.075990:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101668:x1869355197278720:12345-192.168.204.31@tcp:101:rm.0 Request processed in 695us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759496.075998:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2095 00000100:00100000:3.0:1782759496.078931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759496.079046:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197278976 00000100:00100000:1.0:1782759496.079056:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197278976 00000100:00100000:1.0:1782759496.079290:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2096 00000100:00100000:1.0:1782759496.079303:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101668:x1869355197278976:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759496.079339:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759496.079362:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfab7 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f04 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759496.079486:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x11:0x0]: returning size 512 00010000:00010000:1.0:1782759496.079880:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfab7 lrc: 1/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f04 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.079895:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759496.079899:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759496.079904:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfab7 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f04 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.079922:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782759496.079982:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101668:x1869355197278976:12345-192.168.204.31@tcp:101:rm.0 Request processed in 679us (1056us total) trans 4294968077 rc 301/301 00000100:00100000:1.0:1782759496.079989:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2096 00000100:00100000:3.0:1782759496.082384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759496.082435:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197279104 00000100:00100000:1.0:1782759496.082443:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197279104 00000100:00100000:1.0:1782759496.082500:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 267 00000100:00100000:1.0:1782759496.082511:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101668:x1869355197279104:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:1.0:1782759496.084375:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101668:x1869355197279104:12345-192.168.204.31@tcp:37:rm.0 Request processed in 1860us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759496.084386:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 267 00000100:00100000:3.0:1782759496.086356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759496.086408:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197279360 00000100:00100000:0.0:1782759496.086417:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197279360 00000100:00100000:0.0:1782759496.086478:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 268 00000100:00100000:0.0:1782759496.086488:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101668:x1869355197279360:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:0.0:1782759496.087325:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101668:x1869355197279360:12345-192.168.204.31@tcp:35:rm.0 Request processed in 836us (972us total) trans 4294968078 rc 0/0 00000100:00100000:0.0:1782759496.087334:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 268 00000100:00100000:3.0:1782759496.089383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.089581:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197279616 00000100:00100000:2.0:1782759496.089589:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197279616 00000100:00100000:2.0:1782759496.089637:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2097 00000100:00100000:2.0:1782759496.089646:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101668:x1869355197279616:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759496.089696:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759496.089721:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfab0 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x11:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66efd expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.089788:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x11:0x0].0x0 (ffff917183a70100) 00010000:00010000:2.0:1782759496.089812:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759496.089980:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.089993:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090003:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090013:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090019:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090025:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090119:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090127:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090146:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759496.090745:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x11:0x0]: returning size 512 00010000:00010000:2.0:1782759496.090762:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090769:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090781:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090787:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.090790:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090798:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090807:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x11:0x0].0x0 (ffff9171c08f6900) 00010000:00010000:2.0:1782759496.090809:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759496.090813:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.090819:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64800/0xdd99f5c4777dfad3 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091025:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091031:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091037:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091043:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.091046:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091061:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091070:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6e00) 00010000:00010000:2.0:1782759496.091072:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759496.091075:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.091081:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65e00/0xdd99f5c4777dfac5 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759496.091091:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e17fac1b reply state 00000000ad85271e transno 4294968079 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759496.091099:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759496.091232:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101668:x1869355197279616:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1585us (1865us total) trans 4294968079 rc 0/0 00000100:00100000:2.0:1782759496.091240:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2097 00010000:00010000:2.0:1782759496.092229:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.092240:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.092246:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.092251:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.092255:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.092273:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.092284:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171c08f6800) 00010000:00010000:2.0:1782759496.092287:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759496.092291:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.092297:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65400/0xdd99f5c4777dfacc lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759496.092575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.092791:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197279744 00000100:00100000:2.0:1782759496.092799:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197279744 00000100:00100000:2.0:1782759496.092923:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2098 00000100:00100000:2.0:1782759496.092934:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101668:x1869355197279744:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759496.092956:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759496.092977:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777dfada lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f0b expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093033:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093045:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093053:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093063:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093160:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093168:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093246:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 3/1,0 mode: --/PR res: [0x200000418:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093253:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093257:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759496.093282:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x12:0x0]: returning size 0 00000004:00200000:2.0:1782759496.093285:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759496.093299:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093306:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093311:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093315:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093318:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093328:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.093331:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093335:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093341:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:2.0:1782759496.093342:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759496.093344:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093348:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64a00/0xdd99f5c4777dfae1 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093355:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093358:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093362:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093365:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d65c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.093366:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093370:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093384:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6700) 00010000:00010000:2.0:1782759496.093386:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759496.093389:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093395:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65c00/0xdd99f5c4777dfae8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093421:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65800/0xdd99f5c4777dfada lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f0b expref: 17 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093434:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f0b expref: 16 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.093441:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759496.093444:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759496.093446:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d65200, rc 0) 00000100:00100000:2.0:1782759496.093508:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101668:x1869355197279744:12345-192.168.204.31@tcp:101:rm.0 Request processed in 576us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.093514:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2098 00000100:00100000:3.0:1782759496.095022:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.095071:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197279872 00000100:00100000:2.0:1782759496.095079:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197279872 00000100:00100000:2.0:1782759496.095135:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1011 00000100:00100000:2.0:1782759496.095143:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197279872:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759496.095157:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782759496.095172:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759496.095173:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f12 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759496.095209:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x6a42c047, atime: 0x6a42c047, ctime: 0x6a42c047, blocks: 0x1 00010000:00010000:2.0:1782759496.095226:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=3564s v=(0 0) 00010000:00010000:2.0:1782759496.095231:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759496.095240:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.095257:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.095267:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d64e00, rc 0) 00000100:00100000:2.0:1782759496.095305:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197279872:12345-192.168.204.31@tcp:101:rm.0 Request processed in 163us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.095312:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1011 00000100:00100000:3.0:1782759496.096795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759496.097005:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197280128 00000100:00100000:2.0:1782759496.097012:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197280128 00000100:00100000:2.0:1782759496.097053:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2099 00000100:00100000:2.0:1782759496.097062:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101668:x1869355197280128:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759496.097115:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782759496.097136:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d65200/0xdd99f5c4777dfaef lrc: 0/0,0 mode: --/PR res: [0x200000418:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f0b expref: 16 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097154:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64200/0xdd99f5c4777dfa94 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ef6 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097171:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759496.097179:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759496.097195:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097202:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097209:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097225:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097230:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097234:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097336:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 3/0,1 mode: --/EX res: [0x200000418:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097344:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.097351:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759496.098021:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].54, 64 off11768 00000004:00080000:2.0:1782759496.098029:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3564501205812ns, next at 3565501203933ns, rc = 0 00010000:00010000:2.0:1782759496.098109:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098119:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098132:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098140:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098145:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098151:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098172:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759496.098191:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098198:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098204:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098209:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.098213:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.098214:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759496.098224:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098224:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.098233:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759496.098240:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098246:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759496.098251:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759496.098255:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 2/0,0 mode: --/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.098257:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098264:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777dfb0b lrc: 0/0,0 mode: --/EX res: [0x200000418:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.098272:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x12:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:3.0:1782759496.098277:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782759496.098280:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 1/0,0 mode: --/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098282:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098292:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098298:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.098307:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfb12 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098308:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d64c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759496.098314:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098323:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.098329:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759496.098332:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6400) 00010000:00010000:3.0:1782759496.098333:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759496.098338:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759496.098339:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759496.098343:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.098350:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d64c00/0xdd99f5c4777dfafd lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759496.098370:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f245e23 reply state 0000000021498b25 transno 4294968080 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759496.098375:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759496.098430:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101668:x1869355197280128:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1370us (1639us total) trans 4294968080 rc 0/0 00000100:00100000:2.0:1782759496.098436:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2099 00010000:00010000:0.0:1782759496.099573:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.099585:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.099592:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.099597:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759496.099601:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.099608:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.099619:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6300) 00010000:00010000:0.0:1782759496.099621:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759496.099625:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.099632:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfb04 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.299963:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759496.428058:0:147215:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa74a1b10 20000000:00000080:1.0:1782759496.428078:0:147215:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cdac00 uarg=0000000000000000 00010000:00010000:1.0:1782759496.428372:0:147215:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759496.428397:0:147215:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759496.428418:0:147215:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759496.428442:0:147215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428476:0:147215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428488:0:147215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428494:0:147215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428502:0:147215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428509:0:147215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428516:0:147215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759496.428521:0:147215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428530:0:147215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428546:0:147215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428554:0:147215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.428571:0:147215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777dfb19 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759496.555953:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759496.555966:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759496.555971:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759496.556023:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.556033:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.556040:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759496.556060:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211959424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759496.556117:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759496.556193:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959424 00000100:00100000:1.0:1782759496.556196:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759496.556201:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959424 00000100:00100000:2.0:1782759496.556254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:2.0:1782759496.556262:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211959424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759496.556273:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759496.556283:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfb20 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.556300:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.556307:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.556313:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91c00, rc 0) 00000100:00100000:2.0:1782759496.556356:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211959424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.556361:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:1.0:1782759496.556401:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211959424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759496.556417:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.556427:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759496.556444:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759496.556457:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.556482:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759497.147584:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968078 is committed 00000001:00080000:3.0:1782759497.147663:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968080 is committed 00000004:00080000:3.0:1782759497.147668:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 124 committed 00000100:00100000:0.0:1782759497.147857:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211959552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782759497.147929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759497.148043:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959552 00000100:00100000:1.0:1782759497.148051:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959552 00000100:00080000:3.0:1782759497.148092:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759497.148106:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1782759497.148115:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211959552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782759497.148140:0:9120:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:51 count 1 00010000:00010000:1.0:1782759497.148162:0:9120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.148182:0:9120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.148192:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782759497.148196:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759497.148201:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.148225:0:9120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.148239:0:9120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 6 pid: 6599 timeout: 3665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759497.148312:0:9120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211959680:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759497.148371:0:9120:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759497.151371:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759497.151468:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197280256 00000100:00100000:0.0:1782759497.151476:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197280256 00000100:00100000:1.0:1782759497.151482:0:9120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9120:1869355211959680:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759497.151517:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 7 pid: 6599 timeout: 3665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.151520:0:9120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759497.151581:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 646 00000100:00100000:0.0:1782759497.151591:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197280256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759497.151604:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759497.151609:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 7 pid: 6599 timeout: 3665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.151621:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 7 pid: 6599 timeout: 3665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.151645:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007911da7f/0xdd99f5c4777dfaf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f12 expref: 7 pid: 6599 timeout: 3665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.151658:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759497.151662:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759497.151667:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.151676:0:134476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.151699:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759497.151731:0:9120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.151741:0:9120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.151751:0:9120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.151759:0:9120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.151792:0:9120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759497.151848:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759497.151857:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.151878:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759497.151883:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.151893:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.151906:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.151913:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4aaf943/0xdd99f5c4777dfb2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.151932:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759497.151934:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759497.151936:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759497.151970:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197280256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 378us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759497.151980:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 646 00000100:00100000:1.0:1782759497.152213:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211959552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4098us (4284us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1782759497.152221:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000004:00080000:0.0:1782759497.152255:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917190267480/2, rc 0, transno 4294967412 00000100:00100000:0.0:1782759497.152263:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211959552:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782759497.324947:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759497.632518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759497.632577:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197280512 00000100:00100000:1.0:1782759497.632588:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197280512 00000100:00100000:1.0:1782759497.632652:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2100 00000100:00100000:1.0:1782759497.632664:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:101742:x1869355197280512:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782759497.633184:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.633201:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.633215:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.633229:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.633237:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.633245:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759497.634903:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x13:0x0]: returning size 512 00010000:00010000:1.0:1782759497.634918:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.634929:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.634936:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.634942:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759497.634947:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.634965:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.634980:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:1.0:1782759497.634984:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759497.634989:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.634996:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfb35 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759497.635016:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032301e51 reply state 000000008f1eb915 transno 4294968081 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759497.635027:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759497.635133:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:101742:x1869355197280512:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2470us (2619us total) trans 4294968081 rc 0/0 00000100:00100000:1.0:1782759497.635142:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2100 00010000:00010000:2.0:1782759497.637284:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.637294:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.637299:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.637303:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759497.637305:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.637317:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.637328:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171889c5100) 00010000:00010000:2.0:1782759497.637330:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759497.637333:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.637337:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777dfb3c lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759497.642231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759497.642288:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197280768 00000100:00100000:1.0:1782759497.642299:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197280768 00000100:00100000:1.0:1782759497.642350:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2101 00000100:00100000:1.0:1782759497.642360:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:101743:x1869355197280768:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759497.642387:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759497.642409:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfb43 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f19 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.642673:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.642698:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.642709:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.642724:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.642793:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.642801:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759497.643501:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33:0x0], index 1: 0 00010000:00010000:1.0:1782759497.643695:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dfb58 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.643706:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dfb58 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.643715:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dfb58 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759497.644355:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968082 00010000:00010000:1.0:1782759497.644412:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644421:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644450:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644456:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759497.644461:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644469:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644482:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759497.644485:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759497.644490:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644495:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777dfb4a lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759497.644508:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f07346e8 reply state 00000000bfa0aa27 transno 4294968083 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759497.644516:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759497.644550:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfb43 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f19 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644571:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dfb58 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f19 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.644578:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171889c5500) 00010000:00010000:1.0:1782759497.644581:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759497.644589:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:3.0:1782759497.645059:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211959808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759497.645116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759497.645205:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101743:x1869355197280768:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2845us (2979us total) trans 4294968083 rc 0/0 00000100:00100000:0.0:1782759497.645214:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2101 00000020:00080000:0.0:1782759497.645220:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782759497.645261:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211960064:0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.645270:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959808 00000100:00100000:2.0:1782759497.645277:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959808 00000100:00100000:0.0:1782759497.645294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759497.645298:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211960320:0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645321:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782759497.645326:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1782759497.645331:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211959936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.645338:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211959808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759497.645387:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211960448:0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.645394:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211959808:12345-0@lo:400:kworker.0 Request processed in 58us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759497.645403:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1782759497.645417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759497.645455:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960064 00000100:00100000:2.0:1782759497.645459:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960064 00000100:00100000:0.0:1782759497.645466:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211960192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759497.645497:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211959936 00000100:00100000:2.0:1782759497.645501:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211959936 00000100:00100000:2.0:1782759497.645527:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1782759497.645529:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960448 00000100:00100000:0.0:1782759497.645535:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960448 00000100:00100000:2.0:1782759497.645537:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211960064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645568:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960192 00000100:00100000:0.0:1782759497.645572:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960192 00000100:00100000:2.0:1782759497.645583:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211960064:12345-0@lo:400:kworker.0 Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759497.645591:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1782759497.645595:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1782759497.645603:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211960448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.645615:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:2.0:1782759497.645632:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211959936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645639:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211960448:12345-0@lo:400:kworker.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759497.645645:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1782759497.645670:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1782759497.645676:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211959936:12345-0@lo:400:kworker.0 Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759497.645679:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211960192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.645689:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00080000:2.0:1782759497.645710:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759497.645715:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759497.645761:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211959936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.645774:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967400 gen 2 00000004:00080000:2.0:1782759497.645780:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7765c00, transno 4294967400 00000100:00100000:2.0:1782759497.645792:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211960448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645793:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211960192:12345-0@lo:400:kworker.0 Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759497.645804:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1782759497.645807:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211960064:0@lo:400:kworker.0 00000100:00100000:0.0:1782759497.645933:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211960192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759497.646632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759497.647283:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960320 00000100:00100000:2.0:1782759497.647289:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960320 00000100:00100000:2.0:1782759497.647328:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:2.0:1782759497.647334:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211960320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.647371:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211960320:12345-0@lo:400:kworker.0 Request processed in 38us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759497.647376:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00080000:2.0:1782759497.647390:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759497.647407:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211960320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759497.647467:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211959808:0@lo:400:kworker.0 00010000:00010000:3.0:1782759497.647494:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759497.647504:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759497.647511:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759497.647517:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759497.647521:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759497.647528:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759497.647540:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171889c5f00) 00010000:00010000:3.0:1782759497.647543:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759497.647547:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759497.647553:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777dfb51 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759497.647639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.647690:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281024 00000100:00100000:2.0:1782759497.647694:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281024 00000100:00100000:2.0:1782759497.647759:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2102 00000100:00100000:2.0:1782759497.647767:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101743:x1869355197281024:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:2.0:1782759497.647809:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759497.647849:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777dfb58 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f19 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.647859:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171889c5500) 00010000:00010000:2.0:1782759497.647866:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759497.647904:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.647913:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.647920:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759497.648170:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056212345 reply state 00000000d9294add transno 4294968084 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759497.648180:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759497.648251:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101743:x1869355197281024:12345-192.168.204.31@tcp:36:touch.0 Request processed in 484us (611us total) trans 4294968084 rc 0/0 00000100:00100000:2.0:1782759497.648258:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2102 00010000:00010000:1.0:1782759497.649293:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.649311:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.649319:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.649325:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759497.649330:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.649338:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.649358:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:1.0:1782759497.649361:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759497.649367:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.649373:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfb66 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759497.653162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759497.653214:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281152 00000100:00100000:1.0:1782759497.653227:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281152 00000100:00100000:1.0:1782759497.653311:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2103 00000100:00100000:1.0:1782759497.653324:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:101743:x1869355197281152:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:1.0:1782759497.653359:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759497.653400:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfb6d lrc: 2/0,0 mode: --/CR res: [0x200000418:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f20 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.653493:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfb6d lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f20 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.653510:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfb6d lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f20 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.653535:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759497.653539:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759497.653543:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782759497.653615:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101743:x1869355197281152:12345-192.168.204.31@tcp:101:touch.0 Request processed in 293us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759497.653625:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2103 00000100:00100000:3.0:1782759497.659064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759497.659111:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281280 00000100:00100000:1.0:1782759497.659123:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281280 00000100:00100000:1.0:1782759497.659218:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1013 00000100:00100000:1.0:1782759497.659234:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197281280:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:1.0:1782759497.660002:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197281280:12345-192.168.204.31@tcp:2:touch.0 Request processed in 771us (944us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1782759497.660011:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1013 00000100:00080000:1.0:1782759497.660047:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759497.663037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759497.663081:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281536 00000100:00100000:1.0:1782759497.663091:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281536 00000100:00100000:1.0:1782759497.663143:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 269 00000100:00100000:1.0:1782759497.663154:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:101743:x1869355197281536:12345-192.168.204.31@tcp:35:touch.0 00000001:00080000:1.0:1782759497.663978:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968085 00000100:00100000:1.0:1782759497.664117:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101743:x1869355197281536:12345-192.168.204.31@tcp:35:touch.0 Request processed in 962us (1086us total) trans 4294968086 rc 0/0 00000100:00100000:1.0:1782759497.664128:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 269 00000020:00080000:1.0:1782759497.664134:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1782759497.668646:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967411 is committed 00000001:00080000:3.0:1782759497.668671:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967412 is committed 00000100:00100000:1.0:1782759497.681512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.681576:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281664 00000100:00100000:2.0:1782759497.681587:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281664 00000100:00100000:2.0:1782759497.681638:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2104 00000100:00100000:2.0:1782759497.681645:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198912050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101747:x1869355197281664:12345-192.168.204.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759497.681736:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198912050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101747:x1869355197281664:12345-192.168.204.31@tcp:501:chlg_load_threa.0 Request processed in 92us (235us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759497.681757:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2104 00000100:00100000:1.0:1782759497.715312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759497.715374:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281792 00000100:00100000:3.0:1782759497.715384:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281792 00000100:00100000:3.0:1782759497.715453:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2105 00000100:00100000:3.0:1782759497.715465:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101754:x1869355197281792:12345-192.168.204.31@tcp:46:lfs.0 00000100:00100000:3.0:1782759497.715624:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101754:x1869355197281792:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 161us (318us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759497.715632:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2105 00000100:00100000:3.0:1782759497.721935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759497.722316:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197281920 00000100:00100000:1.0:1782759497.722324:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197281920 00000100:00100000:1.0:1782759497.722373:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2106 00000100:00100000:1.0:1782759497.722381:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:101755:x1869355197281920:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759497.722398:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759497.722421:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfb74 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722494:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722509:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722521:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722542:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722549:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722576:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722676:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfb89 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722683:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfb89 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722689:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfb89 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759497.722735:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x13:0x0]: returning size 512 00000004:00200000:1.0:1782759497.722738:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759497.722771:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfb89 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722784:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722791:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722798:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722803:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759497.722808:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722815:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722869:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171889c5000) 00010000:00010000:1.0:1782759497.722872:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759497.722877:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722884:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfb7b lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722897:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722904:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722918:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722927:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759497.722929:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722935:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722943:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171889c5200) 00010000:00010000:1.0:1782759497.722945:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759497.722948:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722955:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777dfb82 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.722997:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfb74 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f27 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.723013:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfb89 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x13:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f27 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.723018:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x13:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:1.0:1782759497.723019:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759497.723021:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759497.723070:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101755:x1869355197281920:12345-192.168.204.31@tcp:101:rm.0 Request processed in 690us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759497.723075:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2106 00000100:00100000:1.0:1782759497.725041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759497.725110:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197282176 00000100:00100000:0.0:1782759497.725119:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197282176 00000100:00100000:0.0:1782759497.725166:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2107 00000100:00100000:0.0:1782759497.725175:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:101755:x1869355197282176:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782759497.725193:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759497.725218:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfb90 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f2e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759497.725287:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x13:0x0]: returning size 512 00010000:00010000:0.0:1782759497.725649:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfb90 lrc: 1/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f2e expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.725659:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759497.725661:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759497.725663:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfb90 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f2e expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.725677:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98400, rc 0) 00000100:00100000:0.0:1782759497.725711:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101755:x1869355197282176:12345-192.168.204.31@tcp:101:rm.0 Request processed in 538us (678us total) trans 4294968087 rc 301/301 00000100:00100000:0.0:1782759497.725715:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2107 00000100:00100000:3.0:1782759497.727894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759497.727932:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197282304 00000100:00100000:0.0:1782759497.727940:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197282304 00000100:00100000:0.0:1782759497.727982:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 270 00000100:00100000:0.0:1782759497.727992:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101755:x1869355197282304:12345-192.168.204.31@tcp:37:rm.0 00000100:00100000:0.0:1782759497.730218:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101755:x1869355197282304:12345-192.168.204.31@tcp:37:rm.0 Request processed in 2222us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759497.730230:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 270 00000100:00100000:1.0:1782759497.732088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.732161:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197282560 00000100:00100000:2.0:1782759497.732170:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197282560 00000100:00100000:2.0:1782759497.732212:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 271 00000100:00100000:2.0:1782759497.732218:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:101755:x1869355197282560:12345-192.168.204.31@tcp:35:rm.0 00000100:00100000:2.0:1782759497.732681:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101755:x1869355197282560:12345-192.168.204.31@tcp:35:rm.0 Request processed in 461us (597us total) trans 4294968088 rc 0/0 00000100:00100000:2.0:1782759497.732689:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 271 00000100:00100000:3.0:1782759497.733750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.733805:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197282816 00000100:00100000:2.0:1782759497.733810:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197282816 00000100:00100000:2.0:1782759497.733896:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2108 00000100:00100000:2.0:1782759497.733905:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101755:x1869355197282816:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759497.733944:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759497.733971:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfb89 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f27 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.733987:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x13:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:2.0:1782759497.733997:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759497.734021:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734032:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734042:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734067:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734076:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734082:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734182:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 3/0,1 mode: --/EX res: [0x200000418:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734191:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734197:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759497.734784:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x13:0x0]: returning size 512 00010000:00010000:2.0:1782759497.734799:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734806:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734813:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734819:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759497.734862:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734880:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734891:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x13:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759497.734894:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759497.734898:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 2/0,0 mode: --/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734904:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfbac lrc: 0/0,0 mode: --/EX res: [0x200000418:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734921:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734927:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734933:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734938:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759497.734941:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734946:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734953:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759497.734955:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759497.734958:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.734972:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777dfb9e lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759497.734983:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000769b48d3 reply state 00000000ee25755d transno 4294968089 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759497.734990:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759497.735052:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101755:x1869355197282816:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1147us (1313us total) trans 4294968089 rc 0/0 00000100:00100000:2.0:1782759497.735059:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2108 00010000:00010000:0.0:1782759497.736118:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.736129:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.736136:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.736142:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759497.736146:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.736153:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.736163:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x8d0dad41 (ffff9171c08f6700) 00010000:00010000:0.0:1782759497.736166:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759497.736170:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.736176:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dfba5 lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759497.736520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.736565:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197282944 00000100:00100000:2.0:1782759497.736573:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197282944 00000100:00100000:2.0:1782759497.736611:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2109 00000100:00100000:2.0:1782759497.736619:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:101755:x1869355197282944:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759497.736637:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759497.736653:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777dfbb3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f35 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736701:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 3/1,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736712:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736721:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736729:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736742:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736746:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736811:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736819:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736849:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759497.736879:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x14:0x0]: returning size 0 00000004:00200000:2.0:1782759497.736884:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759497.736900:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736910:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736918:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 3/1,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736924:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 2/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736930:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736944:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759497.736948:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 3/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736958:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 4/0,0 mode: CR/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736964:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6a00) 00010000:00010000:2.0:1782759497.736966:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759497.736968:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 2/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736971:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfbba lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736978:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736981:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736984:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736987:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759497.736989:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.736992:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.737002:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6200) 00010000:00010000:2.0:1782759497.737004:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759497.737006:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.737009:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dfbc1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.737030:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777dfbb3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f35 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.737044:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f35 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.737050:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171889c5400) 00010000:00010000:2.0:1782759497.737052:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759497.737055:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782759497.737096:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101755:x1869355197282944:12345-192.168.204.31@tcp:101:rm.0 Request processed in 478us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759497.737107:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2109 00000100:00100000:3.0:1782759497.738236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.738280:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283072 00000100:00100000:2.0:1782759497.738284:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283072 00000100:00100000:2.0:1782759497.738311:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1014 00000100:00100000:2.0:1782759497.738316:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197283072:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759497.738325:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759497.738335:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f3c expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759497.738366:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x6a42c048, atime: 0x6a42c048, ctime: 0x6a42c048, blocks: 0x1 00010000:00010000:2.0:1782759497.738381:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=3566s v=(0 0) 00010000:00010000:2.0:1782759497.738385:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759497.738393:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 8 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.738477:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 8 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.738489:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90c00, rc 0) 00000100:00100000:2.0:1782759497.738526:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197283072:12345-192.168.204.31@tcp:101:rm.0 Request processed in 208us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759497.738532:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1014 00000100:00100000:1.0:1782759497.739712:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759497.739747:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283328 00000100:00100000:2.0:1782759497.739751:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283328 00000100:00100000:2.0:1782759497.739783:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2110 00000100:00100000:2.0:1782759497.739788:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101755:x1869355197283328:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759497.739817:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782759497.739852:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777dfbc8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f35 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739867:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfb6d lrc: 0/0,0 mode: --/CR res: [0x200000418:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f20 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739884:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171889c5400) 00010000:00010000:2.0:1782759497.739893:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759497.739907:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 3/0,1 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739915:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739921:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739928:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,1 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739932:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.739936:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740024:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740032:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740038:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759497.740614:0:146757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].48, 64 off11360 00000004:00080000:2.0:1782759497.740625:0:146757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3566143801378ns, next at 3567143799137ns, rc = 0 00010000:00010000:2.0:1782759497.740709:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 3/0,1 mode: --/PW res: [0x200000418:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740718:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740725:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740732:0:146757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740738:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740744:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740763:0:146757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759497.740781:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.740786:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759497.740788:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.740796:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740798:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740815:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759497.740815:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759497.740842:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.740852:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740854:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740873:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.740874:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171c08f6600) 00010000:00010000:0.0:1782759497.740879:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782759497.740884:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 1/0,0 mode: --/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740893:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x14:0x0].0x0 (ffff9171c08f6600) 00010000:00010000:0.0:1782759497.740893:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777dfbeb lrc: 0/0,0 mode: --/PW res: [0x200000418:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740899:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759497.740905:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.740910:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759497.740914:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dfbe4 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.740914:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759497.740918:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759497.740937:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740943:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740949:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740955:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759497.740957:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740964:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740972:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:2.0:1782759497.740974:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759497.740977:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 2/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.740982:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dfbd6 lrc: 0/0,0 mode: --/CW res: [0x200000418:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759497.741005:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004802c3aa reply state 00000000798bff96 transno 4294968090 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759497.741012:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759497.741070:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:101755:x1869355197283328:12345-192.168.204.31@tcp:36:rm.0 Request processed in 1280us (1359us total) trans 4294968090 rc 0/0 00000100:00100000:2.0:1782759497.741077:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2110 00010000:00010000:1.0:1782759497.741853:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,1 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.741863:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 2/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.741871:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.741877:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759497.741880:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 3/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.741897:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 4/0,0 mode: PW/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.741907:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0xc678657f (ffff9171c08f6500) 00010000:00010000:1.0:1782759497.741910:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759497.741913:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 2/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.741919:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfbdd lrc: 0/0,0 mode: --/PW res: [0x200000418:0xc:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759498.083814:0:147414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3a29d9d0 20000000:00000080:2.0:1782759498.083866:0:147414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082d65c00 uarg=0000000000000000 00010000:00010000:2.0:1782759498.084297:0:147414:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759498.084313:0:147414:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759498.084332:0:147414:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759498.084349:0:147414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.084365:0:147414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.084374:0:147414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.084411:0:147414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.084481:0:147414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 18 pid: 5796 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759498.084496:0:147414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147414:1869355211960576:0@lo:104: 00000100:00100000:2.0:1782759498.084558:0:147414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759498.084618:0:147414:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718167d000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759498.084619:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960576 00000100:00100000:3.0:1782759498.084629:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960576 00000100:00100000:3.0:1782759498.084677:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1782759498.084687:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:147414:x1869355211960576:12345-0@lo:104: 00010000:00010000:3.0:1782759498.084700:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759498.084767:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759498.084774:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:147414:x1869355211960576:12345-0@lo:104: Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759498.084780:0:147414:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147414:1869355211960576:0@lo:104: 00000100:00100000:3.0:1782759498.084785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00010000:00010000:2.0:1782759498.084804:0:147414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759498.084882:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759498.084890:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759498.084899:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759498.084903:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759498.084912:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759498.084919:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759498.084925:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759498.084954:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759498.084962:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759498.084998:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759498.085005:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4400/0xdd99f5c4777dfb20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759498.085013:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211960704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759498.085022:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759498.085026:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759498.085028:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759498.085046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759498.085087:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960704 00000100:00100000:0.0:1782759498.085102:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960704 00010000:00010000:0.0:1782759498.085124:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 19 pid: 5796 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759498.085151:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1782759498.085157:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211960704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759498.085165:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759498.085173:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 19 pid: 5796 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085180:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 19 pid: 5796 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085189:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777dfb27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfb20 expref: 19 pid: 5796 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085197:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085202:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085211:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085215:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085220:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085223:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085226:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759498.085229:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085233:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085248:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.085254:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759498.085276:0:147414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.085286:0:147414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.085290:0:147414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfbf2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759498.085297:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211960704:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759498.085307:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1782759498.085331:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211960704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759498.155987:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211960832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759498.156071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759498.156174:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960832 00000100:00100000:2.0:1782759498.156183:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960832 00000100:00100000:2.0:1782759498.156241:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1782759498.156257:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211960832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759498.156296:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759498.156353:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211960832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759498.156363:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1782759498.158491:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211960832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759498.348050:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759499.372194:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759499.446562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759499.446619:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283456 00000100:00100000:1.0:1782759499.446621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759499.446636:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283456 00000100:00100000:1.0:1782759499.446672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759499.446718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759499.446727:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2814 00000100:00100000:2.0:1782759499.446749:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197283456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759499.446769:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283712 00000100:00100000:1.0:1782759499.446780:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283712 00000100:00100000:0.0:1782759499.446794:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283840 00000100:00100000:0.0:1782759499.446802:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283840 00000100:00100000:0.0:1782759499.446883:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2007 00000100:00100000:2.0:1782759499.446889:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197283456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.446898:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197283840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759499.446899:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2814 00000100:00100000:1.0:1782759499.446917:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2008 00000100:00100000:1.0:1782759499.446931:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197283712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759499.446949:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197283840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.446958:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2007 00000100:00080000:2.0:1782759499.446988:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759499.446993:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759499.447000:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197283712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759499.447009:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2008 00000100:00100000:3.0:1782759499.447063:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283584 00000100:00100000:3.0:1782759499.447068:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283584 00000100:00100000:3.0:1782759499.447111:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2559 00000100:00100000:3.0:1782759499.447117:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2364:x1869355197283584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759499.447149:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2364:x1869355197283584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759499.447153:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2559 00000100:00080000:2.0:1782759499.447326:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1782759500.076881:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759500.076890:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759500.076896:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759500.076938:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.076960:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.076971:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759500.076996:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211960960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759500.077063:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759500.077121:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759500.077124:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211960960 00000100:00100000:0.0:1782759500.077132:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211960960 00000100:00100000:0.0:1782759500.077216:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:0.0:1782759500.077227:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211960960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759500.077241:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759500.077254:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfbf9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759500.077278:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759500.077289:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759500.077306:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98800, rc 0) 00000100:00100000:0.0:1782759500.077353:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211960960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759500.077358:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00100000:3.0:1782759500.077461:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211960960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759500.077475:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.077494:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759500.077514:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759500.077519:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.077527:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759500.228279:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967401 is committed 00010000:00010000:1.0:1782759500.397083:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759500.717019:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759500.717044:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211961088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759500.717113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759500.717156:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961088 00000100:00100000:0.0:1782759500.717165:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961088 00000100:00080000:2.0:1782759500.717212:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759500.717231:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1782759500.717243:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211961088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759500.717278:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759500.717347:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211961088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759500.717356:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1782759500.717384:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967412 gen 2 00000004:00080000:2.0:1782759500.717391:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917190267480, transno 4294967412 00000100:00100000:2.0:1782759500.717411:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211961088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759501.420957:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759501.842117:0:147757:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc29c3b410 20000000:00000080:0.0:1782759501.842134:0:147757:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b0c00 uarg=0000000000000000 10000000:01000000:0.0:1782759501.842174:0:147757:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759501.842189:0:147757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.842203:0:147757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.842208:0:147757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.842239:0:147757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.842256:0:147757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 18 pid: 5794 timeout: 3670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759501.842267:0:147757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147757:1869355211961216:0@lo:104: 00000100:00100000:0.0:1782759501.842323:0:147757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759501.842384:0:147757:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759501.842408:0:139369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759501.842420:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961216 00000100:00100000:1.0:1782759501.842426:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961216 00000100:00100000:1.0:1782759501.842466:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1782759501.842475:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:147757:x1869355211961216:12345-0@lo:104: 00010000:00010000:1.0:1782759501.842488:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842580:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759501.842588:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:147757:x1869355211961216:12345-0@lo:104: Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759501.842596:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00010000:00010000:3.0:1782759501.842602:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782759501.842605:0:147757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147757:1869355211961216:0@lo:104: 00010000:00010000:3.0:1782759501.842610:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.842620:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759501.842624:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.842629:0:147757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.842633:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759501.842656:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759501.842663:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759501.842699:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.842717:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759501.842746:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.842758:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777dfbf9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc00 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759501.842761:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211961344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759501.842781:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759501.842785:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759501.842788:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759501.842798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759501.842855:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961344 00000100:00100000:1.0:1782759501.842859:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961344 00010000:00010000:1.0:1782759501.842878:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 19 pid: 5794 timeout: 3670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759501.842902:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1782759501.842909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211961344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759501.842918:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759501.842922:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 19 pid: 5794 timeout: 3670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842932:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 19 pid: 5794 timeout: 3670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842944:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98800/0xdd99f5c4777dfc00 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfbf9 expref: 19 pid: 5794 timeout: 3670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842957:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842965:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842976:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842992:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.842999:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.843006:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.843012:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759501.843016:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.843023:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.843037:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.843047:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759501.843049:0:147757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.843059:0:147757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.843067:0:147757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfc07 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759501.843090:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211961344:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759501.843099:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1782759501.843113:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211961344:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1782759502.264657:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968087 is committed 00000001:00080000:2.0:1782759502.264686:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968090 is committed 00000004:00080000:2.0:1782759502.264691:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 121 committed 00000100:00100000:0.0:1782759502.264969:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211961472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782759502.265041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.265180:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961472 00000100:00100000:2.0:1782759502.265190:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961472 00000100:00080000:1.0:1782759502.265234:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759502.265270:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1782759502.265282:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211961472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782759502.265312:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:51 count 1 00010000:00010000:2.0:1782759502.265348:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.265370:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.265395:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1782759502.265400:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759502.265404:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.265431:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.265445:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 6 pid: 6597 timeout: 3670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759502.265459:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211961600:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759502.265526:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759502.267555:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1869355211961600:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759502.267582:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759502.267889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759502.267935:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197283968 00000100:00100000:0.0:1782759502.267943:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197283968 00000100:00080000:1.0:1782759502.267981:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759502.267988:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 7 pid: 6597 timeout: 3670 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759502.268053:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 649 00000100:00100000:0.0:1782759502.268062:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197283968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759502.268075:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759502.268081:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 7 pid: 6597 timeout: 3670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.268093:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 7 pid: 6597 timeout: 3670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.268117:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053de33a1/0xdd99f5c4777dfbcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f3c expref: 7 pid: 6597 timeout: 3670 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.268130:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759502.268134:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759502.268139:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.268147:0:134476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.268171:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759502.268190:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.268203:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.268215:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759502.268218:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197283968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 156us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.268233:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 649 00010000:00010000:2.0:1782759502.268236:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.268267:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759502.268303:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759502.268311:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.268403:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759502.268408:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.268418:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.268432:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.268439:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ffc9f3b/0xdd99f5c4777dfc0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.268458:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759502.268461:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759502.268464:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759502.268802:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211961472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3522us (3760us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1782759502.268819:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000004:00080000:0.0:1782759502.268955:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b7766300/2, rc 0, transno 4294967402 00000100:00100000:0.0:1782759502.268963:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211961472:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782759502.443984:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759502.764121:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211961728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.764193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759502.764242:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211961856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.764250:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211962240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759502.764262:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211962112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759502.764290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.764295:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211961984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759502.764307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759502.764741:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211962368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.764749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759502.764774:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962112 00000100:00100000:3.0:1782759502.764781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759502.764785:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962112 00000100:00100000:2.0:1782759502.764813:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961728 00000100:00100000:2.0:1782759502.764818:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961728 00000100:00100000:0.0:1782759502.764868:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1782759502.764882:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:0.0:1782759502.764883:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211962112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.764895:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211961728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759502.764953:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211962112:12345-0@lo:400:kworker.0 Request processed in 76us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.764958:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961856 00000100:00100000:2.0:1782759502.764958:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211961728:12345-0@lo:400:kworker.0 Request processed in 63us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.764965:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961856 00000100:00100000:0.0:1782759502.764965:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1782759502.764972:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:0.0:1782759502.764989:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962368 00000100:00100000:0.0:1782759502.764993:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962368 00000100:00100000:2.0:1782759502.765020:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211961984 00000100:00100000:3.0:1782759502.765024:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1782759502.765026:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211961984 00000100:00100000:0.0:1782759502.765028:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:0.0:1782759502.765038:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211962368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759502.765047:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211961856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.765062:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1782759502.765072:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211961984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759502.765083:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211962368:12345-0@lo:400:kworker.0 Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.765091:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1782759502.765094:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211961856:12345-0@lo:400:kworker.0 Request processed in 59us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.765100:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1782759502.765120:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211961984:12345-0@lo:400:kworker.0 Request processed in 50us (372us total) trans 0 rc 0/0 00000100:00080000:0.0:1782759502.765125:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759502.765132:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759502.765138:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1782759502.765143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.765160:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962240 00000100:00100000:2.0:1782759502.765165:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962240 00000100:00100000:3.0:1782759502.765182:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211961728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759502.765182:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211962112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.765201:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1782759502.765210:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211962240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759502.765234:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211961856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759502.765254:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211962368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.765259:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211962240:12345-0@lo:400:kworker.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.765268:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00080000:2.0:1782759502.765294:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759502.765306:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211961984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759502.765323:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211962240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759503.276342:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759503.276372:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211962496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759503.276461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759503.276507:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962496 00000100:00100000:1.0:1782759503.276517:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962496 00000100:00100000:1.0:1782759503.276581:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1782759503.276595:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211962496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759503.276641:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759503.276723:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211962496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759503.276733:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1782759503.276779:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211962496:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1782759503.322974:0:147955:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782759503.322982:0:147955:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1782759503.323103:0:147955:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:0.0:1782759503.323108:0:147955:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1782759503.343954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759503.344039:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284096 00000100:00100000:3.0:1782759503.344050:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284096 00000100:00080000:2.0:1782759503.344102:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759503.344129:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2111 00000100:00100000:3.0:1782759503.344142:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:102333:x1869355197284096:12345-192.168.204.31@tcp:46:lfs.0 00000004:00000080:3.0:1782759503.344182:0:5803:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff917198081160 uarg=0000000000000000 00000004:00000080:3.0:1782759503.344225:0:5803:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff917198081160 00000004:00000080:3.0:1782759503.344232:0:5803:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1782759503.344333:0:5803:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.344338:0:5803:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1782759503.344378:0:5803:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 36 00000040:00080000:3.0:1782759503.344496:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:3.0:1782759503.344503:0:5803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759503.344507:0:5803:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1782759503.344630:0:5803:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.344633:0:5803:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759503.345769:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 36 count 1 00000040:00080000:3.0:1782759503.345776:0:5803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1782759503.345918:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:102333:x1869355197284096:12345-192.168.204.31@tcp:46:lfs.0 Request processed in 1776us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.345929:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2111 00010000:00010000:3.0:1782759503.468117:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759503.704425:0:148003:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffdb65ebf90 00000004:00000080:3.0:1782759503.704441:0:148003:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9171b317d800 uarg=0000000000000000 00000004:00000080:3.0:1782759503.704479:0:148003:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9171b317d800 00000004:00000080:3.0:1782759503.704490:0:148003:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1782759503.704584:0:148003:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.704588:0:148003:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1782759503.704615:0:148003:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 36 00000040:00080000:3.0:1782759503.704675:0:148003:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:3.0:1782759503.704681:0:148003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759503.704719:0:148003:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1782759503.704760:0:148003:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.704763:0:148003:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759503.705303:0:148003:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759503.705367:0:148003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1782759503.705389:0:148003:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=2 00000040:00080000:3.0:1782759503.705428:0:148003:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.705431:0:148003:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759503.705656:0:148003:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 1 00000040:00080000:3.0:1782759503.705661:0:148003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759503.705678:0:148003:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1782759503.705680:0:148003:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1782759503.707789:0:148003:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl2 record=18446744073709551615 00000040:00080000:3.0:1782759503.707907:0:148003:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.707911:0:148003:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759503.708442:0:148003:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759503.708449:0:148003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:3.0:1782759503.708513:0:148003:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.708516:0:148003:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759503.709041:0:148003:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1782759503.709047:0:148003:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 10000000:01000000:0.0:1782759503.789903:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759503.789909:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759503.789919:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759503.789963:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.789974:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.789986:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759503.790011:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211962624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759503.790079:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759503.790113:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962624 00000100:00100000:2.0:1782759503.790122:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962624 00000100:00100000:0.0:1782759503.790125:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198273e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759503.790172:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:2.0:1782759503.790183:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211962624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759503.790196:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759503.790211:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfc15 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.790234:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.790258:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.790269:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759503.790326:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211962624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759503.790333:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1782759503.790431:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211962624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759503.790446:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.790456:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759503.790475:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759503.790480:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.790488:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759504.076111:0:148051:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782759504.076120:0:148051:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1782759504.076599:0:148051:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1782759504.076607:0:148051:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:0.0:1782759504.492991:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759504.566019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759504.566086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759504.566229:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284480 00000100:00100000:2.0:1782759504.566244:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284480 00000100:00100000:2.0:1782759504.566345:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2011 00000100:00100000:2.0:1782759504.566356:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:0.0:1782759504.566389:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759504.566445:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284224 00000100:00100000:2.0:1782759504.566452:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.566457:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284224 00000100:00100000:2.0:1782759504.566472:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2011 00000100:00100000:1.0:1782759504.566526:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2818 00000100:00100000:1.0:1782759504.566535:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197284224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759504.566588:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197284224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 55us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.566594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2818 00000100:00100000:0.0:1782759504.567396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759504.567439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759504.567457:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284352 00000100:00100000:3.0:1782759504.567481:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284352 00000100:00100000:3.0:1782759504.567540:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2563 00000100:00100000:3.0:1782759504.567548:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284352:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759504.567588:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284352:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759504.567593:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2563 00000100:00100000:1.0:1782759504.568141:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284608 00000100:00100000:1.0:1782759504.568148:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284608 00000100:00100000:1.0:1782759504.568197:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2012 00000100:00100000:1.0:1782759504.568205:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197284608:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759504.568247:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197284608:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.568254:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2012 00000100:00080000:0.0:1782759504.568321:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1782759504.791913:0:148147:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd8103330 20000000:00000080:3.0:1782759504.791927:0:148147:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cd8000 uarg=0000000000000000 00010000:00010000:3.0:1782759504.792573:0:148147:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759504.792588:0:148147:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759504.792605:0:148147:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759504.792622:0:148147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.792637:0:148147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.792645:0:148147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.792680:0:148147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.792694:0:148147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 18 pid: 5794 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759504.792708:0:148147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148147:1869355211962752:0@lo:104: 00000100:00100000:3.0:1782759504.792765:0:148147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759504.792820:0:148147:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191f51d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759504.793079:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962752 00000100:00100000:0.0:1782759504.793087:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962752 00000100:00100000:0.0:1782759504.793165:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1782759504.793176:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:148147:x1869355211962752:12345-0@lo:104: 00010000:00010000:0.0:1782759504.793188:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.793263:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759504.793270:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:148147:x1869355211962752:12345-0@lo:104: Request processed in 96us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.793278:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:2.0:1782759504.793338:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759504.793345:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793353:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759504.793357:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793366:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759504.793373:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759504.793388:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759504.793417:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793424:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759504.793442:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793450:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777dfc15 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc1c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793465:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759504.793467:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759504.793469:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759504.793480:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211962880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759504.793511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759504.793576:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211962880 00000100:00100000:2.0:1782759504.793579:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211962880 00010000:00010000:2.0:1782759504.793598:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 19 pid: 5794 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759504.793619:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1782759504.793626:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211962880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759504.793635:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759504.793640:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 19 pid: 5794 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793649:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 19 pid: 5794 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793668:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dfc1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfc15 expref: 19 pid: 5794 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793679:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793687:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793700:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793707:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793715:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793721:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793727:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759504.793731:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793737:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793745:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.793764:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759504.793791:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211962880:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.793797:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1782759504.793871:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211962880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759504.793995:0:148147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148147:1869355211962752:0@lo:104: 00010000:00010000:1.0:1782759504.794038:0:148147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.794054:0:148147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.794063:0:148147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.794070:0:148147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777dfc23 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759505.154804:0:148196:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedda329a0 20000000:00000080:3.0:1782759505.154916:0:148196:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cd9c00 uarg=0000000000000000 00010000:00010000:3.0:1782759505.155157:0:148196:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759505.155172:0:148196:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759505.155188:0:148196:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759505.155208:0:148196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155224:0:148196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155234:0:148196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155241:0:148196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155248:0:148196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155254:0:148196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155260:0:148196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759505.155265:0:148196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155273:0:148196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155298:0:148196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155317:0:148196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.155323:0:148196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc2a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759505.339673:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967402 is committed 00000020:00000080:3.0:1782759505.490240:0:148247:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8886c0f0 20000000:00000080:3.0:1782759505.490257:0:148247:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082cd9c00 uarg=0000000000000000 00010000:00010000:3.0:1782759505.490495:0:148247:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759505.490511:0:148247:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759505.490528:0:148247:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759505.490551:0:148247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490568:0:148247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490577:0:148247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490582:0:148247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490587:0:148247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490592:0:148247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490603:0:148247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759505.490607:0:148247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490616:0:148247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490630:0:148247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490639:0:148247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.490646:0:148247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777dfc31 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759505.516481:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759505.837521:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211963008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759505.837588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759505.837657:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963008 00000100:00100000:0.0:1782759505.837669:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963008 00000100:00080000:2.0:1782759505.837719:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759505.837751:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1782759505.837761:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211963008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759505.837805:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759505.837882:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211963008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759505.837890:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1782759505.837949:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211963008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759506.540193:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759506.796544:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759506.796551:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759506.796556:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759506.796734:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759506.796747:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759506.796757:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759506.796781:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211963136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759506.797103:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759506.797186:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171919cb000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759506.797540:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963136 00000100:00100000:2.0:1782759506.797549:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963136 00000100:00100000:2.0:1782759506.797606:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:2.0:1782759506.797616:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211963136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759506.797629:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759506.797642:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfc38 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759506.797665:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759506.797677:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759506.797685:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90600, rc 0) 00000100:00100000:2.0:1782759506.797728:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211963136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759506.797735:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:2.0:1782759506.797810:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082715f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211963136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759506.797851:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759506.797860:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759506.797881:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759506.797887:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759506.797894:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759507.563958:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782759507.671713:0:148445:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64f: Nodemap enforces fscrypt_admin RBAC roles ========================================================== 14:58:26 (1782759506) 00000100:00100000:3.0:1782759507.884087:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211963264:0@lo:400:kworker.0 00000100:00100000:0.0:1782759507.884120:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211963392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759507.884177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759507.884177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759507.884182:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211963648:0@lo:400:kworker.0 00000100:00100000:2.0:1782759507.884218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759507.884252:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211963904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759507.884262:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211963776:0@lo:400:kworker.0 00000100:00100000:0.0:1782759507.884289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759507.884310:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963392 00000100:00100000:2.0:1782759507.884317:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963392 00000100:00100000:3.0:1782759507.884318:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211963520:0@lo:400:kworker.0 00000100:00100000:0.0:1782759507.884335:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963648 00000100:00100000:0.0:1782759507.884340:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963648 00000100:00100000:3.0:1782759507.884362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759507.884374:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963520 00000100:00100000:2.0:1782759507.884380:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963520 00000100:00100000:0.0:1782759507.884389:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963904 00000100:00100000:0.0:1782759507.884394:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963904 00000100:00100000:1.0:1782759507.884413:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963264 00000100:00100000:3.0:1782759507.884414:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1782759507.884422:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1782759507.884429:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211963392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759507.884429:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1782759507.884430:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963264 00000100:00100000:2.0:1782759507.884433:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211963520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759507.884443:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211963648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759507.884464:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:1.0:1782759507.884474:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211963264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759507.884499:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211963392:12345-0@lo:400:kworker.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759507.884506:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211963648:12345-0@lo:400:kworker.0 Request processed in 64us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759507.884512:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1782759507.884512:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211963520:12345-0@lo:400:kworker.0 Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759507.884522:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1782759507.884526:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:1.0:1782759507.884554:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211963264:12345-0@lo:400:kworker.0 Request processed in 82us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759507.884562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759507.884563:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1782759507.884578:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:3.0:1782759507.884580:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211963520:0@lo:400:kworker.0 00000100:00100000:0.0:1782759507.884590:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211963904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759507.884594:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211963264:0@lo:400:kworker.0 00000100:00100000:3.0:1782759507.884614:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211963776 00000100:00100000:3.0:1782759507.884619:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211963776 00000100:00100000:0.0:1782759507.884635:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211963904:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759507.884642:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:2.0:1782759507.884655:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211963392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759507.884663:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1782759507.884668:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967402 gen 2 00000100:00100000:3.0:1782759507.884675:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211963776:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1782759507.884675:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b7766300, transno 4294967402 00000100:00100000:2.0:1782759507.884688:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211963904:0@lo:400:kworker.0 00000100:00080000:2.0:1782759507.884731:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759507.884736:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759507.884737:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211963776:12345-0@lo:400:kworker.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00080000:2.0:1782759507.884739:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759507.884746:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1782759507.884786:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211963776:0@lo:400:kworker.0 00000100:00100000:3.0:1782759507.884787:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211963648:0@lo:400:kworker.0 00000001:02000400:2.0:1782759508.364896:0:148493:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_64f Need fscrypt, skip fscrypt_admin role 00000100:00100000:1.0:1782759508.397527:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759508.398289:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211964032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759508.398350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759508.398408:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211964032 00000100:00100000:1.0:1782759508.398415:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211964032 00000100:00100000:1.0:1782759508.398453:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1782759508.398461:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211964032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759508.398493:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759508.398531:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211964032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759508.398538:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1782759508.398586:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211964032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759508.588322:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759509.417798:0:148541:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64g: Nodemap enforces server_upcall RBAC role ========================================================== 14:58:27 (1782759507) 00010000:00010000:0.0:1782759509.619252:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759509.691084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759509.691152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759509.691285:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284736 00000100:00100000:2.0:1782759509.691295:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284736 00000100:00100000:2.0:1782759509.691355:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2821 00000100:00100000:2.0:1782759509.691366:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197284736:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759509.691440:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197284736:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759509.691448:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2821 00000100:00100000:2.0:1782759509.693106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759509.693148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759509.694492:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284864 00000100:00100000:3.0:1782759509.694520:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284864 00000100:00100000:3.0:1782759509.694598:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2567 00000100:00100000:3.0:1782759509.694609:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759509.694688:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759509.694697:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2567 00000100:00080000:1.0:1782759509.695163:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759509.699323:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197284992 00000100:00100000:0.0:1782759509.699337:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197284992 00000100:00100000:3.0:1782759509.705472:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197285120 00000100:00100000:3.0:1782759509.705487:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197285120 00000100:00100000:3.0:1782759509.705814:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2015 00000100:00100000:3.0:1782759509.705849:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197285120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759509.705932:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197285120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 110us (12784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759509.705940:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2015 00000100:00080000:2.0:1782759509.711368:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759509.711379:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759509.712098:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2016 00000100:00100000:1.0:1782759509.712116:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759509.712211:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197284992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (21059us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.712219:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2016 00000100:00100000:2.0:1782759509.863212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759509.863308:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197285248 00000100:00100000:0.0:1782759509.863317:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197285248 00000100:00100000:0.0:1782759509.863373:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2112 00000100:00100000:0.0:1782759509.863383:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197285248:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:0.0:1782759509.863424:0:19544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:0.0:1782759509.863506:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197285248:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759509.863525:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2112 00000100:00100000:3.0:1782759509.864683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759509.864798:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197285504 00000100:00100000:2.0:1782759509.864805:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197285504 00000100:00100000:2.0:1782759509.864882:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2113 00000100:00100000:2.0:1782759509.864891:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:102936:x1869355197285504:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759509.864940:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759509.864945:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777df82c) 00010000:00010000:2.0:1782759509.864946:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759509.865314:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.865330:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.865342:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.865389:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.865398:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.865405:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759509.867457:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 512 00010000:00010000:2.0:1782759509.867470:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.867480:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.867487:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.867494:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759509.867504:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.867528:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.867542:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759509.867545:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759509.867549:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.867557:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfc46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759509.867573:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4bb628a reply state 00000000c170dba8 transno 4294968091 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759509.867582:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759509.867673:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102936:x1869355197285504:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 2780us (2990us total) trans 4294968091 rc 0/0 00000100:00100000:2.0:1782759509.867681:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2113 00010000:00010000:0.0:1782759509.870399:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.870415:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.870422:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.870428:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759509.870432:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.870440:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.870455:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff9171c08f6800) 00010000:00010000:0.0:1782759509.870458:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759509.870462:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.870468:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfc4d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759509.883277:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759509.883374:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197285632 00000100:00100000:0.0:1782759509.883384:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197285632 00000100:00100000:0.0:1782759509.883456:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2114 00000100:00100000:0.0:1782759509.883466:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:102937:x1869355197285632:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759509.883511:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759509.883534:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f43 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.883595:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfc5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.883608:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfc5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.883618:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfc5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759509.883675:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1782759509.883679:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759509.883704:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfc5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.883738:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f43 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.883757:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfc5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f43 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.883766:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759509.883769:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759509.883772:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98e00, rc 0) 00000100:00100000:0.0:1782759509.883874:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102937:x1869355197285632:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 409us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759509.883883:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2114 00000100:00100000:1.0:1782759509.886519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759509.886593:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197285760 00000100:00100000:0.0:1782759509.886602:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197285760 00000100:00100000:0.0:1782759509.886657:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2115 00000100:00100000:0.0:1782759509.886667:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102937:x1869355197285760:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759509.886686:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759509.886704:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777dfc62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f4a expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886810:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886844:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886856:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886870:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886878:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886885:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886978:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfc77 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.886987:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfc77 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887012:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfc77 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759509.887050:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 512 00000004:00200000:0.0:1782759509.887054:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759509.887076:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfc77 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887087:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887094:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887101:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887106:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759509.887110:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887118:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887129:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759509.887132:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759509.887136:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887143:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887168:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887174:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887181:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887198:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759509.887201:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887208:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887216:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff917183a70500) 00010000:00010000:0.0:1782759509.887218:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759509.887221:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887227:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887258:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777dfc62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f4a expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887271:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfc77 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f4a expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.887289:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759509.887292:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759509.887294:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99a00, rc 0) 00000100:00100000:0.0:1782759509.887362:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:102937:x1869355197285760:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 696us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759509.887369:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2115 00000100:00100000:2.0:1782759509.890584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759509.890708:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197286016 00000100:00100000:3.0:1782759509.890733:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197286016 00000100:00100000:3.0:1782759509.890791:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2116 00000100:00100000:3.0:1782759509.890801:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:102937:x1869355197286016:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782759509.890879:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759509.890907:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfc77 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f4a expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.890927:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70100) 00010000:00010000:3.0:1782759509.890952:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759509.890976:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.890989:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.890999:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759509.924413:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968091 is committed 00000001:00080000:1.0:1782759509.924446:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968092 is committed 00000004:00010000:0.0:1782759509.924640:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019c0e25d reply state 00000000d99235bb transno 4294968092 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.924655:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759509.925159:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00010000:00080000:0.0:1782759509.925321:0:7487:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782759509.925346:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102937:x1869355197286016:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 34543us (34765us total) trans 4294968092 rc 0/0 00000100:00100000:0.0:1782759509.925355:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2116 00010000:00010000:2.0:1782759509.925440:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.925449:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.925456:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.925462:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759509.925474:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.925482:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.925497:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171908a1b00) 00010000:00010000:2.0:1782759509.925625:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759509.925630:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.925637:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777dfc7e lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759509.936089:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759509.936334:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197286144 00000100:00100000:0.0:1782759509.936343:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197286144 00000100:00100000:0.0:1782759509.936433:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2117 00000100:00100000:0.0:1782759509.936444:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:102938:x1869355197286144:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:0.0:1782759509.936468:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759509.936487:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777dfc85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f51 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.936656:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.936671:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.936696:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.936711:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.936736:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.936743:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937099:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc9a lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937291:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc9a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937301:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc9a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759509.937393:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00000004:00200000:0.0:1782759509.937397:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759509.937472:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc9a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937485:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937492:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937622:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937628:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759509.937633:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937640:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937652:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759509.937655:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759509.937660:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937666:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfc8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937679:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937686:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937692:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937697:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759509.937699:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937715:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937771:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff917183a70500) 00010000:00010000:0.0:1782759509.937774:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759509.937777:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937784:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfc93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937814:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99400/0xdd99f5c4777dfc85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f51 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937915:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc9a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f51 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.937923:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759509.937926:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759509.937928:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99e00, rc 0) 00000100:00100000:0.0:1782759509.937989:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102938:x1869355197286144:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 1546us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759509.937996:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2117 00000100:00100000:1.0:1782759509.940686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759509.940849:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197286400 00000100:00100000:3.0:1782759509.940858:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197286400 00000100:00100000:3.0:1782759509.940907:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2118 00000100:00100000:3.0:1782759509.940916:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102938:x1869355197286400:12345-192.168.204.31@tcp:36:chgrp.0 00010000:00010000:3.0:1782759509.940960:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759509.940983:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777dfc9a lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f51 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.941002:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70d00) 00010000:00010000:3.0:1782759509.941014:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759509.941037:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.941048:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.941058:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759509.976249:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968093 is committed 00000004:00010000:3.0:1782759509.976341:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014982187 reply state 000000005d93ef5b transno 4294968093 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759509.976373:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759509.976639:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00010000:00080000:3.0:1782759509.976772:0:19544:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782759509.976795:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102938:x1869355197286400:12345-192.168.204.31@tcp:36:chgrp.0 Request processed in 35875us (36111us total) trans 4294968093 rc 0/0 00000100:00100000:3.0:1782759509.976804:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2118 00010000:00010000:2.0:1782759509.976896:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.976905:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.976912:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.976918:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759509.976922:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.976930:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.976946:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171908a1100) 00010000:00010000:2.0:1782759509.976950:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759509.976962:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.976969:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfca1 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759509.980952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759509.981036:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197286528 00000100:00100000:2.0:1782759509.981046:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197286528 00000100:00100000:2.0:1782759509.981105:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2119 00000100:00100000:2.0:1782759509.981116:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102758:x1869355197286528:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1782759509.981140:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759509.981157:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f58 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981226:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981239:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981248:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981262:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981269:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981276:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981672:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981681:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981688:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759509.981788:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00000004:00200000:2.0:1782759509.981792:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759509.981892:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981904:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981910:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981917:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981922:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759509.981926:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981934:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981946:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:2.0:1782759509.981955:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759509.981960:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981968:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777dfcaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981980:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981986:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981992:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.981997:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759509.982000:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.982005:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.982012:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759509.982015:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759509.982017:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.982023:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777dfcb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.982048:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.982072:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.982080:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:2.0:1782759509.982082:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759509.982085:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759509.982145:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:102758:x1869355197286528:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1030us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759509.982153:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2119 00000100:00100000:1.0:1782759509.985502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759509.985583:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197286784 00000100:00100000:3.0:1782759509.985594:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197286784 00000100:00100000:3.0:1782759509.985651:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2120 00000100:00100000:3.0:1782759509.985661:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102758:x1869355197286784:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1782759509.985680:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759509.985698:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfcc4 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f5f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.988201:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 3/0,1 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.988222:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.988233:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.988246:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.988253:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.988272:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759509.989867:0:5801:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34:0x0], index 0: 0 00010000:00010000:3.0:1782759509.990109:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfcd9 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990122:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfcd9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990132:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfcd9 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990167:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990175:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990181:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990198:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759509.990203:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990210:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990222:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:3.0:1782759509.990225:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759509.990237:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990243:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfccb lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759509.990258:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0b34fbd reply state 000000008a8615e2 transno 4294968094 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759509.990268:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759509.990302:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfcc4 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f5f expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990316:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfcd9 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f5f expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.990324:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759509.990326:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759509.990329:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759509.990457:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:102758:x1869355197286784:12345-192.168.204.31@tcp:101:bash.0 Request processed in 4797us (4963us total) trans 4294968094 rc 0/0 00000100:00100000:3.0:1782759509.990467:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2120 00000100:00100000:1.0:1782759509.994698:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759509.994862:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197286912 00000100:00100000:0.0:1782759509.994871:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197286912 00000100:00100000:0.0:1782759509.994921:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1016 00000100:00100000:0.0:1782759509.994932:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:102758:x1869355197286912:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1782759509.994962:0:126932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759509.994983:0:126932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55ab351/0xdd99f5c4777dfce7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f66 expref: -99 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759509.995006:0:126932:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782759509.995027:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=3578s v=(0 0) 00010000:00010000:0.0:1782759509.995031:0:126932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759509.995039:0:126932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55ab351/0xdd99f5c4777dfce7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f66 expref: 6 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.995057:0:126932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b55ab351/0xdd99f5c4777dfce7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f66 expref: 6 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.995068:0:126932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99400, rc 0) 00000100:00100000:0.0:1782759509.995127:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:102758:x1869355197286912:12345-192.168.204.31@tcp:101:bash.0 Request processed in 197us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759509.995134:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1016 00010000:00010000:2.0:1782759509.995436:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.995447:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.995453:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.995458:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759509.995463:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.995470:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.995482:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x121d9c5e (ffff9171908a1e00) 00010000:00010000:2.0:1782759509.995485:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759509.995488:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759509.995516:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfcd2 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759509.998319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759509.998421:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197287168 00000100:00100000:2.0:1782759509.998430:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197287168 00000100:00100000:2.0:1782759509.998613:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 272 00000100:00100000:2.0:1782759509.998624:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:102758:x1869355197287168:12345-192.168.204.31@tcp:35:bash.0 00000100:00100000:2.0:1782759509.999112:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:102758:x1869355197287168:12345-192.168.204.31@tcp:35:bash.0 Request processed in 489us (800us total) trans 4294968095 rc 0/0 00000100:00100000:2.0:1782759509.999120:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 272 00000100:00100000:1.0:1782759510.007963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.008062:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197287424 00000100:00100000:0.0:1782759510.008073:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197287424 00000100:00100000:0.0:1782759510.008129:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2121 00000100:00100000:0.0:1782759510.008139:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:102939:x1869355197287424:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:0.0:1782759510.008202:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759510.008229:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfcd9 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f5f expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.008247:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171908a1600) 00010000:00010000:0.0:1782759510.008271:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759510.008302:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,1 mode: --/PW res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.008315:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.008325:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759510.008810:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033906c4a reply state 00000000562a3d4f transno 4294968096 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.008962:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759510.009053:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:102939:x1869355197287424:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 914us (1099us total) trans 4294968096 rc 0/0 00000100:00100000:0.0:1782759510.009061:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2121 00010000:00010000:0.0:1782759510.010473:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.010486:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.010494:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.010515:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759510.010520:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.010528:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.010556:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759510.010560:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759510.010564:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 2/0,0 mode: --/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.010571:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfcee lrc: 0/0,0 mode: --/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759510.011796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759510.011934:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197287552 00000100:00100000:2.0:1782759510.011943:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197287552 00000100:00100000:2.0:1782759510.011995:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2122 00000100:00100000:2.0:1782759510.012005:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:102939:x1869355197287552:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759510.012025:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759510.012044:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfcf5 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f6d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.012100:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfcf5 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f6d expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.012115:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfcf5 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f6d expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.012132:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759510.012136:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759510.012149:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91600, rc 0) 00000100:00100000:2.0:1782759510.012216:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:102939:x1869355197287552:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 211us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759510.012223:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2122 00000100:00100000:1.0:1782759510.014961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.015062:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197287680 00000100:00100000:0.0:1782759510.015071:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197287680 00000100:00100000:0.0:1782759510.015119:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1017 00000100:00100000:0.0:1782759510.015129:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197287680:12345-192.168.204.31@tcp:2:chmod.0 00002000:00010000:0.0:1782759510.015413:0:9120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759510.015416:0:9120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1782759510.015419:0:9120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782759510.015421:0:9120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb ctime from disk: 0 -> 1782759509 00002000:00010000:0.0:1782759510.015423:0:9120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759510.015472:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197287680:12345-192.168.204.31@tcp:2:chmod.0 Request processed in 344us (519us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1782759510.015480:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1017 00000100:00100000:3.0:1782759510.028934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759510.029043:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197287808 00000100:00100000:1.0:1782759510.029052:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197287808 00000100:00100000:1.0:1782759510.029110:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2123 00000100:00100000:1.0:1782759510.029120:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:102940:x1869355197287808:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:1.0:1782759510.029140:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759510.029159:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfcfc lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f74 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029226:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029241:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029252:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029265:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029287:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029294:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029390:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029399:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029406:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759510.029438:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00000004:00200000:1.0:1782759510.029442:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759510.029461:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029472:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029481:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029487:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029494:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029525:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759510.029530:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029538:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029550:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:1.0:1782759510.029553:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759510.029557:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029564:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfd03 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029577:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029583:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029589:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029594:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759510.029597:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029603:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029619:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x121d9c5e (ffff9171889c5d00) 00010000:00010000:1.0:1782759510.029622:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759510.029625:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 2/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029631:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777dfd0a lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029659:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfcfc lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f74 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029671:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f74 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.029679:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:1.0:1782759510.029681:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759510.029683:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4c00, rc 0) 00000100:00100000:1.0:1782759510.029803:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:102940:x1869355197287808:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 684us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759510.029811:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2123 00000100:00100000:1.0:1782759510.033905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759510.034014:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197287936 00000100:00100000:3.0:1782759510.034023:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197287936 00000100:00100000:3.0:1782759510.034080:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2124 00000100:00100000:3.0:1782759510.034090:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:102940:x1869355197287936:12345-192.168.204.31@tcp:101:chgrp.0 00010000:00010000:3.0:1782759510.034108:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759510.034128:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfd18 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f7b expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.034174:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfd1f lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.034199:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfd1f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.034210:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfd1f lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.034293:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfd18 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f7b expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.034311:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfd1f lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f7b expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.034319:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:3.0:1782759510.034321:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759510.034324:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759510.034383:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:102940:x1869355197287936:12345-192.168.204.31@tcp:101:chgrp.0 Request processed in 294us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759510.034390:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2124 00000100:00100000:2.0:1782759510.037201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.037289:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197288192 00000100:00100000:0.0:1782759510.037298:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197288192 00000100:00100000:0.0:1782759510.037349:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2125 00000100:00100000:0.0:1782759510.037359:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:102940:x1869355197288192:12345-192.168.204.31@tcp:36:chgrp.0 00010000:00010000:0.0:1782759510.037400:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759510.037422:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777dfd11 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f74 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.037452:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:0.0:1782759510.037457:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759510.037481:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.037492:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.037515:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759510.037948:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].55, 88 off11856 00000004:00080000:0.0:1782759510.037958:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3578441135156ns, next at 3579441132941ns, rc = 0 00000004:00010000:0.0:1782759510.038028:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4de7fc3 reply state 000000008185fa7e transno 4294968097 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.038038:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759510.038121:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102940:x1869355197288192:12345-192.168.204.31@tcp:36:chgrp.0 Request processed in 763us (935us total) trans 4294968097 rc 0/0 00000100:00100000:0.0:1782759510.038128:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2125 00010000:00010000:2.0:1782759510.039683:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.039696:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.039705:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.039711:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759510.039726:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.039735:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.039750:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759510.039753:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759510.039758:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.039765:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfd26 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759510.040982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759510.041049:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197288320 00000100:00100000:1.0:1782759510.041058:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197288320 00000100:00100000:1.0:1782759510.041103:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1018 00000100:00100000:1.0:1782759510.041113:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197288320:12345-192.168.204.31@tcp:2:chgrp.0 00002000:00010000:1.0:1782759510.041298:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782759510.041302:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1782759510.041316:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782759510.041318:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb ctime from disk: 1782759509 -> 1782759509 00002000:00010000:1.0:1782759510.041320:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782759510.041375:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197288320:12345-192.168.204.31@tcp:2:chgrp.0 Request processed in 262us (396us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1782759510.041382:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1018 00000100:00100000:1.0:1782759510.066863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759510.067027:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197288448 00000100:00100000:3.0:1782759510.067037:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197288448 00000100:00100000:3.0:1782759510.067095:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2126 00000100:00100000:3.0:1782759510.067105:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:102941:x1869355197288448:12345-192.168.204.31@tcp:101:setfacl.0 00010000:00010000:3.0:1782759510.067130:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759510.067149:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfd2d lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f82 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067232:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067246:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067256:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067271:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067278:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067285:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067374:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067383:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067390:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759510.067422:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00000004:00200000:3.0:1782759510.067427:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759510.067461:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067483:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067491:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067498:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067518:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067525:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759510.067529:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067536:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067549:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:3.0:1782759510.067552:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759510.067557:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067564:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd34 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067578:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067585:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067597:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067603:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759510.067606:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067612:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067620:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x121d9c5e (ffff9171908a1800) 00010000:00010000:3.0:1782759510.067623:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759510.067626:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 2/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067632:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd3b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067662:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfd2d lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067675:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.067682:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:3.0:1782759510.067684:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759510.067686:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759510.067981:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102941:x1869355197288448:12345-192.168.204.31@tcp:101:setfacl.0 Request processed in 875us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759510.067998:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2126 00000100:00100000:3.0:1782759510.072536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.072621:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197288704 00000100:00100000:0.0:1782759510.072631:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197288704 00000100:00100000:0.0:1782759510.072686:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2127 00000100:00100000:0.0:1782759510.072695:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102941:x1869355197288704:12345-192.168.204.31@tcp:36:setfacl.0 00010000:00010000:0.0:1782759510.072752:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759510.072779:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dfd1f lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f7b expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.072814:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:0.0:1782759510.072819:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759510.072887:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.072900:0:19544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.072908:0:19544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 4/0,1 mode: --/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.072940:0:19544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.072953:0:19544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 13 pid: 5803 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.072967:0:19544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19544:1869355211964160:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759510.073053:0:19544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759510.075780:0:19544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19544:1869355211964160:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759510.075807:0:19544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759510.077373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759510.077993:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197288832 00000100:00100000:1.0:1782759510.078002:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197288832 00010000:00010000:1.0:1782759510.078040:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 14 pid: 5803 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759510.078127:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 651 00000100:00100000:1.0:1782759510.078138:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:2362:x1869355197288832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759510.078152:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759510.078160:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 14 pid: 5803 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.078173:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 14 pid: 5803 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.078204:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfd42 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f82 expref: 14 pid: 5803 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.078220:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:1.0:1782759510.078224:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.078249:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.078256:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 4/0,1 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.078287:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759510.078343:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2362:x1869355197288832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 207us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759510.078351:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 651 00010000:00010000:0.0:1782759510.078402:0:19544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.078410:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759510.078663:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080a80e7e reply state 00000000efee9c0a transno 4294968098 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.078673:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759510.078713:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102941:x1869355197288704:12345-192.168.204.31@tcp:36:setfacl.0 Request processed in 6019us (6185us total) trans 4294968098 rc 0/0 00000100:00100000:0.0:1782759510.078736:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2127 00010000:00010000:0.0:1782759510.081602:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.081617:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.081624:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.081631:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759510.081636:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.081644:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.081659:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:0.0:1782759510.081663:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759510.081667:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.081673:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd49 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759510.090386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.090466:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197288960 00000100:00100000:0.0:1782759510.090473:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197288960 00000100:00100000:0.0:1782759510.090525:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2128 00000100:00100000:0.0:1782759510.090532:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:102942:x1869355197288960:12345-192.168.204.31@tcp:101:setfacl.0 00010000:00010000:0.0:1782759510.090552:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759510.090567:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f89 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.090614:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.090624:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.090631:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759510.090680:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00000004:00200000:0.0:1782759510.090683:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759510.090706:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.090747:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.090766:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.090775:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:0.0:1782759510.090790:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759510.090794:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98400, rc 0) 00000100:00100000:0.0:1782759510.091145:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102942:x1869355197288960:12345-192.168.204.31@tcp:101:setfacl.0 Request processed in 610us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759510.091152:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2128 00000100:00100000:1.0:1782759510.094004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.094093:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197289216 00000100:00100000:0.0:1782759510.094102:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197289216 00000100:00100000:0.0:1782759510.094154:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2129 00000100:00100000:0.0:1782759510.094163:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102942:x1869355197289216:12345-192.168.204.31@tcp:36:setfacl.0 00010000:00010000:0.0:1782759510.094240:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.094256:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.094265:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.094273:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 5/0,1 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.094306:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.094317:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 14 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.094333:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211964288:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759510.094426:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.094436:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 14 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.094445:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211964416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759510.094465:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759510.096612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759510.096706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.096925:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211964288:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759510.096937:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355211964416:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759510.096963:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759510.097675:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197289344 00000100:00100000:1.0:1782759510.097682:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197289344 00010000:00010000:1.0:1782759510.097761:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 15 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759510.097767:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197289472 00000100:00100000:2.0:1782759510.097770:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197289472 00010000:00010000:2.0:1782759510.097800:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 16 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759510.097855:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 652 00000100:00100000:1.0:1782759510.097865:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:2361:x1869355197289344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759510.097879:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759510.097886:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 16 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.097898:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 16 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.097919:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfd57 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f89 expref: 16 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759510.097923:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 653 00000100:00100000:2.0:1782759510.097931:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:2361:x1869355197289472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759510.097939:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759510.097944:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 15 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.097946:0:134476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:1.0:1782759510.097950:0:134476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.097959:0:134476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.097965:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759510.098009:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2361:x1869355197289344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 145us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759510.098016:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 652 00010000:00010000:2.0:1782759510.098133:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 14 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.098146:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777dfcbd lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f58 expref: 14 pid: 5802 timeout: 3678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.098157:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:2.0:1782759510.098161:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.098168:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.098175:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 4/0,1 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.098215:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759510.098240:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2361:x1869355197289472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 310us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759510.098247:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 653 00010000:00010000:1.0:1782759510.098528:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.098537:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759510.136035:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5b921af reply state 000000008a88411d transno 4294968099 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.136054:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759510.136155:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:102942:x1869355197289216:12345-192.168.204.31@tcp:36:setfacl.0 Request processed in 41988us (42154us total) trans 4294968099 rc 0/0 00000100:00100000:0.0:1782759510.136165:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2129 00000001:00080000:3.0:1782759510.136250:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968098 is committed 00000004:00080000:3.0:1782759510.136261:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 125 committed 00000001:00080000:3.0:1782759510.136293:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968099 is committed 00010000:00010000:1.0:1782759510.136352:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.136362:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.136370:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.136377:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759510.136382:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.136402:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.136418:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6c00) 00010000:00010000:1.0:1782759510.136421:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759510.136426:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 2/0,0 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.136433:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfd5e lrc: 0/0,0 mode: --/EX res: [0x200000418:0x15:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759510.136780:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759510.136797:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211964544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782759510.136902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759510.137071:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211964544 00000100:00100000:3.0:1782759510.137081:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211964544 00000100:00100000:3.0:1782759510.137145:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1782759510.137160:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211964544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782759510.137327:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759510.137331:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1782759510.137336:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782759510.137341:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb ctime from disk: 1782759509 -> 1782759509 00002000:00010000:3.0:1782759510.137344:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782759510.137387:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211964544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (488us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1782759510.137395:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000004:00080000:0.0:1782759510.137431:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170835fb800/2, rc 0, transno 4294967415 00000100:00080000:1.0:1782759510.137437:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759510.137439:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211964544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782759510.157319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759510.157630:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197289600 00000100:00100000:3.0:1782759510.157640:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197289600 00000100:00100000:3.0:1782759510.157694:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2130 00000100:00100000:3.0:1782759510.157704:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:102943:x1869355197289600:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759510.157726:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759510.157759:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfd65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f90 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.157814:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.157867:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.157879:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.157894:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.157902:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.157908:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.158352:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfd7a lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.158362:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfd7a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.158370:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfd7a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759510.158461:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00000004:00200000:3.0:1782759510.158466:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759510.159388:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfd7a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159410:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159417:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159424:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159430:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759510.159434:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159441:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159454:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:3.0:1782759510.159457:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759510.159461:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159467:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777dfd6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159477:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159484:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159489:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159862:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759510.159866:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159873:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159882:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff9171908a1400) 00010000:00010000:3.0:1782759510.159885:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759510.159888:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159894:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfd73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159931:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfd65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f90 expref: 9 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159945:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfd7a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f90 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.159952:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759510.159954:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759510.159957:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759510.160026:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:102943:x1869355197289600:12345-192.168.204.31@tcp:101:ls.0 Request processed in 2323us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759510.160034:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2130 00000100:00100000:1.0:1782759510.166352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.170025:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197289856 00000100:00100000:0.0:1782759510.170040:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197289856 00000100:00100000:0.0:1782759510.170107:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2131 00000100:00100000:0.0:1782759510.170118:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:102943:x1869355197289856:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759510.170154:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759510.170174:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f97 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759510.170416:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00010000:00010000:0.0:1782759510.170617:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f97 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.170630:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759510.170633:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759510.170638:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777dfd81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f97 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.170652:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98800, rc 0) 00000100:00100000:0.0:1782759510.170724:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:102943:x1869355197289856:12345-192.168.204.31@tcp:101:ls.0 Request processed in 607us (4378us total) trans 4294968100 rc 301/301 00000100:00100000:0.0:1782759510.170732:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2131 00000100:00100000:3.0:1782759510.178929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759510.179057:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197289984 00000100:00100000:0.0:1782759510.179066:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197289984 00000100:00100000:0.0:1782759510.179126:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 273 00000100:00100000:0.0:1782759510.179136:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:102943:x1869355197289984:12345-192.168.204.31@tcp:37:ls.0 00000100:00100000:0.0:1782759510.189604:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:102943:x1869355197289984:12345-192.168.204.31@tcp:37:ls.0 Request processed in 10459us (10673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759510.189618:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 273 00000100:00100000:3.0:1782759510.199169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759510.199261:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197290112 00000100:00100000:1.0:1782759510.199271:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197290112 00000100:00100000:1.0:1782759510.199333:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2132 00000100:00100000:1.0:1782759510.199344:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:102943:x1869355197290112:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759510.199365:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759510.199385:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfd8f lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66f9e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.199437:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.199452:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.199475:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.199490:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.199511:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.199518:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200076:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200085:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200092:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759510.200125:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00000004:00200000:1.0:1782759510.200130:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759510.200149:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200159:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200168:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200196:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200203:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200209:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759510.200213:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200220:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200233:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171908a1800) 00010000:00010000:1.0:1782759510.200237:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759510.200242:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200247:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777dfd96 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200260:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200265:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200270:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200275:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759510.200284:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200290:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200297:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x121d9c5e (ffff9171889c5d00) 00010000:00010000:1.0:1782759510.200299:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759510.200302:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 2/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200306:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4400/0xdd99f5c4777dfd9d lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200334:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dfd8f lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f9e expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200347:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f9e expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759510.200354:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:1.0:1782759510.200356:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759510.200358:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782759510.200424:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:102943:x1869355197290112:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1081us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759510.200432:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2132 00000100:00100000:0.0:1782759510.217637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759510.217952:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197290368 00000100:00100000:2.0:1782759510.217962:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197290368 00000100:00100000:2.0:1782759510.218019:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 274 00000100:00100000:2.0:1782759510.218028:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:102943:x1869355197290368:12345-192.168.204.31@tcp:35:ls.0 00000100:00100000:2.0:1782759510.218416:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:102943:x1869355197290368:12345-192.168.204.31@tcp:35:ls.0 Request processed in 389us (787us total) trans 4294968101 rc 0/0 00000100:00100000:2.0:1782759510.218424:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 274 00010000:00010000:2.0:1782759510.636625:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759510.964731:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759510.964752:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211964672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759510.964817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759510.964895:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211964672 00000100:00100000:2.0:1782759510.964902:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211964672 00000100:00100000:2.0:1782759510.964941:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1782759510.964949:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211964672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759510.964983:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759510.965025:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211964672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759510.965033:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1782759510.965079:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211964672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759511.662344:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759512.685179:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759513.012687:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211964928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.012751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759513.012794:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211965440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.012817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759513.012868:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782759513.012874:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211964800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.012899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759513.012919:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211965312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.012936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759513.012972:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211964928 00000100:00100000:3.0:1782759513.012979:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211964928 00000100:00100000:3.0:1782759513.013014:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965312 00000100:00100000:3.0:1782759513.013017:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965312 00000100:00100000:3.0:1782759513.013042:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1782759513.013050:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211964928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.013097:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211964928:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759513.013103:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1782759513.013117:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1782759513.013122:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211965312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.013160:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211965312:12345-0@lo:400:kworker.0 Request processed in 38us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759513.013165:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00080000:0.0:1782759513.013697:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759513.013710:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211964800 00000100:00100000:0.0:1782759513.013714:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211964800 00000100:00100000:0.0:1782759513.013747:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1782759513.013754:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211964800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759513.013792:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211964800:12345-0@lo:400:kworker.0 Request processed in 38us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759513.013798:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1782759513.013877:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965440 00000100:00100000:0.0:1782759513.013881:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965440 00000100:00100000:0.0:1782759513.013911:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1782759513.013917:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211965440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759513.013953:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211965440:12345-0@lo:400:kworker.0 Request processed in 30us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759513.013959:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1782759513.013977:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211965056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759513.014003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759513.014027:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759513.014038:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965056 00000100:00100000:0.0:1782759513.014040:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965056 00000100:00100000:0.0:1782759513.014067:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1782759513.014073:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211965056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759513.014104:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211965056:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759513.014110:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00080000:0.0:1782759513.014123:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759513.014159:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211965056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.014389:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211965312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.014412:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211964928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759513.014422:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211965440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759513.014932:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211965184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759513.014969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759513.015225:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211964800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759513.015314:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965184 00000100:00100000:0.0:1782759513.015319:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965184 00000100:00100000:0.0:1782759513.015361:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:0.0:1782759513.015368:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211965184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759513.015409:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211965184:12345-0@lo:400:kworker.0 Request processed in 42us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759513.015416:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00080000:1.0:1782759513.016121:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759513.016542:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211965184:0@lo:400:kworker.0 00000001:00080000:3.0:1782759513.052393:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967413 is committed 00000001:00080000:3.0:1782759513.052408:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967414 is committed 00000001:00080000:3.0:1782759513.052413:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967415 is committed 00000020:00000080:1.0:1782759513.373306:0:148739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff144af7d0 20000000:00000080:1.0:1782759513.373322:0:148739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb937000 uarg=0000000000000000 10000000:01000000:1.0:1782759513.373819:0:148739:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759513.373993:0:148739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759513.374025:0:148739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759513.374035:0:148739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759513.374074:0:148739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759513.374088:0:148739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 18 pid: 5794 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759513.374101:0:148739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148739:1869355211965568:0@lo:104: 00000100:00100000:1.0:1782759513.374176:0:148739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759513.374334:0:148739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b32370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759513.387008:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965568 00000100:00100000:2.0:1782759513.387036:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965568 00000100:00100000:2.0:1782759513.387243:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1782759513.387254:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:148739:x1869355211965568:12345-0@lo:104: 00010000:00010000:2.0:1782759513.387272:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.387389:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759513.387396:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:148739:x1869355211965568:12345-0@lo:104: Request processed in 144us (13220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759513.387403:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:1.0:1782759513.387745:0:148739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148739:1869355211965568:0@lo:104: 00010000:00010000:1.0:1782759513.387776:0:148739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.393569:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759513.393583:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.393596:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759513.393600:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.393611:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759513.393619:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759513.393625:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759513.393669:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.393675:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759513.393706:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.393714:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777dfc38 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfc3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.393748:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759513.393749:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759513.393751:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759513.393920:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759513.393940:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211965696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759513.394000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759513.394197:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965696 00000100:00100000:2.0:1782759513.394204:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965696 00010000:00010000:2.0:1782759513.394231:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 19 pid: 5794 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759513.394293:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1782759513.394302:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211965696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759513.394315:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759513.394320:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 19 pid: 5794 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394331:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 19 pid: 5794 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394345:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfc3f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfc38 expref: 19 pid: 5794 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394358:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394367:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394381:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394398:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394405:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394412:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394417:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759513.394421:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394428:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394450:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759513.394473:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759513.394515:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211965696:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759513.394522:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00010000:00010000:3.0:1782759513.394584:0:148739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759513.394595:0:148739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759513.394603:0:148739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777dfdab lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759513.394699:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211965696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759513.520156:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211965824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759513.520225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759513.520295:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965824 00000100:00100000:0.0:1782759513.520302:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965824 00000100:00100000:0.0:1782759513.520346:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1782759513.520355:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211965824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759513.520387:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759513.520432:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211965824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759513.520439:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1782759513.521086:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211965824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759513.708054:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759514.139191:0:148787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff08122e70 20000000:00000080:2.0:1782759514.139209:0:148787:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc1400 uarg=0000000000000000 10000000:01000000:2.0:1782759514.139417:0:148787:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759514.139515:0:148787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139532:0:148787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139550:0:148787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139557:0:148787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139564:0:148787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139571:0:148787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139577:0:148787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759514.139581:0:148787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139589:0:148787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139601:0:148787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139609:0:148787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.139615:0:148787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfdb2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.743174:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759514.808158:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759514.808202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759514.808231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759514.808250:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197290752 00000100:00100000:2.0:1782759514.808267:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197290752 00000100:00100000:3.0:1782759514.808268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759514.808294:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197290624 00000100:00100000:3.0:1782759514.808299:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197290624 00000100:00100000:2.0:1782759514.808327:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197290880 00000100:00100000:2.0:1782759514.808332:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197290880 00000100:00100000:3.0:1782759514.808340:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2571 00000100:00100000:3.0:1782759514.808352:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:2364:x1869355197290624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759514.808363:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2019 00000100:00100000:2.0:1782759514.808374:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197290752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759514.808453:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197290496 00000100:00100000:0.0:1782759514.808462:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197290496 00000100:00100000:0.0:1782759514.808488:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2823 00000100:00100000:0.0:1782759514.808495:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197290496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759514.808550:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:2364:x1869355197290624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 201us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759514.808557:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2571 00000100:00100000:2.0:1782759514.808588:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197290752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 217us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759514.808593:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2019 00000100:00100000:2.0:1782759514.808604:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2020 00000100:00100000:2.0:1782759514.808609:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b47c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197290880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759514.808636:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b47c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197290880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759514.808640:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2020 00000100:00080000:2.0:1782759514.808794:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759514.808799:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759514.808802:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759514.809630:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197290496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1130us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759514.809640:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2823 10000000:01000000:2.0:1782759515.118198:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759515.118207:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759515.118213:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759515.118263:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.118277:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.118288:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759515.118315:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211965952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759515.120130:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759515.120193:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759515.120221:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211965952 00000100:00100000:2.0:1782759515.120229:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211965952 00000100:00100000:2.0:1782759515.120275:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:2.0:1782759515.120283:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211965952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759515.120300:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759515.120318:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfdb9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.120347:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.120359:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.120369:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782759515.121530:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211965952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1241us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759515.121540:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:2.0:1782759515.121607:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211965952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759515.121626:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.121637:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759515.121656:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759515.121672:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.121679:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759515.322947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759515.322989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759515.323045:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291136 00000100:00100000:0.0:1782759515.323055:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291136 00000100:00100000:0.0:1782759515.323116:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:0.0:1782759515.323125:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291136:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:0.0:1782759515.323224:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291136:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759515.323231:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1020 00000100:00100000:3.0:1782759515.324251:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291008 00000100:00100000:3.0:1782759515.324256:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291008 00002000:00100000:3.0:1782759515.324288:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34:0x0] (0->2) req@ffff917082b4ca80 x1869355197291008/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:676/0 lens 496/0 e 0 to 0 dl 1782759526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759515.324298:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917082b4ca80 with x1869355197291008 ext(0->2) 00002000:00010000:3.0:1782759515.324303:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917082b4ca80 00000100:00100000:3.0:1782759515.324324:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:3.0:1782759515.324330:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291008:12345-192.168.204.31@tcp:4:bash.0 00000100:00100000:3.0:1782759515.325131:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197291008:12345-192.168.204.31@tcp:4:bash.0 Request processed in 388us (1779us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1782759515.325139:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00002000:00100000:3.0:1782759515.325147:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34:0x0] (0->2) req@ffff917082b4ca80 x1869355197291008/t4294967416(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:676/0 lens 496/448 e 0 to 0 dl 1782759526 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759515.325155:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff917082b4ca80 with x1869355197291008 ext(0->2) 00002000:00010000:3.0:1782759515.325159:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff917082b4ca80 00000001:00080000:2.0:1782759515.724913:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968100 is committed 00000001:00080000:2.0:1782759515.724933:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968101 is committed 00010000:00010000:2.0:1782759515.755938:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759516.076800:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759516.076856:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211966080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759516.076925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759516.077156:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966080 00000100:00100000:2.0:1782759516.077164:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966080 00000100:00100000:2.0:1782759516.077268:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1782759516.077278:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211966080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759516.077301:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759516.077353:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211966080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759516.077360:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1782759516.077480:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967415 gen 2 00000004:00080000:3.0:1782759516.077485:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170835fb800, transno 4294967415 00000100:00100000:3.0:1782759516.077502:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211966080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759516.089684:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759516.780151:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759517.809079:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759517.973549:0:148937:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd087dd60 20000000:00000080:3.0:1782759517.973564:0:148937:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7831000 uarg=0000000000000000 10000000:01000000:3.0:1782759517.974290:0:148937:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759517.974313:0:148937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759517.974330:0:148937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759517.974338:0:148937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759517.974375:0:148937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759517.974389:0:148937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 18 pid: 5793 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759517.974404:0:148937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148937:1869355211966208:0@lo:104: 00000100:00100000:3.0:1782759517.974462:0:148937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759517.974555:0:148937:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dae40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759517.976265:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966208 00000100:00100000:0.0:1782759517.976277:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966208 00000100:00100000:0.0:1782759517.976345:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1782759517.976355:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:148937:x1869355211966208:12345-0@lo:104: 00010000:00010000:0.0:1782759517.976371:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759517.976496:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759517.976502:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:148937:x1869355211966208:12345-0@lo:104: Request processed in 149us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759517.976510:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00010000:00010000:2.0:1782759517.976511:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759517.976518:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976525:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759517.976529:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976538:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759517.976558:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759517.976563:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782759517.976577:0:148937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148937:1869355211966208:0@lo:104: 00010000:00010000:3.0:1782759517.976600:0:148937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976602:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976608:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759517.976633:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976641:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777dfdb9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfdc0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976655:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759517.976657:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759517.976658:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759517.976686:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759517.976700:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211966336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759517.976740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759517.976868:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966336 00000100:00100000:2.0:1782759517.976872:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966336 00010000:00010000:2.0:1782759517.976891:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 19 pid: 5793 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759517.976917:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1782759517.976924:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211966336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759517.976934:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759517.976939:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 19 pid: 5793 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976949:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 19 pid: 5793 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976969:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdc0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfdb9 expref: 19 pid: 5793 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976981:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.976989:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977002:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977009:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977016:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977021:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977026:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759517.977040:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977048:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977065:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759517.977083:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759517.977095:0:148937:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759517.977102:0:148937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759517.977108:0:148937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dfdc7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759517.977119:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211966336:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759517.977125:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1782759517.977962:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211966336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759518.130235:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211966592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759518.130383:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782759518.130389:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211966464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759518.130429:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211966976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759518.130474:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211966720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759518.130511:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759518.130516:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211966848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759518.130564:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966592 00000100:00100000:1.0:1782759518.130571:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966592 00000100:00100000:1.0:1782759518.130614:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966464 00000100:00100000:1.0:1782759518.130616:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966464 00000100:00100000:1.0:1782759518.130630:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966848 00000100:00100000:1.0:1782759518.130632:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966848 00000100:00100000:1.0:1782759518.130654:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1782759518.130661:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211966592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130707:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211966592:12345-0@lo:400:kworker.0 Request processed in 46us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759518.130713:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1782759518.130730:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1782759518.130746:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211966464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130770:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211966464:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759518.130775:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1782759518.130786:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1782759518.130791:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211966848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130813:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211966848:12345-0@lo:400:kworker.0 Request processed in 22us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759518.130818:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1782759518.130853:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966976 00000100:00100000:1.0:1782759518.130856:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966976 00000100:00100000:1.0:1782759518.130878:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211966720 00000100:00100000:1.0:1782759518.130880:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211966720 00000100:00100000:1.0:1782759518.130896:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1782759518.130901:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211966976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130926:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211966976:12345-0@lo:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759518.130931:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1782759518.130942:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1782759518.130947:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.130971:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211966720:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759518.130977:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00080000:1.0:1782759518.130997:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759518.131000:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759518.131003:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759518.131057:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211966848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.131075:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211966720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.131102:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211966464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.131110:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211966976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759518.131118:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211966592:0@lo:400:kworker.0 00000001:00080000:1.0:1782759518.228518:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967416 is committed 00000100:00100000:0.0:1782759518.644462:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759518.644485:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211967104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759518.644553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759518.644674:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967104 00000100:00100000:3.0:1782759518.644681:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967104 00000100:00100000:3.0:1782759518.644739:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1782759518.644748:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211967104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759518.644782:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759518.644846:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211967104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759518.644853:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1782759518.645306:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211967104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759518.828282:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759519.170885:0:148987:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd43589530 20000000:00000080:3.0:1782759519.170902:0:148987:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b347c000 uarg=0000000000000000 10000000:01000000:3.0:1782759519.171202:0:148987:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759519.171222:0:148987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171238:0:148987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171248:0:148987:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171256:0:148987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171263:0:148987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171270:0:148987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171286:0:148987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759519.171290:0:148987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171299:0:148987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171311:0:148987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171318:0:148987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.171324:0:148987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777dfdce lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759519.406410:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759519.406419:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759519.406424:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759519.406471:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.406485:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.406496:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759519.406521:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211967232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759519.406584:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759519.406652:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759519.406992:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967232 00000100:00100000:0.0:1782759519.407012:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967232 00000100:00100000:0.0:1782759519.407071:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:0.0:1782759519.407082:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211967232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759519.407096:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759519.407111:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfdd5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759519.407134:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759519.407145:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759519.407154:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99a00, rc 0) 00000100:00100000:0.0:1782759519.407235:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211967232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759519.407242:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:3.0:1782759519.410668:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211967232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759519.410698:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.410712:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759519.411254:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759519.411260:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.411269:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.854164:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759519.898496:0:149035:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe30301c30 20000000:00000080:2.0:1782759519.898512:0:149035:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc2000 uarg=0000000000000000 10000000:01000000:2.0:1782759519.898749:0:149035:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759519.898767:0:149035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.898785:0:149035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.898804:0:149035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.898982:0:149035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759519.899008:0:149035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 18 pid: 5794 timeout: 3688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759519.899022:0:149035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149035:1869355211967360:0@lo:104: 00000100:00100000:2.0:1782759519.899085:0:149035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759519.899185:0:149035:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171811caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759519.899227:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967360 00000100:00100000:0.0:1782759519.899234:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967360 00000100:00100000:0.0:1782759519.899425:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1782759519.899435:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149035:x1869355211967360:12345-0@lo:104: 00010000:00010000:0.0:1782759519.899447:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759519.899521:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759519.899527:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149035:x1869355211967360:12345-0@lo:104: Request processed in 95us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759519.899541:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00010000:00010000:3.0:1782759519.899585:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759519.899592:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.899599:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759519.899603:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.899612:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759519.899619:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759519.899625:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759519.899651:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.899658:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759519.899675:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.899682:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777dfdd5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfddc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759519.899696:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759519.899698:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759519.899699:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759519.899715:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211967488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759519.899746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759519.899873:0:149035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149035:1869355211967360:0@lo:104: 00010000:00010000:1.0:1782759519.899893:0:149035:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759519.899927:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967488 00000100:00100000:1.0:1782759519.899932:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967488 00010000:00010000:1.0:1782759519.899950:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 19 pid: 5794 timeout: 3688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759519.899973:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1782759519.899978:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211967488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759519.899987:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759519.900004:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 19 pid: 5794 timeout: 3688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900014:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 19 pid: 5794 timeout: 3688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900026:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777dfddc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfdd5 expref: 19 pid: 5794 timeout: 3688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900038:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900052:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900065:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900073:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900079:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900086:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900091:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759519.900095:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900101:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900113:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900121:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759519.900149:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211967488:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759519.900155:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00010000:00010000:1.0:1782759519.900184:0:149035:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900196:0:149035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759519.900203:0:149035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91800/0xdd99f5c4777dfde3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759519.901194:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211967488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759519.925549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759519.925582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759519.925605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759519.925627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759519.925652:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291520 00000100:00100000:3.0:1782759519.925660:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291520 00000100:00100000:3.0:1782759519.925708:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291648 00000100:00100000:3.0:1782759519.925711:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291648 00000100:00100000:2.0:1782759519.925813:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291264 00000100:00100000:2.0:1782759519.925816:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291264 00000100:00100000:2.0:1782759519.925860:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2826 00000100:00100000:2.0:1782759519.925869:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197291264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759519.925932:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197291264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 65us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759519.925940:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2826 00000100:00100000:3.0:1782759519.927128:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2023 00000100:00100000:3.0:1782759519.927137:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759519.927175:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759519.927181:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2023 00000100:00100000:3.0:1782759519.927192:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2024 00000100:00100000:3.0:1782759519.927197:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759519.927217:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197291648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 19us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759519.927222:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2024 00000100:00100000:3.0:1782759519.927237:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291392 00000100:00100000:3.0:1782759519.927241:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291392 00000100:00100000:3.0:1782759519.927266:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2575 00000100:00100000:3.0:1782759519.927272:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197291392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759519.927295:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197291392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759519.927893:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2575 00000100:00080000:3.0:1782759519.927914:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759519.927918:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759519.927920:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782759520.527578:0:149083:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdaabe26d0 20000000:00000080:2.0:1782759520.527596:0:149083:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc2c00 uarg=0000000000000000 10000000:01000000:2.0:1782759520.527784:0:149083:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759520.527805:0:149083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527887:0:149083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527910:0:149083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527916:0:149083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527922:0:149083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527929:0:149083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527936:0:149083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759520.527940:0:149083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527948:0:149083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527961:0:149083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527969:0:149083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759520.527975:0:149083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777dfdea lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759520.882359:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759521.197621:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211967616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759521.197685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759521.198016:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967616 00000100:00100000:0.0:1782759521.198024:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967616 00000100:00100000:0.0:1782759521.198095:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1782759521.198103:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211967616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759521.198137:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782759521.198233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759521.205137:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211967616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7024us (7440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759521.205152:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1782759521.213020:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211967616:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759521.643931:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759521.643938:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759521.643944:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759521.644004:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759521.644017:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759521.644028:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759521.644055:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211967744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759521.644131:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759521.644261:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759521.646089:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967744 00000100:00100000:2.0:1782759521.646101:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967744 00000100:00100000:2.0:1782759521.646184:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:2.0:1782759521.646194:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211967744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759521.646209:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759521.646227:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfdf1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759521.646255:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759521.646267:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759521.646276:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782759521.646446:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211967744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759521.646455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:3.0:1782759521.648951:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211967744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759521.648988:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759521.649001:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759521.649024:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759521.649040:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759521.649048:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759521.904976:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759522.158959:0:149132:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe63a598f0 20000000:00000080:3.0:1782759522.158976:0:149132:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b30db800 uarg=0000000000000000 00010000:00010000:3.0:1782759522.159669:0:149132:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1782759522.159716:0:149132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:3.0:1782759522.159720:0:149132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759522.159729:0:149132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfc5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f43 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.159767:0:149132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:3.0:1782759522.159770:0:149132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759522.159774:0:149132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777dfda4 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f9e expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.159785:0:149132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759522.159787:0:149132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759522.159791:0:149132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfd7a lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f90 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.159803:0:149132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:3.0:1782759522.159805:0:149132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759522.159808:0:149132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777dfcf5 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f6d expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.160009:0:149132:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 4 locks, left on hash table 0. 10000000:01000000:3.0:1782759522.160028:0:149132:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759522.160040:0:149132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.160052:0:149132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.160059:0:149132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.160091:0:149132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.160103:0:149132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 18 pid: 5793 timeout: 3690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759522.160117:0:149132:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149132:1869355211967872:0@lo:104: 00000100:00100000:3.0:1782759522.160171:0:149132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.160250:0:149132:0:(client.c:2701:ptlrpc_set_wait()) set ffff917088c3dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759522.160440:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211967872 00000100:00100000:2.0:1782759522.160447:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211967872 00000100:00100000:2.0:1782759522.160497:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1782759522.160504:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149132:x1869355211967872:12345-0@lo:104: 00010000:00010000:2.0:1782759522.160516:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.160661:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759522.160667:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149132:x1869355211967872:12345-0@lo:104: Request processed in 163us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.160674:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00010000:00010000:0.0:1782759522.160718:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759522.160724:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.160731:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759522.160734:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.160741:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759522.160747:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759522.160752:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759522.160781:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.160787:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759522.160816:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.160841:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc000/0xdd99f5c4777dfdf1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfdf8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.160854:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759522.160856:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759522.160858:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759522.160865:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759522.160874:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211968000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759522.160901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759522.160927:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968000 00000100:00100000:0.0:1782759522.160931:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968000 00010000:00010000:0.0:1782759522.160958:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 19 pid: 5793 timeout: 3690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759522.160982:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1782759522.160989:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211968000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759522.160998:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759522.161003:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 19 pid: 5793 timeout: 3690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161011:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 19 pid: 5793 timeout: 3690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161022:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161029:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161047:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161053:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161058:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161063:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161068:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759522.161071:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161076:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161082:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.161089:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759522.161113:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211968000:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.161118:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1782759522.161167:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211968000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759522.161409:0:149132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfdf8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfdf1 expref: 18 pid: 5793 timeout: 3690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759522.161418:0:149132:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149132:1869355211967872:0@lo:104: 00010000:00010000:3.0:1782759522.161428:0:149132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.161436:0:149132:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.161447:0:149132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.161462:0:149132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777dfdff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.924205:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759523.244198:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211968384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759523.244407:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211968128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759523.244518:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211968256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759523.244564:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211968512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759523.246117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759523.246173:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211968640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759523.246202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759523.246268:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968640 00000100:00100000:0.0:1782759523.246276:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968640 00000100:00100000:0.0:1782759523.246332:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1782759523.246342:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211968640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759523.246396:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211968640:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.246403:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1782759523.246449:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211968640:0@lo:400:kworker.0 00000100:00080000:0.0:1782759523.246481:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759523.246937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759523.246976:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968128 00000100:00100000:2.0:1782759523.246980:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968128 00000100:00100000:2.0:1782759523.247006:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:2.0:1782759523.247013:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211968128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.247050:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211968128:12345-0@lo:400:kworker.0 Request processed in 37us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.247056:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:2.0:1782759523.247083:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968384 00000100:00100000:2.0:1782759523.247087:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968384 00000100:00100000:2.0:1782759523.247117:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:2.0:1782759523.247122:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211968384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.247156:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211968384:12345-0@lo:400:kworker.0 Request processed in 34us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.247162:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00080000:2.0:1782759523.247181:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759523.247197:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211968128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.247221:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211968384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.249459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759523.249493:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211968768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.249525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759523.249651:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968256 00000100:00100000:2.0:1782759523.249657:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968256 00000100:00100000:2.0:1782759523.249701:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1782759523.249708:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211968256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.249998:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211968256:12345-0@lo:400:kworker.0 Request processed in 288us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.250012:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1782759523.250032:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968768 00000100:00100000:2.0:1782759523.250035:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968768 00000100:00100000:2.0:1782759523.250063:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1782759523.250069:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211968768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.250097:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211968768:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.250102:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00080000:2.0:1782759523.250120:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759523.250150:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211968256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759523.250160:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211968768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759523.251319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759523.251438:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968512 00000100:00100000:3.0:1782759523.251443:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968512 00000100:00100000:3.0:1782759523.251487:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1782759523.251496:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211968512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759523.251539:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211968512:12345-0@lo:400:kworker.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.251545:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00080000:1.0:1782759523.251945:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759523.251968:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211968512:0@lo:400:kworker.0 10000000:01000000:3.0:1782759523.564007:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759523.564015:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759523.564019:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759523.564063:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.564076:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.564087:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759523.564113:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211968896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759523.564179:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759523.564275:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759523.568367:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211968896 00000100:00100000:2.0:1782759523.568384:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211968896 00000100:00100000:2.0:1782759523.568488:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:2.0:1782759523.568499:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211968896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759523.568518:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759523.568536:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfe06 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.568570:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.568583:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.568594:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759523.569348:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211968896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 849us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.569363:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1782759523.572612:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211968896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759523.572640:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.572653:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759523.572688:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759523.572694:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.572701:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.758366:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211969024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759523.758439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759523.762721:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969024 00000100:00100000:3.0:1782759523.762737:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969024 00000100:00100000:3.0:1782759523.762798:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1782759523.762808:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211969024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759523.762878:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759523.762968:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211969024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (4530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.762977:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1782759523.763157:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211969024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759523.948696:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759524.976509:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759525.051606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759525.051652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759525.051696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759525.051719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759525.051765:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197292160 00000100:00100000:2.0:1782759525.051774:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197292160 00000100:00100000:2.0:1782759525.051862:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197292032 00000100:00100000:2.0:1782759525.051866:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197292032 00000100:00080000:3.0:1782759525.051870:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759525.051904:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2027 00000100:00100000:2.0:1782759525.051917:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197292160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759525.051949:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759525.051998:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197292160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759525.052006:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2027 00000100:00100000:2.0:1782759525.052023:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2028 00000100:00100000:2.0:1782759525.052030:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197292032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759525.052056:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197292032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759525.052062:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2028 00000100:00100000:2.0:1782759525.052080:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291776 00000100:00100000:2.0:1782759525.052084:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291776 00000100:00100000:2.0:1782759525.052108:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2830 00000100:00100000:2.0:1782759525.052115:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197291776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759525.052140:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197291776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759525.052162:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2830 00000100:00100000:1.0:1782759525.052393:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197291904 00000100:00100000:1.0:1782759525.052397:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197291904 00000100:00100000:1.0:1782759525.052445:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2579 00000100:00100000:1.0:1782759525.052453:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197291904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759525.052484:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197291904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.052490:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2579 00000100:00080000:2.0:1782759525.056935:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1782759525.123794:0:149327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa3b1e1f0 20000000:00000080:2.0:1782759525.123813:0:149327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc0400 uarg=0000000000000000 00010000:00010000:2.0:1782759525.125609:0:149327:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759525.125626:0:149327:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759525.125641:0:149327:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759525.125658:0:149327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.125674:0:149327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.125684:0:149327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.125722:0:149327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.125737:0:149327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 18 pid: 5793 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759525.125750:0:149327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149327:1869355211969152:0@lo:104: 00000100:00100000:2.0:1782759525.125810:0:149327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759525.125904:0:149327:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759525.126438:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969152 00000100:00100000:1.0:1782759525.126445:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969152 00000100:00100000:1.0:1782759525.126518:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1782759525.126528:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149327:x1869355211969152:12345-0@lo:104: 00010000:00010000:1.0:1782759525.126542:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126607:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759525.126614:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149327:x1869355211969152:12345-0@lo:104: Request processed in 88us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.126620:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00010000:00010000:1.0:1782759525.126647:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759525.126653:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126660:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759525.126663:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126683:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759525.126691:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759525.126697:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759525.126725:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126732:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759525.126750:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126756:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777dfe06 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfe0d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126767:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759525.126769:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759525.126771:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759525.126786:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211969280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759525.126813:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.126877:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969280 00000100:00100000:1.0:1782759525.126882:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969280 00010000:00010000:1.0:1782759525.126912:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 19 pid: 5793 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759525.126934:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1782759525.126941:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211969280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759525.126959:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759525.126965:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 19 pid: 5793 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126975:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 19 pid: 5793 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126991:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.126999:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.127011:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.127373:0:149327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777dfe0d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfe06 expref: 19 pid: 5793 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759525.127383:0:149327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149327:1869355211969152:0@lo:104: 00010000:00010000:2.0:1782759525.127407:0:149327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.127417:0:149327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.127423:0:149327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128426:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128433:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128439:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128445:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759525.128448:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128456:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128478:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128486:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777dfe14 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759525.128500:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759525.128541:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211969280:12345-0@lo:103:ldlm_bl.0 Request processed in 1600us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.128548:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1782759525.129506:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211969280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759525.998479:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759526.317300:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211969408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759526.317363:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759526.317422:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969408 00000100:00100000:0.0:1782759526.317429:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969408 00000100:00100000:0.0:1782759526.317475:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1782759526.317482:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211969408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759526.317515:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759526.317553:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211969408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759526.317560:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00080000:0.0:1782759526.317594:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759526.317629:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211969408:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759526.920370:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759526.920378:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759526.920383:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759526.920427:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759526.920439:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759526.920450:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759526.920476:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211969536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759526.920541:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759526.922508:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171853d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759526.923700:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969536 00000100:00100000:2.0:1782759526.923784:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969536 00000100:00100000:3.0:1782759526.924075:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1782759526.924085:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211969536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759526.924101:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759526.924120:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dfe1b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759526.924145:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759526.924168:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759526.924291:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc400, rc 0) 00000100:00100000:3.0:1782759526.924404:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211969536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (3861us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759526.924411:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:1.0:1782759526.924502:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211969536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759526.924520:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759526.924529:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759526.924549:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759526.924554:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759526.924684:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759527.021015:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759528.046496:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759528.474889:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211969664:0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.474902:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211969792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759528.475123:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211969920:0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.485487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759528.485487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759528.485569:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969792 00000100:00100000:2.0:1782759528.485580:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969792 00000100:00100000:1.0:1782759528.486242:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211970176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.486292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759528.486458:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970176 00000100:00100000:2.0:1782759528.486463:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970176 00000100:00100000:2.0:1782759528.486506:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:2.0:1782759528.486516:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211969792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.486540:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969664 00000100:00100000:1.0:1782759528.486546:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969664 00000100:00100000:2.0:1782759528.486584:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211969792:12345-0@lo:400:kworker.0 Request processed in 68us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759528.486587:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:2.0:1782759528.486600:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1782759528.486601:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211969664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.486626:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1782759528.486634:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211970176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.486651:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211969664:12345-0@lo:400:kworker.0 Request processed in 53us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759528.486660:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:2.0:1782759528.486671:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211970176:12345-0@lo:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759528.486679:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1782759528.486740:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211969792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.486744:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211969664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.486758:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211970176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.486764:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211970304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.486796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759528.486884:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970304 00000100:00100000:2.0:1782759528.486888:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970304 00000100:00100000:2.0:1782759528.486925:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1782759528.486932:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211970304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.486951:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211970048:0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.486972:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211970304:12345-0@lo:400:kworker.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759528.486981:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1782759528.487007:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211970304:0@lo:400:kworker.0 00000100:00080000:2.0:1782759528.487163:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759528.487168:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759528.490096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759528.490184:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970048 00000100:00100000:2.0:1782759528.490198:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970048 00000100:00100000:2.0:1782759528.490290:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:2.0:1782759528.490462:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211970048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759528.490561:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211970048:12345-0@lo:400:kworker.0 Request processed in 262us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759528.490568:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00080000:1.0:1782759528.492118:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759528.492188:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211970048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.501908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759528.501962:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211969920 00000100:00100000:1.0:1782759528.501972:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211969920 00000100:00100000:1.0:1782759528.502054:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1782759528.502065:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211969920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759528.502138:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211969920:12345-0@lo:400:kworker.0 Request processed in 69us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759528.502146:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00080000:1.0:1782759528.502175:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759528.502221:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211969920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759528.876066:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211970432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759528.876177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759528.876295:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970432 00000100:00100000:3.0:1782759528.876306:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970432 00000100:00100000:3.0:1782759528.876372:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1782759528.876383:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211970432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759528.876428:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759528.876941:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211970432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 558us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759528.876950:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1782759528.877048:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211970432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759529.070902:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759529.908104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759529.908859:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197292416 00000100:00100000:0.0:1782759529.908871:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197292416 00000100:00080000:3.0:1782759529.908938:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759529.908963:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2133 00000100:00100000:0.0:1782759529.908974:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103290:x1869355197292416:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:0.0:1782759529.908998:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759529.909001:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782759529.909006:0:146757:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777dfd7a) 00010000:00010000:0.0:1782759529.909008:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759529.909028:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfe29 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fa5 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909299:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909313:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909560:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909606:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909625:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909633:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759529.909761:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00010000:00010000:0.0:1782759529.909777:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909785:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909791:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.909929:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759529.909934:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910050:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910063:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70700) 00010000:00010000:0.0:1782759529.910066:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759529.910070:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910077:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe30 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910099:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910106:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910113:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910118:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759529.910121:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910127:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910135:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xe065f617 (ffff917183a70400) 00010000:00010000:0.0:1782759529.910137:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759529.910140:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910145:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe37 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910184:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfe29 lrc: 1/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fa5 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910194:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70700) 00010000:00010000:0.0:1782759529.910197:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759529.910206:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfe29 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fa5 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.910219:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99800, rc 0) 00000100:00100000:0.0:1782759529.912875:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103290:x1869355197292416:12345-192.168.204.31@tcp:101:touch.500 Request processed in 3894us (4771us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759529.913288:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2133 00000100:00100000:2.0:1782759529.923835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759529.928050:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197292672 00000100:00100000:0.0:1782759529.928061:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197292672 00000100:00100000:0.0:1782759529.928127:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2134 00000100:00100000:0.0:1782759529.928138:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103290:x1869355197292672:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:0.0:1782759529.928158:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759529.928181:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfe3e lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fac expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.928536:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.928551:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.928564:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.928578:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.928585:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.928592:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759529.931511:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34:0x0], index 1: 0 00010000:00010000:0.0:1782759529.934014:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfe53 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.934037:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfe53 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.934049:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfe53 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.934094:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.934910:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.934918:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.934924:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759529.934929:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.935395:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.935413:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70700) 00010000:00010000:0.0:1782759529.935416:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759529.935421:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.935445:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99a00/0xdd99f5c4777dfe45 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759529.935463:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9991904 reply state 00000000f98386a1 transno 4294968102 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759529.935472:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759529.935521:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777dfe3e lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fac expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.935545:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfe53 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fac expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.935553:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759529.935556:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759529.935559:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99c00, rc 0) 00000100:00100000:0.0:1782759529.935697:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103290:x1869355197292672:12345-192.168.204.31@tcp:101:touch.500 Request processed in 7560us (11882us total) trans 4294968102 rc 0/0 00000100:00100000:0.0:1782759529.935706:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2134 00010000:00010000:1.0:1782759529.958752:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.958773:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.958781:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.958786:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759529.958792:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.958816:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.958965:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xe065f617 (ffff917183a70400) 00010000:00010000:1.0:1782759529.958969:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759529.958974:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.958980:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777dfe4c lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759529.960018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759529.960864:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197292928 00000100:00100000:3.0:1782759529.960876:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197292928 00000100:00100000:3.0:1782759529.960926:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2135 00000100:00100000:3.0:1782759529.960935:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103290:x1869355197292928:12345-192.168.204.31@tcp:36:touch.500 00010000:00010000:3.0:1782759529.960999:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759529.961023:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777dfe53 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fac expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.961040:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff917183a70600) 00010000:00010000:3.0:1782759529.961053:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759529.961103:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.961116:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.961126:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759529.961265:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000760d8acd reply state 00000000109eb0c3 transno 4294968103 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759529.961274:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759529.961374:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103290:x1869355197292928:12345-192.168.204.31@tcp:36:touch.500 Request processed in 439us (1360us total) trans 4294968103 rc 0/0 00000100:00100000:3.0:1782759529.961381:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2135 00000100:00100000:3.0:1782759529.973234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782759529.973352:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.973382:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.973390:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.973396:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759529.973402:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.973411:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.973428:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759529.973432:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759529.973437:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.973444:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfe61 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759529.975887:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197293056 00000100:00100000:3.0:1782759529.975903:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197293056 00000100:00100000:3.0:1782759529.975967:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2136 00000100:00100000:3.0:1782759529.975978:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103290:x1869355197293056:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:3.0:1782759529.976004:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759529.976025:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfe68 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fb3 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.976085:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfe68 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fb3 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.976402:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfe68 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fb3 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759529.976430:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759529.976434:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759529.976437:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759529.976501:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103290:x1869355197293056:12345-192.168.204.31@tcp:101:touch.500 Request processed in 524us (3276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759529.976509:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2136 00000100:00100000:2.0:1782759529.983953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759529.984228:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197293184 00000100:00100000:3.0:1782759529.984238:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197293184 00000100:00100000:3.0:1782759529.984291:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1021 00000100:00100000:3.0:1782759529.984301:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197293184:12345-192.168.204.31@tcp:2:touch.500 00000100:00100000:3.0:1782759529.984643:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197293184:12345-192.168.204.31@tcp:2:touch.500 Request processed in 343us (699us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1782759529.984651:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1021 00000100:00080000:2.0:1782759529.985048:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759529.999207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759529.999324:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197293440 00000100:00100000:1.0:1782759529.999334:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197293440 00000100:00100000:1.0:1782759529.999393:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 275 00000100:00100000:1.0:1782759529.999404:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103290:x1869355197293440:12345-192.168.204.31@tcp:35:touch.500 00000100:00100000:1.0:1782759529.999724:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:103290:x1869355197293440:12345-192.168.204.31@tcp:35:touch.500 Request processed in 321us (525us total) trans 4294968104 rc 0/0 00000100:00100000:1.0:1782759529.999742:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 275 00010000:00010000:1.0:1782759530.092182:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759530.171940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759530.171977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759530.172080:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197293696 00000100:00100000:2.0:1782759530.172091:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197293696 00000100:00100000:2.0:1782759530.172175:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2031 00000100:00100000:2.0:1782759530.172198:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197293696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759530.172278:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197293696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759530.172286:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2031 00000100:00080000:3.0:1782759530.172750:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759530.172887:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197293568 00000100:00100000:0.0:1782759530.172894:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197293568 00000100:00100000:0.0:1782759530.172932:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2833 00000100:00100000:0.0:1782759530.172939:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197293568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759530.172982:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197293568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759530.172989:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2833 02000000:00000400:1.0:1782759530.904556:0:149573:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0000_int: flush entry ffff917082bf4200: key 500, ref 0, fl 0, cur 1782759530, ex 3628/4798 00000100:00100000:3.0:1782759530.953965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759530.954005:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197293824 00000100:00100000:0.0:1782759530.954019:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197293824 00000100:00100000:0.0:1782759530.954075:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2137 00000100:00100000:0.0:1782759530.954086:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:103327:x1869355197293824:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:0.0:1782759530.954109:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759530.954130:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777dfe6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fba expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.954203:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.954217:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.954229:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.954281:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.954289:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.954296:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.955979:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfe84 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.955993:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfe84 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956004:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfe84 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759530.956100:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00000004:00200000:0.0:1782759530.956105:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759530.956239:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfe84 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956255:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956262:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956268:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956273:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759530.956277:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956283:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956295:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759530.956298:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759530.956302:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956307:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dfe76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956318:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956333:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956338:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956342:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759530.956345:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956350:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956357:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff917183a70100) 00010000:00010000:0.0:1782759530.956359:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759530.956361:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956366:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777dfe7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956403:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777dfe6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fba expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956417:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfe84 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fba expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.956424:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759530.956426:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759530.956433:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98e00, rc 0) 00000100:00100000:0.0:1782759530.956503:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197293824:12345-192.168.204.31@tcp:101:touch.500 Request processed in 2419us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759530.956511:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2137 00000100:00100000:3.0:1782759530.961470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759530.961513:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197294080 00000100:00100000:1.0:1782759530.961626:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197294080 00000100:00100000:1.0:1782759530.961762:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2138 00000100:00100000:1.0:1782759530.961773:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197294080:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:1.0:1782759530.961802:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759530.962741:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfe8b lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fc1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.963415:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.963431:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.963442:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.966088:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.966108:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.966120:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759530.966984:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00010000:00010000:1.0:1782759530.967007:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967015:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967023:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967030:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759530.967034:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967042:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967057:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70600) 00010000:00010000:1.0:1782759530.967060:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759530.967064:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967070:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777dfe92 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967083:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967089:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967105:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967110:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759530.967114:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967120:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967128:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xaeae4fd0 (ffff9171889c5300) 00010000:00010000:1.0:1782759530.967131:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759530.967134:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967139:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dfe99 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967184:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfe8b lrc: 1/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fc1 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967196:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70600) 00010000:00010000:1.0:1782759530.967199:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759530.967202:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dfe8b lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fc1 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.967212:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782759530.967281:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197294080:12345-192.168.204.31@tcp:101:touch.500 Request processed in 5509us (5818us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759530.967300:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2138 00000100:00100000:3.0:1782759530.973613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759530.973650:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197294336 00000100:00100000:3.0:1782759530.973661:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197294336 00000100:00100000:3.0:1782759530.973713:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2139 00000100:00100000:3.0:1782759530.973722:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197294336:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:3.0:1782759530.973749:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759530.973768:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfea0 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fc8 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.974178:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.974195:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.974205:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.974217:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.974224:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.974231:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759530.978561:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35:0x0], index 0: 0 00010000:00010000:3.0:1782759530.979690:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfeb5 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.979709:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.979720:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.979769:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981281:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981295:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981302:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759530.981307:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981316:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981330:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70600) 00010000:00010000:3.0:1782759530.981333:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759530.981338:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981344:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dfea7 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759530.981358:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd61d6b0 reply state 0000000082c6ff47 transno 4294968105 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759530.981367:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759530.981417:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfea0 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fc8 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981446:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fc8 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.981454:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759530.981457:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759530.981460:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759530.981537:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:103327:x1869355197294336:12345-192.168.204.31@tcp:101:touch.500 Request processed in 7815us (7933us total) trans 4294968105 rc 0/0 00000100:00100000:3.0:1782759530.981546:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2139 00000001:00080000:3.0:1782759530.984304:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967403 is committed 00000001:00080000:1.0:1782759530.998773:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968102 is committed 00000001:00080000:1.0:1782759530.998993:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968104 is committed 00010000:00010000:3.0:1782759531.002964:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.002982:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.002990:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.002997:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759531.003001:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.003008:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.003023:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xaeae4fd0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759531.003026:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759531.003038:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.003043:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfeae lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759531.003219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759531.003426:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197294592 00000100:00100000:3.0:1782759531.003436:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197294592 00000100:00100000:3.0:1782759531.003502:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2140 00000100:00100000:3.0:1782759531.003513:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:103327:x1869355197294592:12345-192.168.204.31@tcp:36:touch.500 00010000:00010000:3.0:1782759531.003571:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759531.003588:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfeb5 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fc8 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.003598:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759531.003604:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759531.003645:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.003659:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.003669:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782759531.003810:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1782759531.003894:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4c45d28 reply state 00000000c8d49d7f transno 4294968106 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759531.003904:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759531.004034:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197294592:12345-192.168.204.31@tcp:36:touch.500 Request processed in 522us (817us total) trans 4294968106 rc 0/0 00000100:00100000:3.0:1782759531.004053:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2140 00010000:00010000:3.0:1782759531.009344:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.009360:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.009368:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.009375:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759531.009380:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.009387:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.009403:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759531.009406:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759531.009411:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.009417:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfec3 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759531.010458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759531.010991:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197294720 00000100:00100000:3.0:1782759531.011002:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197294720 00000100:00100000:3.0:1782759531.011066:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2141 00000100:00100000:3.0:1782759531.011077:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:103327:x1869355197294720:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:3.0:1782759531.011109:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759531.011135:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfeca lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fcf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.011191:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfeca lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fcf expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.011205:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfeca lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fcf expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759531.011222:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759531.011226:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759531.011229:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759531.011300:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197294720:12345-192.168.204.31@tcp:101:touch.500 Request processed in 224us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759531.011307:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2141 00000100:00100000:2.0:1782759531.024378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759531.024412:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197294848 00000100:00100000:2.0:1782759531.024421:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197294848 00000100:00100000:2.0:1782759531.024474:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1022 00000100:00100000:2.0:1782759531.024483:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197294848:12345-192.168.204.31@tcp:2:touch.500 00000100:00100000:2.0:1782759531.024792:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197294848:12345-192.168.204.31@tcp:2:touch.500 Request processed in 308us (421us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1782759531.024799:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1022 00000100:00100000:2.0:1782759531.028871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759531.029256:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197295104 00000100:00100000:3.0:1782759531.029266:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197295104 00000100:00100000:3.0:1782759531.029324:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 276 00000100:00100000:3.0:1782759531.029334:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:103327:x1869355197295104:12345-192.168.204.31@tcp:35:touch.500 00000100:00100000:3.0:1782759531.029661:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:103327:x1869355197295104:12345-192.168.204.31@tcp:35:touch.500 Request processed in 327us (843us total) trans 4294968107 rc 0/0 00000100:00100000:3.0:1782759531.029669:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 276 00010000:00010000:0.0:1782759531.120989:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759531.436231:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759531.436266:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211970560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759531.436356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759531.436458:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970560 00000100:00100000:3.0:1782759531.436466:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970560 00000100:00100000:3.0:1782759531.436543:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1782759531.436554:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211970560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759531.436597:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759531.436659:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211970560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759531.436668:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00080000:2.0:1782759531.436714:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759531.436735:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211970560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759532.140020:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 02000000:00000400:1.0:1782759532.157495:0:149623:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0000_int: flush entry ffff9170839b6000: key 500, ref 0, fl 0, cur 1782759532, ex 3629/4799 00010000:00010000:0.0:1782759533.164002:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759533.228869:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759533.228906:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197295360 00000100:00100000:2.0:1782759533.228915:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197295360 00000100:00100000:2.0:1782759533.228975:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2142 00000100:00100000:2.0:1782759533.228984:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:103399:x1869355197295360:12345-192.168.204.31@tcp:101:cat.500 00010000:00010000:2.0:1782759533.229009:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759533.229028:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfed1 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fd6 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229150:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229164:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229176:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759533.229187:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00010000:00010000:2.0:1782759533.229213:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229220:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229226:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229238:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759533.229242:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229248:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229259:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759533.229262:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759533.229267:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229281:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777dfed8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229315:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfed1 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fd6 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229324:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70600) 00010000:00010000:2.0:1782759533.229325:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759533.229329:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777dfed1 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fd6 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.229337:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90a00, rc 0) 00000100:00100000:2.0:1782759533.229397:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:103399:x1869355197295360:12345-192.168.204.31@tcp:101:cat.500 Request processed in 413us (536us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759533.229406:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2142 00000100:00080000:2.0:1782759533.229427:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759533.232171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759533.232234:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197295616 00000100:00100000:3.0:1782759533.232244:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197295616 00000100:00100000:3.0:1782759533.232298:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2143 00000100:00100000:3.0:1782759533.232306:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:103399:x1869355197295616:12345-192.168.204.31@tcp:101:cat.500 00010000:00010000:3.0:1782759533.232324:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759533.232342:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfedf lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fdd expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759533.232445:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfee6 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759533.232459:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfee6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759533.232469:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfee6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759533.232480:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00010000:00010000:3.0:1782759533.232626:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dfedf lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fdd expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759533.232641:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfee6 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fdd expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759533.232655:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759533.232658:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759533.232661:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759533.232926:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:103399:x1869355197295616:12345-192.168.204.31@tcp:101:cat.500 Request processed in 619us (761us total) trans 4294968108 rc 0/0 00000100:00100000:3.0:1782759533.232933:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2143 00000100:00100000:2.0:1782759533.240705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759533.241374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759533.241460:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197295872 00000100:00100000:3.0:1782759533.241470:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197295872 00000100:00100000:3.0:1782759533.241555:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 277 00000100:00100000:3.0:1782759533.241566:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:103399:x1869355197295872:12345-192.168.204.31@tcp:35:cat.500 00000100:00100000:3.0:1782759533.241887:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:103399:x1869355197295872:12345-192.168.204.31@tcp:35:cat.500 Request processed in 322us (1192us total) trans 4294968109 rc 0/0 00000100:00100000:3.0:1782759533.241895:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 277 00000100:00100000:0.0:1782759533.241967:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296000 00000100:00100000:0.0:1782759533.241972:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296000 00000100:00100000:0.0:1782759533.242006:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 182 00000100:00100000:0.0:1782759533.242013:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:2362:x1869355197296000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759533.242024:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759533.242059:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777dfee6 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fdd expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.242075:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171908a1500) 00010000:00010000:0.0:1782759533.242083:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759533.242103:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2362:x1869355197296000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 90us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759533.242109:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 182 00000100:00100000:2.0:1782759533.488623:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211970816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.488691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759533.488750:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211971328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.488779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759533.488803:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782759533.488809:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211970688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.488894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759533.488925:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211971200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.488947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759533.488971:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211971072:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.488994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759533.489011:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759533.489016:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211970944:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.489036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759533.489232:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970688 00000100:00100000:1.0:1782759533.489241:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970688 00000100:00100000:1.0:1782759533.489284:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1782759533.489294:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759533.489346:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211970688:12345-0@lo:400:kworker.0 Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759533.489353:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1782759533.489405:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211970688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.489495:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970816 00000100:00100000:2.0:1782759533.489499:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970816 00000100:00100000:2.0:1782759533.489525:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971200 00000100:00100000:2.0:1782759533.489528:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971200 00000100:00100000:2.0:1782759533.489551:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211970944 00000100:00100000:2.0:1782759533.489554:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211970944 00000100:00100000:2.0:1782759533.489569:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1782759533.489574:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211970816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.489604:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211970816:12345-0@lo:400:kworker.0 Request processed in 29us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759533.489610:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1782759533.489621:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1782759533.489626:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211971200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.489646:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211971200:12345-0@lo:400:kworker.0 Request processed in 20us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759533.489651:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1782759533.489660:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1782759533.489665:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211970944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.489693:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211970944:12345-0@lo:400:kworker.0 Request processed in 28us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759533.489707:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1782759533.489723:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971328 00000100:00100000:1.0:1782759533.489773:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211971200:0@lo:400:kworker.0 00000100:00100000:1.0:1782759533.489783:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211970816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.489816:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971328 00000100:00100000:2.0:1782759533.490993:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971072 00000100:00100000:2.0:1782759533.490999:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971072 00000100:00100000:2.0:1782759533.491023:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1782759533.491030:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211971328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.491201:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211971328:12345-0@lo:400:kworker.0 Request processed in 171us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759533.491208:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1782759533.491222:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1782759533.491228:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211971072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.491255:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211971072:12345-0@lo:400:kworker.0 Request processed in 28us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759533.491260:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00080000:2.0:1782759533.491283:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759533.491286:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759533.491288:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759533.491317:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211970944:0@lo:400:kworker.0 00000100:00100000:2.0:1782759533.491328:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211971072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759533.491611:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211971328:0@lo:400:kworker.0 00000001:00080000:0.0:1782759533.564034:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967417 is committed 00000100:00100000:1.0:1782759534.000316:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759534.000338:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211971456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759534.000408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759534.000505:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971456 00000100:00100000:2.0:1782759534.000513:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971456 00000100:00100000:2.0:1782759534.000564:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1782759534.000574:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211971456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759534.000611:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759534.000675:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211971456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759534.000692:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1782759534.000751:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211971456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759534.188374:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759535.090265:0:149768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9995a260 20000000:00000080:2.0:1782759535.090283:0:149768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082d66000 uarg=0000000000000000 00010000:00010000:2.0:1782759535.095365:0:149768:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1782759535.095637:0:149768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:2.0:1782759535.095642:0:149768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759535.095653:0:149768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777dfe68 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x18:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fb3 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.095677:0:149768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171908a1600) 00010000:00010000:2.0:1782759535.095680:0:149768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759535.095685:0:149768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777dfeca lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fcf expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.095711:0:149768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70600) 00010000:00010000:2.0:1782759535.095714:0:149768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759535.095718:0:149768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777dfe84 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fba expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.095733:0:149768:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 3 locks, left on hash table 0. 10000000:01000000:2.0:1782759535.095782:0:149768:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759535.095794:0:149768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.095806:0:149768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.096469:0:149768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.096511:0:149768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759535.096522:0:149768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 18 pid: 5793 timeout: 3703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759535.096536:0:149768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149768:1869355211971584:0@lo:104: 00000100:00100000:2.0:1782759535.096602:0:149768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759535.096652:0:149768:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759535.096959:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759535.096971:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971584 00000100:00100000:0.0:1782759535.096977:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971584 00000100:00100000:0.0:1782759535.097029:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1782759535.097037:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bba89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149768:x1869355211971584:12345-0@lo:104: 00010000:00010000:0.0:1782759535.097049:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759535.097112:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759535.097117:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bba89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149768:x1869355211971584:12345-0@lo:104: Request processed in 81us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.097124:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1782759535.097369:0:149768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149768:1869355211971584:0@lo:104: 00010000:00010000:2.0:1782759535.097387:0:149768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.097534:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759535.097540:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.097548:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759535.097552:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.097561:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759535.097569:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759535.097585:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759535.097618:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.097625:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759535.097653:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.097660:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dfe1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dfe22 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.097675:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759535.097677:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759535.097678:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759535.097791:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211971712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759535.097817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759535.098026:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971712 00000100:00100000:1.0:1782759535.098031:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971712 00010000:00010000:1.0:1782759535.098049:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 19 pid: 5793 timeout: 3703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759535.098091:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1782759535.098098:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211971712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759535.098108:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759535.098113:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 19 pid: 5793 timeout: 3703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098123:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 19 pid: 5793 timeout: 3703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098135:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc400/0xdd99f5c4777dfe22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dfe1b expref: 19 pid: 5793 timeout: 3703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098147:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098155:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098165:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098172:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098179:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098185:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098199:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759535.098203:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098210:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098223:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759535.098231:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759535.098259:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211971712:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759535.098265:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1782759535.098290:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211971712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759535.098767:0:149768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.098777:0:149768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759535.098783:0:149768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777dfef4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759535.218116:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759535.295508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759535.295548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759535.295577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759535.295625:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759535.295655:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296128 00000100:00100000:0.0:1782759535.295663:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296128 00000100:00100000:0.0:1782759535.295726:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2835 00000100:00100000:0.0:1782759535.295737:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197296128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759535.295837:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197296128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.295845:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2835 00000100:00100000:2.0:1782759535.298736:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296256 00000100:00100000:2.0:1782759535.298751:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296256 00000100:00100000:2.0:1782759535.298848:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2586 00000100:00100000:2.0:1782759535.298859:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2363:x1869355197296256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759535.298928:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2363:x1869355197296256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759535.298935:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2586 00000100:00100000:2.0:1782759535.298958:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296512 00000100:00100000:2.0:1782759535.298969:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296512 00000100:00100000:2.0:1782759535.298996:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296384 00000100:00100000:2.0:1782759535.298999:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296384 00000100:00100000:2.0:1782759535.299019:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2034 00000100:00100000:2.0:1782759535.299025:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197296512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759535.299052:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197296512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759535.299058:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2034 00000100:00100000:2.0:1782759535.299069:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2035 00000100:00100000:2.0:1782759535.299075:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197296384:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759535.299098:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197296384:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759535.299104:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2035 00000100:00080000:0.0:1782759535.299901:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759535.299906:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759535.299909:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1782759536.062432:0:149816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3c244cd0 20000000:00000080:2.0:1782759536.062450:0:149816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2dab800 uarg=0000000000000000 00010000:00010000:2.0:1782759536.063257:0:149816:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759536.063276:0:149816:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759536.063295:0:149816:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759536.063317:0:149816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063334:0:149816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063343:0:149816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063351:0:149816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063364:0:149816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063372:0:149816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063379:0:149816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759536.063383:0:149816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063393:0:149816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063406:0:149816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063414:0:149816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759536.063420:0:149816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777dfefb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759536.129951:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968109 is committed 00010000:00010000:1.0:1782759536.239634:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759536.556039:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211971840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759536.556115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759536.556217:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971840 00000100:00100000:3.0:1782759536.556224:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971840 00000100:00100000:3.0:1782759536.556281:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1782759536.556290:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211971840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759536.556324:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782759536.556386:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759536.557390:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211971840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1097us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759536.557417:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1782759536.557493:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211971840:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782759536.895316:0:149865:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4d371090 20000000:00000080:1.0:1782759536.895334:0:149865:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084fa3000 uarg=0000000000000000 00010000:00010000:1.0:1782759536.895714:0:149865:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759536.895729:0:149865:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759536.895748:0:149865:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759536.895768:0:149865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895795:0:149865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895806:0:149865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895814:0:149865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895859:0:149865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895868:0:149865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895875:0:149865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759536.895879:0:149865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895887:0:149865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895900:0:149865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895908:0:149865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759536.895914:0:149865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777dff02 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759537.068936:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759537.068947:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759537.068953:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759537.069004:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759537.069018:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759537.069029:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759537.069059:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211971968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759537.069135:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759537.069236:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718bf4ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759537.073356:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211971968 00000100:00100000:2.0:1782759537.073370:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211971968 00000100:00100000:2.0:1782759537.073428:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:2.0:1782759537.073438:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211971968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759537.073454:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759537.073475:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dff09 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759537.073533:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759537.073545:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759537.073554:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90c00, rc 0) 00000100:00100000:2.0:1782759537.073885:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211971968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 447us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759537.073892:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:3.0:1782759537.073995:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211971968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759537.074012:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759537.074021:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759537.074041:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759537.074046:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759537.074054:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.260360:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759537.846114:0:149913:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4540c7f0 20000000:00000080:0.0:1782759537.846131:0:149913:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b1c00 uarg=0000000000000000 00010000:00010000:0.0:1782759537.846339:0:149913:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759537.846353:0:149913:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759537.846369:0:149913:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759537.846387:0:149913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759537.846409:0:149913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759537.846417:0:149913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759537.846453:0:149913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759537.846562:0:149913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 18 pid: 5793 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759537.846577:0:149913:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149913:1869355211972096:0@lo:104: 00000100:00100000:0.0:1782759537.846634:0:149913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759537.846735:0:149913:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759537.846780:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972096 00000100:00100000:3.0:1782759537.846787:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972096 00000100:00100000:3.0:1782759537.847014:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1782759537.847023:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149913:x1869355211972096:12345-0@lo:104: 00010000:00010000:3.0:1782759537.847036:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759537.847092:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759537.847098:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:149913:x1869355211972096:12345-0@lo:104: Request processed in 77us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759537.847106:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00010000:00010000:1.0:1782759537.847153:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759537.847160:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847168:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759537.847172:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847179:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759537.847187:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759537.847193:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759537.847223:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847229:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759537.847247:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847254:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777dff09 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff10 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847266:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759537.847268:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759537.847270:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759537.847294:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211972224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759537.847324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759537.847362:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972224 00000100:00100000:1.0:1782759537.847366:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972224 00010000:00010000:1.0:1782759537.847386:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 19 pid: 5793 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759537.847407:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1782759537.847413:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211972224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759537.847423:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759537.847428:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 19 pid: 5793 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847437:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 19 pid: 5793 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847452:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847460:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847473:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847481:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847487:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847503:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847508:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759537.847512:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847519:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847527:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759537.847536:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759537.847564:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211972224:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759537.847570:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1782759537.847609:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211972224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759537.847695:0:149913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff10 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dff09 expref: 18 pid: 5793 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759537.847706:0:149913:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149913:1869355211972096:0@lo:104: 00010000:00010000:2.0:1782759537.847718:0:149913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759537.847726:0:149913:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759537.847733:0:149913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759537.847738:0:149913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99e00/0xdd99f5c4777dff17 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759538.287461:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759538.606981:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211972352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759538.607095:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211972864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759538.607147:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782759538.607154:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211972480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759538.607192:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211972992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759538.607262:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211972608:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759538.607305:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759538.607310:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211972736:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759538.607383:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972352 00000100:00100000:1.0:1782759538.607390:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972352 00000100:00100000:1.0:1782759538.607442:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1782759538.607452:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211972352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607502:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211972352:12345-0@lo:400:kworker.0 Request processed in 51us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759538.607509:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1782759538.607546:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972864 00000100:00100000:1.0:1782759538.607549:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972864 00000100:00100000:1.0:1782759538.607579:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972480 00000100:00100000:1.0:1782759538.607581:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972480 00000100:00100000:1.0:1782759538.607597:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972608 00000100:00100000:1.0:1782759538.607599:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972608 00000100:00100000:1.0:1782759538.607616:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1782759538.607621:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211972864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607666:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211972864:12345-0@lo:400:kworker.0 Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759538.607672:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1782759538.607685:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1782759538.607690:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211972480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607715:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211972480:12345-0@lo:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759538.607728:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1782759538.607741:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1782759538.607747:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211972608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607782:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211972608:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759538.607787:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1782759538.607808:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972992 00000100:00100000:1.0:1782759538.607811:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972992 00000100:00100000:1.0:1782759538.607853:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211972736 00000100:00100000:1.0:1782759538.607856:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211972736 00000100:00100000:1.0:1782759538.607875:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1782759538.607881:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211972992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607911:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211972992:12345-0@lo:400:kworker.0 Request processed in 30us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759538.607917:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1782759538.607929:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1782759538.607934:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211972736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.607959:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211972736:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759538.607965:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00080000:1.0:1782759538.607986:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759538.607990:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759538.607992:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759538.608264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211972736:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.608276:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211972608:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.608323:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211972480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.608332:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211972992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.608340:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211972352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759538.608348:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211972864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759539.116701:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759539.116729:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211973120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759539.116801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759539.116914:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973120 00000100:00100000:0.0:1782759539.116922:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973120 00000100:00100000:0.0:1782759539.116979:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1782759539.116987:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211973120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759539.117028:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759539.117072:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211973120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759539.117078:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1782759539.117118:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211973120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759539.527879:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759539.889423:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759539.889429:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759539.889433:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759539.889478:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759539.889490:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759539.889501:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759539.889528:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211973248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759539.889617:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759539.889671:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759539.889731:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973248 00000100:00100000:2.0:1782759539.889740:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973248 00000100:00100000:2.0:1782759539.889803:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:2.0:1782759539.889813:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211973248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759539.889848:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759539.889861:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dff1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.889884:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.889895:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.889904:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759539.890088:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211973248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759539.890095:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1782759539.892124:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211973248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759539.892153:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759539.892166:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759539.892190:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759539.892196:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759539.892204:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759540.332280:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759540.405481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759540.405517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759540.405563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759540.405588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759540.405687:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296640 00000100:00100000:3.0:1782759540.405697:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296640 00000100:00100000:3.0:1782759540.405744:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2839 00000100:00100000:3.0:1782759540.405754:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197296640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759540.405818:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197296640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759540.405845:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2839 00000100:00100000:3.0:1782759540.405997:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297024 00000100:00100000:3.0:1782759540.406001:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297024 00000100:00100000:3.0:1782759540.406032:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296896 00000100:00100000:3.0:1782759540.406035:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296896 00000100:00100000:3.0:1782759540.406054:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2038 00000100:00100000:3.0:1782759540.406060:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197297024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759540.406094:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197297024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759540.406100:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2038 00000100:00100000:3.0:1782759540.406111:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2039 00000100:00100000:3.0:1782759540.406117:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197296896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759540.406137:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197296896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759540.406142:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2039 00000100:00100000:1.0:1782759540.406814:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197296768 00000100:00100000:1.0:1782759540.406840:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197296768 00000100:00100000:1.0:1782759540.406879:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2590 00000100:00100000:1.0:1782759540.406886:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197296768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759540.407054:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197296768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 166us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759540.407062:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2590 00000100:00080000:1.0:1782759540.407088:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759540.407092:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759540.407094:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759541.356103:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759541.678549:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211973376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759541.678638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759541.679079:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973376 00000100:00100000:0.0:1782759541.679089:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973376 00000100:00100000:0.0:1782759541.679167:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1782759541.679177:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211973376:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759541.679213:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782759541.679233:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759541.679298:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211973376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759541.679305:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1782759541.679597:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211973376:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1782759541.894432:0:150111:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3f085c30 20000000:00000080:2.0:1782759541.894453:0:150111:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b2da8000 uarg=0000000000000000 10000000:01000000:2.0:1782759541.895126:0:150111:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759541.895144:0:150111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.895159:0:150111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.895167:0:150111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.895203:0:150111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.895225:0:150111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 18 pid: 5793 timeout: 3710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759541.895238:0:150111:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150111:1869355211973504:0@lo:104: 00000100:00100000:2.0:1782759541.895292:0:150111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759541.895388:0:150111:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759541.896143:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973504 00000100:00100000:0.0:1782759541.896152:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973504 00000100:00100000:0.0:1782759541.896242:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1782759541.896252:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150111:x1869355211973504:12345-0@lo:104: 00010000:00010000:0.0:1782759541.896265:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759541.896373:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759541.896379:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150111:x1869355211973504:12345-0@lo:104: Request processed in 129us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759541.896386:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1782759541.896439:0:150111:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150111:1869355211973504:0@lo:104: 00010000:00010000:2.0:1782759541.896457:0:150111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.896507:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759541.896514:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.896521:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759541.896524:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.896532:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759541.896550:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759541.896555:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759541.896625:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.896631:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759541.896657:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.896663:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff1e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.896676:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759541.896677:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759541.896679:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759541.896685:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759541.896694:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211973632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759541.896722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759541.896754:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973632 00000100:00100000:3.0:1782759541.896757:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973632 00010000:00010000:3.0:1782759541.896957:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 19 pid: 5793 timeout: 3710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759541.897006:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1782759541.897014:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211973632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759541.897024:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759541.897029:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 19 pid: 5793 timeout: 3710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897039:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 19 pid: 5793 timeout: 3710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897050:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777dff25 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dff1e expref: 19 pid: 5793 timeout: 3710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897061:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897069:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897089:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897095:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897101:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897106:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897111:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759541.897114:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897120:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897130:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897137:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759541.897161:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211973632:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759541.897166:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00010000:2.0:1782759541.897184:0:150111:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897190:0:150111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759541.897201:0:150111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777dff2c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759541.898744:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211973632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759542.383603:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759542.741243:0:150159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe98701b20 20000000:00000080:3.0:1782759542.741260:0:150159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928f800 uarg=0000000000000000 10000000:01000000:3.0:1782759542.741528:0:150159:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759542.741560:0:150159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741577:0:150159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741588:0:150159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741595:0:150159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741602:0:150159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741608:0:150159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741615:0:150159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759542.741620:0:150159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741629:0:150159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741641:0:150159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741648:0:150159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759542.741664:0:150159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777dff33 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.408591:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759543.532038:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759543.532047:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759543.532052:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759543.532094:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.532107:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.532119:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759543.532145:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211973760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759543.532212:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759543.532294:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759543.532401:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973760 00000100:00100000:3.0:1782759543.532409:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973760 00000100:00100000:3.0:1782759543.532465:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1782759543.532474:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211973760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759543.532488:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759543.532500:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dff3a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759543.532522:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759543.532555:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759543.532564:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759543.532601:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211973760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759543.532608:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:0.0:1782759543.532780:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211973760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759543.532793:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.532802:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759543.533117:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759543.533125:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.533133:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759543.725173:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211974272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759543.725244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759543.725302:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782759543.725308:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211973888:0@lo:400:kworker.0 00000100:00100000:2.0:1782759543.725337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759543.725361:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211974400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759543.725384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759543.725412:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211973888 00000100:00100000:2.0:1782759543.725420:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211973888 00000100:00100000:2.0:1782759543.725462:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1782759543.725470:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211973888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759543.725518:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211973888:12345-0@lo:400:kworker.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759543.725524:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1782759543.725587:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211973888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.725966:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211974016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.725997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759543.726017:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211974528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759543.726059:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759543.726078:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211974144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759543.726129:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974272 00000100:00100000:1.0:1782759543.726133:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974272 00000100:00100000:1.0:1782759543.726168:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974528 00000100:00100000:1.0:1782759543.726170:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974528 00000100:00100000:1.0:1782759543.726191:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1782759543.726197:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211974272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726238:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211974272:12345-0@lo:400:kworker.0 Request processed in 41us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759543.726244:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1782759543.726261:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1782759543.726267:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211974528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726297:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211974528:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759543.726302:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1782759543.726320:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974400 00000100:00100000:1.0:1782759543.726323:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974400 00000100:00100000:1.0:1782759543.726344:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974016 00000100:00100000:1.0:1782759543.726346:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974016 00000100:00100000:1.0:1782759543.726358:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974144 00000100:00100000:1.0:1782759543.726360:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974144 00000100:00100000:1.0:1782759543.726375:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1782759543.726380:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211974400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726411:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211974400:12345-0@lo:400:kworker.0 Request processed in 31us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759543.726417:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1782759543.726429:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1782759543.726442:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211974016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726468:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211974016:12345-0@lo:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759543.726474:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1782759543.726486:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1782759543.726491:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211974144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726514:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211974144:12345-0@lo:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759543.726519:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00080000:1.0:1782759543.726576:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759543.726581:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759543.726583:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759543.726610:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211974400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726620:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211974272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726647:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211974144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726655:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211974016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759543.726664:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211974528:0@lo:400:kworker.0 00000020:00000080:1.0:1782759543.792026:0:150208:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff255090a0 20000000:00000080:1.0:1782759543.792049:0:150208:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91718853e000 uarg=0000000000000000 00010000:00010000:1.0:1782759543.792299:0:150208:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759543.792314:0:150208:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759543.792330:0:150208:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759543.792349:0:150208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759543.792381:0:150208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759543.792390:0:150208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759543.792428:0:150208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759543.792444:0:150208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 18 pid: 5796 timeout: 3712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759543.792458:0:150208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150208:1869355211974656:0@lo:104: 00000100:00100000:1.0:1782759543.792517:0:150208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759543.795944:0:150208:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759543.796290:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974656 00000100:00100000:0.0:1782759543.796301:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974656 00000100:00100000:2.0:1782759543.797253:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1782759543.797265:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150208:x1869355211974656:12345-0@lo:104: 00010000:00010000:2.0:1782759543.797283:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759543.797459:0:150208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150208:1869355211974656:0@lo:104: 00010000:00010000:1.0:1782759543.797484:0:150208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.800790:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759543.800855:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150208:x1869355211974656:12345-0@lo:104: Request processed in 3575us (8319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759543.800870:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00010000:00010000:0.0:1782759543.801256:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759543.801264:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.801275:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759543.801279:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.801290:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759543.801298:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759543.801316:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759543.801359:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.801366:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759543.801418:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211974784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759543.801486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759543.801621:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.801629:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777dff3a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff41 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.801650:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759543.801652:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759543.801653:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759543.801735:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974784 00000100:00100000:2.0:1782759543.801743:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974784 00010000:00010000:2.0:1782759543.801772:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 19 pid: 5796 timeout: 3712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759543.801808:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1782759543.801817:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211974784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759543.802023:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759543.802029:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 19 pid: 5796 timeout: 3712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802041:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 19 pid: 5796 timeout: 3712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802054:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777dff41 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dff3a expref: 19 pid: 5796 timeout: 3712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802068:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802076:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802091:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802097:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802114:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802121:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802126:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759543.802130:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802137:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802156:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759543.802167:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759543.802228:0:150208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.802236:0:150208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759543.802241:0:150208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777dff48 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759543.815954:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211974784:12345-0@lo:103:ldlm_bl.0 Request processed in 14022us (14350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759543.815968:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1782759543.820706:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211974784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759544.247194:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211974912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759544.247270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759544.247915:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211974912 00000100:00100000:3.0:1782759544.247928:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211974912 00000100:00100000:3.0:1782759544.247988:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1782759544.248000:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211974912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759544.248049:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759544.248115:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211974912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759544.248138:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1782759544.250558:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211974912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759544.432034:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759545.452062:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759545.525204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759545.525244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759545.525290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759545.525319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759545.525349:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297536 00000100:00100000:3.0:1782759545.525361:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297536 00000100:00100000:3.0:1782759545.525419:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297408 00000100:00100000:3.0:1782759545.525422:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297408 00000100:00100000:3.0:1782759545.525446:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2042 00000100:00100000:3.0:1782759545.525458:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197297536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759545.525547:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197297536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759545.525554:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2042 00000100:00100000:3.0:1782759545.525573:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2043 00000100:00100000:3.0:1782759545.525581:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197297408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759545.525607:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197297408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759545.525614:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2043 00000100:00100000:3.0:1782759545.525632:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297152 00000100:00100000:3.0:1782759545.525636:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297152 00000100:00100000:3.0:1782759545.525661:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2842 00000100:00100000:3.0:1782759545.525668:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197297152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759545.525690:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197297152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759545.525713:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2842 00000100:00080000:3.0:1782759545.525748:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759545.525752:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759545.526501:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297280 00000100:00100000:0.0:1782759545.526510:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297280 00000100:00100000:0.0:1782759545.526574:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2594 00000100:00100000:0.0:1782759545.526583:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197297280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759545.526637:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197297280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 55us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759545.526657:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2594 00000100:00080000:3.0:1782759545.529188:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1782759545.837003:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759545.837012:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759545.837018:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759545.837080:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759545.837093:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759545.837104:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759545.837138:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211975040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759545.837210:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759545.837271:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759545.837381:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975040 00000100:00100000:2.0:1782759545.837390:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975040 00000100:00100000:2.0:1782759545.837444:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:2.0:1782759545.837453:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211975040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759545.837465:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759545.837501:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dff4f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759545.837525:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759545.837536:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759545.837546:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759545.837596:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211975040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.837602:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:1.0:1782759545.837713:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211975040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759545.837731:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759545.837746:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759545.837767:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759545.837772:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759545.837779:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759546.490995:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759546.797668:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759546.797701:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211975168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759546.797791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759546.797886:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975168 00000100:00100000:1.0:1782759546.797896:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975168 00000100:00100000:1.0:1782759546.797961:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1782759546.797972:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211975168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759546.798015:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759546.798069:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211975168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759546.798077:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:1.0:1782759546.798108:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759546.798149:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211975168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759547.509170:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759548.524027:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759548.848645:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211975424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.848717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759548.848764:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211975936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.848805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759548.848847:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782759548.848853:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211975296:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.848880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759548.848904:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211975808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.848931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759548.848954:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211975552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.848975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759548.848990:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759548.848995:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211975680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759548.849041:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975424 00000100:00100000:1.0:1782759548.849049:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975424 00000100:00100000:1.0:1782759548.849087:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975808 00000100:00100000:1.0:1782759548.849090:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975808 00000100:00100000:1.0:1782759548.849116:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975552 00000100:00100000:1.0:1782759548.849118:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975552 00000100:00100000:1.0:1782759548.849139:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1782759548.849146:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211975424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849194:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211975424:12345-0@lo:400:kworker.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759548.849203:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1782759548.849222:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1782759548.849227:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211975808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849255:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211975808:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759548.849261:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1782759548.849283:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1782759548.849288:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211975552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849318:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211975552:12345-0@lo:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759548.849324:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1782759548.849341:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975936 00000100:00100000:1.0:1782759548.849344:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975936 00000100:00100000:1.0:1782759548.849373:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975680 00000100:00100000:1.0:1782759548.849376:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975680 00000100:00100000:1.0:1782759548.849395:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1782759548.849400:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211975936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849445:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211975936:12345-0@lo:400:kworker.0 Request processed in 44us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759548.849451:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1782759548.849463:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:1.0:1782759548.849468:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211975680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849492:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211975680:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759548.849497:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00080000:1.0:1782759548.849522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759548.849526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759548.849528:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759548.849558:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211975808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849569:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211975424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849578:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211975936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849605:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211975680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759548.849621:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211975552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759548.850711:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211975296 00000100:00100000:3.0:1782759548.850719:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211975296 00000100:00100000:3.0:1782759548.850751:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1782759548.850758:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211975296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759548.850813:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211975296:12345-0@lo:400:kworker.0 Request processed in 55us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759548.850836:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1782759548.850915:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211975296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759549.357736:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211976064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759549.357847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759549.357954:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976064 00000100:00100000:1.0:1782759549.357962:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976064 00000100:00100000:1.0:1782759549.358014:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1782759549.358024:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211976064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759549.358058:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759549.358101:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211976064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759549.358109:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1782759549.358955:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211976064:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1782759549.378713:0:150405:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2daa2ae0 20000000:00000080:3.0:1782759549.378735:0:150405:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928c000 uarg=0000000000000000 00010000:00010000:3.0:1782759549.380021:0:150405:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759549.380041:0:150405:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759549.380062:0:150405:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759549.380078:0:150405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759549.380096:0:150405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759549.380105:0:150405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759549.380371:0:150405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759549.380389:0:150405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 18 pid: 5796 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759549.380406:0:150405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150405:1869355211976192:0@lo:104: 00000100:00100000:3.0:1782759549.380482:0:150405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759549.380677:0:150405:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759549.383751:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976192 00000100:00100000:1.0:1782759549.383767:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976192 00000100:00100000:1.0:1782759549.384030:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1782759549.384042:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150405:x1869355211976192:12345-0@lo:104: 00010000:00010000:1.0:1782759549.384061:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759549.384183:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759549.384190:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150405:x1869355211976192:12345-0@lo:104: Request processed in 152us (3708us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759549.384197:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00010000:00010000:2.0:1782759549.384240:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759549.384247:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384254:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759549.384258:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759549.384265:0:150405:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150405:1869355211976192:0@lo:104: 00010000:00010000:2.0:1782759549.384267:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759549.384274:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759549.384279:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759549.384299:0:150405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384339:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384345:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759549.384372:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384380:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777dff4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff56 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384396:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759549.384398:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759549.384399:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759549.384664:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211976320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759549.384704:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759549.384855:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976320 00000100:00100000:2.0:1782759549.384860:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976320 00010000:00010000:2.0:1782759549.384881:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 19 pid: 5796 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759549.384901:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1782759549.384908:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211976320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759549.384919:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759549.384924:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 19 pid: 5796 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384934:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 19 pid: 5796 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384948:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777dff56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dff4f expref: 19 pid: 5796 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384960:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384975:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384989:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.384996:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.385003:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.385009:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.385014:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759549.385018:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.385024:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.385042:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.385052:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759549.385084:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211976320:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759549.385090:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1782759549.388682:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211976320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759549.388731:0:150405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759549.388744:0:150405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759549.388751:0:150405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777dff5d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759549.548014:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759550.580350:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759550.652348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759550.652379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759550.652419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759550.652446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759550.652473:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297792 00000100:00100000:3.0:1782759550.652481:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297792 00000100:00100000:3.0:1782759550.652538:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2598 00000100:00100000:3.0:1782759550.652550:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197297792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759550.652617:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197297792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759550.652623:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2598 00000100:00100000:3.0:1782759550.652647:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197298048 00000100:00100000:3.0:1782759550.652650:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197298048 00000100:00100000:3.0:1782759550.652685:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297920 00000100:00100000:3.0:1782759550.652688:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297920 00000100:00100000:3.0:1782759550.652707:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2046 00000100:00100000:3.0:1782759550.652714:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197298048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759550.652740:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197298048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759550.652746:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2046 00000100:00100000:3.0:1782759550.652758:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2047 00000100:00100000:3.0:1782759550.652764:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197297920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759550.652785:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197297920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759550.652791:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2047 00000100:00100000:3.0:1782759550.652806:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197297664 00000100:00100000:3.0:1782759550.652809:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197297664 00000100:00100000:3.0:1782759550.652846:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2845 00000100:00100000:3.0:1782759550.652853:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197297664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759550.652874:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197297664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759550.652881:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2845 00000100:00080000:3.0:1782759550.652907:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759550.652910:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759550.652913:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1782759550.665714:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759550.665722:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759550.665727:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759550.665776:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.665788:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.665799:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759550.665844:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211976448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759550.665910:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.665949:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976448 00000100:00100000:2.0:1782759550.665956:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976448 00000100:00100000:2.0:1782759550.665995:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:2.0:1782759550.666002:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211976448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759550.666015:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759550.666027:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777dff64 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.666048:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.666058:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.666066:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90a00, rc 0) 00000100:00100000:2.0:1782759550.666097:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211976448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.666117:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:2.0:1782759550.666510:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759550.666532:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211976448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759550.666547:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.666555:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759550.666572:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759550.666576:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.666583:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759551.607033:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759551.920275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211976576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759551.920358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759551.920543:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976576 00000100:00100000:1.0:1782759551.920553:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976576 00000100:00100000:1.0:1782759551.920626:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1782759551.920636:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211976576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759551.920675:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759551.920737:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211976576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759551.920765:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1782759551.920816:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211976576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759551.921056:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759552.622541:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759553.653554:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759553.964042:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211976704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.964042:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211976832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.974508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759553.974670:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211977216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.974703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759553.974736:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759553.974750:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211977088:0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.975567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759553.975598:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977088 00000100:00100000:2.0:1782759553.975605:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977088 00000100:00100000:2.0:1782759553.975657:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1782759553.975666:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211977088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.975725:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211977088:12345-0@lo:400:kworker.0 Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759553.975732:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00080000:2.0:1782759553.975753:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759553.975930:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977216 00000100:00100000:1.0:1782759553.975935:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977216 00000100:00100000:1.0:1782759553.975967:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1782759553.975974:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211977216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976008:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211977216:12345-0@lo:400:kworker.0 Request processed in 34us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759553.976013:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1782759553.976035:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211976960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759553.976080:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759553.976085:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211977344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759553.976126:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759553.976134:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976960 00000100:00100000:1.0:1782759553.976137:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976960 00000100:00100000:1.0:1782759553.976161:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1782759553.976167:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211976960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976198:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211976960:12345-0@lo:400:kworker.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759553.976204:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1782759553.976222:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977344 00000100:00100000:1.0:1782759553.976233:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977344 00000100:00100000:1.0:1782759553.976256:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1782759553.976261:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211977344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.976268:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211977088:0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.976285:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211977216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976286:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211977344:12345-0@lo:400:kworker.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759553.976292:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00080000:1.0:1782759553.976303:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759553.976306:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759553.976322:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211977344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976345:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211976960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759553.976384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759553.976412:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976704 00000100:00100000:0.0:1782759553.976416:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976704 00000100:00100000:0.0:1782759553.976442:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:0.0:1782759553.976448:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211976704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759553.976502:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211976704:12345-0@lo:400:kworker.0 Request processed in 54us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759553.976508:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:0.0:1782759553.976557:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211976704:0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.977253:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211976832 00000100:00100000:2.0:1782759553.977258:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211976832 00000100:00100000:2.0:1782759553.977286:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1782759553.977293:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211976832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759553.977348:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211976832:12345-0@lo:400:kworker.0 Request processed in 55us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759553.977355:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1782759553.978620:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211976832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759554.480760:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211977472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759554.480857:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759554.482421:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977472 00000100:00100000:1.0:1782759554.482431:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977472 00000100:00100000:1.0:1782759554.482482:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1782759554.482491:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211977472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759554.482526:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759554.482602:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211977472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759554.482610:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1782759554.482740:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211977472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759554.675391:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759555.724008:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759555.808210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759555.808251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759555.808274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759555.808313:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759555.808340:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197298432 00000100:00100000:0.0:1782759555.808350:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197298432 00000100:00100000:0.0:1782759555.808403:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197298560 00000100:00100000:0.0:1782759555.808406:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197298560 00000100:00100000:0.0:1782759555.808427:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2050 00000100:00100000:0.0:1782759555.808436:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197298432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759555.808506:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197298432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759555.808512:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2050 00000100:00100000:0.0:1782759555.808530:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2051 00000100:00100000:0.0:1782759555.808537:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197298560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759555.808575:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197298560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759555.808581:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2051 00000100:00100000:2.0:1782759555.809188:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197298176 00000100:00100000:2.0:1782759555.809194:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197298176 00000100:00100000:2.0:1782759555.809222:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2848 00000100:00100000:2.0:1782759555.809230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197298176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759555.809272:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197298176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759555.809280:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2848 00000100:00100000:1.0:1782759555.809386:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197298304 00000100:00100000:1.0:1782759555.809391:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197298304 00000100:00100000:1.0:1782759555.809437:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2602 00000100:00100000:1.0:1782759555.809445:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197298304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759555.809480:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197298304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759555.809493:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2602 00000100:00080000:1.0:1782759555.809516:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759555.809519:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759555.809522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759556.780260:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759557.037520:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759557.037543:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211977600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759557.037628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759557.037944:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977600 00000100:00100000:1.0:1782759557.037954:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977600 00000100:00100000:1.0:1782759557.038024:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1782759557.038034:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211977600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759557.038069:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759557.038130:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211977600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759557.038138:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1782759557.038185:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211977600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759557.038503:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759557.823392:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759558.829253:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759559.088306:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211978112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759559.088453:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759559.088459:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211977728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759559.088513:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211978240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759559.088562:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211977856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759559.088612:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211978368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759559.088650:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759559.088656:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211977984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759559.088719:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977728 00000100:00100000:3.0:1782759559.088726:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977728 00000100:00100000:3.0:1782759559.088767:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:3.0:1782759559.088776:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211977728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.088848:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211977728:12345-0@lo:400:kworker.0 Request processed in 73us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759559.088856:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:3.0:1782759559.088887:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978240 00000100:00100000:3.0:1782759559.088891:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978240 00000100:00100000:3.0:1782759559.088915:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977856 00000100:00100000:3.0:1782759559.088918:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977856 00000100:00100000:3.0:1782759559.088936:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211977984 00000100:00100000:3.0:1782759559.088938:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211977984 00000100:00100000:3.0:1782759559.088956:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1782759559.088962:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211978240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089003:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211978240:12345-0@lo:400:kworker.0 Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759559.089010:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1782759559.089023:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1782759559.089030:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211977856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089483:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211977856:12345-0@lo:400:kworker.0 Request processed in 44us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759559.089492:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1782759559.089506:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1782759559.089513:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211977984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089545:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211977984:12345-0@lo:400:kworker.0 Request processed in 33us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759559.089551:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1782759559.089573:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978112 00000100:00100000:3.0:1782759559.089576:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978112 00000100:00100000:3.0:1782759559.089616:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978368 00000100:00100000:3.0:1782759559.089619:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978368 00000100:00100000:3.0:1782759559.089641:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1782759559.089647:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211978112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089791:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211978112:12345-0@lo:400:kworker.0 Request processed in 144us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759559.089798:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1782759559.089810:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1782759559.089816:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211978368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089863:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211978368:12345-0@lo:400:kworker.0 Request processed in 48us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759559.089875:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1782759559.089916:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211977984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089927:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211977856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089935:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211978368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089973:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211977728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089983:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211978240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759559.089991:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211978112:0@lo:400:kworker.0 00000100:00080000:2.0:1782759559.092038:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759559.092045:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759559.092049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759559.595999:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211978496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759559.596060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759559.596127:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978496 00000100:00100000:2.0:1782759559.596134:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978496 00000100:00100000:2.0:1782759559.596175:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1782759559.596183:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211978496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759559.596229:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759559.596282:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211978496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759559.596289:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1782759559.596329:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211978496:0@lo:13:osp-pre-1-0.0 02000000:00000400:3.0:1782759559.615181:0:150603:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0000_int: flush entry ffff9170839b7400: key 500, ref 0, fl 0, cur 1782759559, ex 3631/4801 00010000:00010000:2.0:1782759559.877032:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759560.040442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759560.040509:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197298816 00000100:00100000:1.0:1782759560.040518:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197298816 00000100:00100000:1.0:1782759560.040605:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2144 00000100:00100000:1.0:1782759560.040615:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103712:x1869355197298816:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:1.0:1782759560.040635:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759560.040657:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dff72 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66fe4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041067:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041082:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041311:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041329:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041337:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041345:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782759560.041837:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1782759560.041930:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00010000:00010000:1.0:1782759560.041946:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041953:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041961:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041967:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759560.041972:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041980:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.041993:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171889c5900) 00010000:00010000:1.0:1782759560.041996:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759560.042006:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042013:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777dff79 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042024:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042030:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042036:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042042:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759560.042044:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042050:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042056:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xe065f617 (ffff9171889c5400) 00010000:00010000:1.0:1782759560.042059:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759560.042061:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042067:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dff80 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.042099:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dff72 lrc: 1/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fe4 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.043357:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171889c5900) 00010000:00010000:1.0:1782759560.043360:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759560.043366:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777dff72 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66fe4 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759560.043381:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759560.044323:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103712:x1869355197298816:12345-192.168.204.31@tcp:101:touch.500 Request processed in 3706us (3885us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759560.044333:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2144 00000100:00100000:0.0:1782759560.063084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.067753:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197299072 00000100:00100000:3.0:1782759560.067766:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197299072 00000100:00100000:3.0:1782759560.067845:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2145 00000100:00100000:3.0:1782759560.067856:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103712:x1869355197299072:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:3.0:1782759560.067875:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759560.067896:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dff87 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66feb expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068303:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 3/1,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068316:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068329:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068350:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068357:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068364:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068889:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dff9c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068898:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dff9c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.068907:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dff9c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759560.068918:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x18:0x0]: returning size 0 00010000:00010000:3.0:1782759560.069033:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069041:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069048:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069054:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759560.069059:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069076:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069089:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759560.069092:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759560.069096:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069109:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777dff8e lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069120:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069127:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069133:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069138:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759560.069141:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069147:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069154:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xe065f617 (ffff9171908a1600) 00010000:00010000:3.0:1782759560.069156:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759560.069159:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.069169:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777dff95 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.071516:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dff87 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66feb expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.071638:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dff9c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66feb expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.071647:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759560.071650:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759560.071653:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:2.0:1782759560.081776:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103712:x1869355197299072:12345-192.168.204.31@tcp:101:touch.500 Request processed in 13911us (18689us total) trans 4294968110 rc 0/0 00000100:00100000:2.0:1782759560.081789:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2145 00000100:00100000:2.0:1782759560.092884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.092996:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197299328 00000100:00100000:3.0:1782759560.093005:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197299328 00000100:00100000:3.0:1782759560.093049:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2146 00000100:00100000:3.0:1782759560.093057:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103712:x1869355197299328:12345-192.168.204.31@tcp:36:touch.500 00010000:00010000:3.0:1782759560.093122:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759560.093147:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dff9c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66feb expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.093165:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759560.093175:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759560.093221:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,1 mode: --/PW res: [0x200000418:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.093235:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.093266:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759560.093419:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3b3c2f3 reply state 00000000011f07ab transno 4294968111 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759560.093429:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759560.093511:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103712:x1869355197299328:12345-192.168.204.31@tcp:36:touch.500 Request processed in 453us (635us total) trans 4294968111 rc 0/0 00000100:00100000:3.0:1782759560.093518:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2146 00010000:00010000:3.0:1782759560.097200:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.097229:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.097237:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.097244:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759560.097248:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.097263:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.097279:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x18:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759560.097282:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759560.097287:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 2/0,0 mode: --/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759560.097308:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffaa lrc: 0/0,0 mode: --/PW res: [0x200000418:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759560.100372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.100538:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197299456 00000100:00100000:3.0:1782759560.100548:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197299456 00000100:00100000:3.0:1782759560.100627:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1023 00000100:00100000:3.0:1782759560.100636:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197299456:12345-192.168.204.31@tcp:2:touch.500 00000100:00100000:3.0:1782759560.100933:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197299456:12345-192.168.204.31@tcp:2:touch.500 Request processed in 297us (568us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1782759560.100940:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1023 00000100:00080000:2.0:1782759560.102234:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759560.113258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759560.113572:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197299712 00000100:00100000:2.0:1782759560.113581:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197299712 00000100:00100000:2.0:1782759560.113631:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 278 00000100:00100000:2.0:1782759560.113640:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103712:x1869355197299712:12345-192.168.204.31@tcp:35:touch.500 00000100:00100000:2.0:1782759560.113882:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103712:x1869355197299712:12345-192.168.204.31@tcp:35:touch.500 Request processed in 242us (630us total) trans 4294968112 rc 0/0 00000100:00100000:2.0:1782759560.113890:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 278 00000100:00100000:3.0:1782759560.903593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.903634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.903668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.903699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759560.903734:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197299968 00000100:00100000:3.0:1782759560.903743:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197299968 00000100:00100000:0.0:1782759560.903945:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197300096 00000100:00100000:0.0:1782759560.903949:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197300096 00000100:00100000:0.0:1782759560.903991:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197300224 00000100:00100000:0.0:1782759560.903994:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197300224 00000100:00100000:0.0:1782759560.904013:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2054 00000100:00100000:0.0:1782759560.904021:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197300096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759560.904089:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197300096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759560.904096:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2054 00000100:00100000:0.0:1782759560.904112:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2055 00000100:00100000:0.0:1782759560.904118:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197300224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759560.904140:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197300224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759560.904146:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2055 00000100:00080000:0.0:1782759560.904159:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759560.904744:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2606 00000100:00100000:3.0:1782759560.904753:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197299968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759560.905368:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197299840 00000100:00100000:1.0:1782759560.905374:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197299840 00000100:00100000:1.0:1782759560.905408:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2850 00000100:00100000:1.0:1782759560.905415:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197299840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759560.905475:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197299840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759560.905482:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2850 00000100:00100000:3.0:1782759560.907005:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197299968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2248us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759560.907016:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2606 00010000:00010000:0.0:1782759560.940122:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759562.015479:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968112 is committed 00010000:00010000:0.0:1782759562.041575:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759562.051283:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967404 is committed 00000100:00100000:1.0:1782759562.162681:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759562.162712:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211978624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759562.162792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759562.162920:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978624 00000100:00100000:2.0:1782759562.162927:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978624 00000100:00100000:2.0:1782759562.162987:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1782759562.162997:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211978624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759562.163042:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759562.163091:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211978624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759562.163098:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00080000:1.0:1782759562.163324:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759562.163354:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211978624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759563.064204:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759564.090600:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759564.230351:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211979136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759564.230435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759564.230498:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782759564.230505:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211978752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759564.230533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759564.230553:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211979264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759564.230576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759564.230610:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979136 00000100:00100000:1.0:1782759564.230616:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979136 00000100:00100000:1.0:1782759564.230666:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1782759564.230674:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211979136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759564.230724:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211979136:12345-0@lo:400:kworker.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759564.230731:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00080000:1.0:1782759564.230753:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759564.230780:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211979136:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.230894:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211978880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.230922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759564.230951:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211979392:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.230974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759564.230992:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759564.230997:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211979008:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759564.231065:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978752 00000100:00100000:2.0:1782759564.231069:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978752 00000100:00100000:2.0:1782759564.231093:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:2.0:1782759564.231099:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211978752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231142:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211978752:12345-0@lo:400:kworker.0 Request processed in 42us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759564.231148:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:2.0:1782759564.231175:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979264 00000100:00100000:2.0:1782759564.231178:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979264 00000100:00100000:2.0:1782759564.231205:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211978880 00000100:00100000:2.0:1782759564.231207:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211978880 00000100:00100000:2.0:1782759564.231222:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979008 00000100:00100000:2.0:1782759564.231224:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979008 00000100:00100000:2.0:1782759564.231247:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1782759564.231254:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211979264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231283:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211979264:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759564.231290:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1782759564.231301:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1782759564.231307:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211978880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231336:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211978880:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759564.231342:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1782759564.231352:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1782759564.231357:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211979008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231383:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211979008:12345-0@lo:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759564.231397:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1782759564.231415:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979392 00000100:00100000:2.0:1782759564.231418:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979392 00000100:00100000:2.0:1782759564.231444:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1782759564.231451:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211979392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231480:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211979392:12345-0@lo:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759564.231486:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1782759564.231514:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211978752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231524:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211979264:0@lo:400:kworker.0 00000100:00080000:2.0:1782759564.231542:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759564.231545:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759564.231568:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211979008:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231578:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211978880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759564.231587:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211979392:0@lo:400:kworker.0 02000000:00000400:0.0:1782759564.609086:0:150653:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0000_int: flush entry ffff9170811c4c00: key 500, ref 0, fl 0, cur 1782759564, ex 3658/4828 00000100:00100000:0.0:1782759564.716397:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759564.716421:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211979520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759564.716504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759564.716696:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979520 00000100:00100000:2.0:1782759564.716703:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979520 00000100:00100000:2.0:1782759564.716758:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1782759564.716767:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211979520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759564.716800:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759564.716874:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211979520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759564.716881:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1782759564.716963:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211979520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759564.813128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759564.815391:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197300480 00000100:00100000:2.0:1782759564.815407:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197300480 00000100:00100000:2.0:1782759564.815504:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2147 00000100:00100000:2.0:1782759564.815515:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103749:x1869355197300480:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:2.0:1782759564.815534:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759564.815556:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dffb1 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ff2 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759564.816111:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759564.816368:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816382:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816395:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816409:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816416:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816423:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816654:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dffc6 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816663:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dffc6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.816683:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dffc6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759564.816701:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1a:0x0]: returning size 0 00010000:00010000:2.0:1782759564.817050:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817059:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817066:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817073:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759564.817077:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817083:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817095:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff9171c08f6400) 00010000:00010000:2.0:1782759564.817098:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759564.817104:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817111:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777dffb8 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817134:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817140:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817156:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817161:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759564.817165:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817172:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817181:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0xaeae4fd0 (ffff9171c08f6a00) 00010000:00010000:2.0:1782759564.817184:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759564.817187:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 2/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817193:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777dffbf lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817236:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777dffb1 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ff2 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817252:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dffc6 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ff2 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759564.817260:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759564.817262:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759564.817265:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90600, rc 0) 00000100:00100000:2.0:1782759564.817492:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103749:x1869355197300480:12345-192.168.204.31@tcp:101:touch.500 Request processed in 1979us (4382us total) trans 4294968113 rc 0/0 00000100:00100000:2.0:1782759564.817509:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2147 00000100:00100000:0.0:1782759564.831075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759564.831149:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197300736 00000100:00100000:1.0:1782759564.831158:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197300736 00000100:00100000:1.0:1782759564.831203:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2148 00000100:00100000:1.0:1782759564.831213:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103749:x1869355197300736:12345-192.168.204.31@tcp:36:touch.500 00010000:00010000:1.0:1782759564.831272:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759564.831299:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777dffc6 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ff2 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759564.831317:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:1.0:1782759564.831327:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759564.831365:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759564.831385:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759564.831395:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759564.831557:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1b320f2 reply state 00000000b82b6904 transno 4294968114 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759564.831568:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759564.831657:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103749:x1869355197300736:12345-192.168.204.31@tcp:36:touch.500 Request processed in 445us (590us total) trans 4294968114 rc 0/0 00000100:00100000:1.0:1782759564.831672:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2148 00010000:00010000:0.0:1782759564.833047:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759564.833059:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759564.833065:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759564.833071:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759564.833075:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759564.833082:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759564.833094:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1a:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:0.0:1782759564.833097:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759564.833101:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759564.833107:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777dffd4 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759564.834226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759564.834286:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197300864 00000100:00100000:3.0:1782759564.834294:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197300864 00000100:00100000:3.0:1782759564.834365:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1024 00000100:00100000:3.0:1782759564.834374:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197300864:12345-192.168.204.31@tcp:2:touch.500 00000100:00100000:3.0:1782759564.834764:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197300864:12345-192.168.204.31@tcp:2:touch.500 Request processed in 390us (541us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1782759564.834771:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1024 00000100:00080000:0.0:1782759564.835180:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759564.836878:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759564.837005:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301120 00000100:00100000:1.0:1782759564.837013:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301120 00000100:00100000:1.0:1782759564.837063:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 279 00000100:00100000:1.0:1782759564.837073:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103749:x1869355197301120:12345-192.168.204.31@tcp:35:touch.500 00000100:00100000:1.0:1782759564.837283:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:103749:x1869355197301120:12345-192.168.204.31@tcp:35:touch.500 Request processed in 211us (408us total) trans 4294968115 rc 0/0 00000100:00100000:1.0:1782759564.837290:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 279 00010000:00010000:0.0:1782759565.102293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759566.020766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759566.020860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759566.020891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759566.020916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759566.020948:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301504 00000100:00100000:2.0:1782759566.020960:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301504 00000100:00100000:2.0:1782759566.021029:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301632 00000100:00100000:2.0:1782759566.021044:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301632 00000100:00100000:2.0:1782759566.021074:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2058 00000100:00100000:2.0:1782759566.021087:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197301504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759566.021186:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197301504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759566.021194:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2058 00000100:00100000:2.0:1782759566.021212:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2059 00000100:00100000:2.0:1782759566.021219:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197301632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759566.021244:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197301632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759566.021251:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2059 00000100:00080000:2.0:1782759566.021268:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759566.021272:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759566.021690:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301248 00000100:00100000:1.0:1782759566.021695:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301248 00000100:00100000:1.0:1782759566.021743:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2852 00000100:00100000:1.0:1782759566.021752:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197301248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759566.021793:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197301248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.021819:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2852 00000100:00100000:3.0:1782759566.022190:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301376 00000100:00100000:3.0:1782759566.022196:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301376 00000100:00100000:3.0:1782759566.022249:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2610 00000100:00100000:3.0:1782759566.022256:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197301376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759566.022292:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197301376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.022299:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2610 00000100:00080000:1.0:1782759566.029014:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759566.128294:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782759566.977091:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968115 is committed 00010000:00010000:1.0:1782759567.157792:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759567.278084:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759567.278132:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211979648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759567.278228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759567.279511:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979648 00000100:00100000:2.0:1782759567.279523:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979648 00000100:00100000:2.0:1782759567.279616:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1782759567.279639:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211979648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759567.279705:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759567.279800:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211979648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759567.279808:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1782759567.279892:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211979648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759567.286249:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759568.181851:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 02000000:00000400:2.0:1782759568.576578:0:150701:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0000_int: flush entry ffff9171b33a8c00: key 500, ref 0, fl 0, cur 1782759568, ex 3663/4833 00010000:00010000:3.0:1782759569.211935:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759569.324923:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211979904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759569.324992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759569.325057:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211980416:0@lo:400:kworker.0 00000100:00100000:3.0:1782759569.325080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759569.325103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759569.325107:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211980032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759569.325126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759569.325151:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980416 00000100:00100000:3.0:1782759569.325158:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980416 00000100:00100000:3.0:1782759569.325204:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1782759569.325223:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211980416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759569.325269:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211980416:12345-0@lo:400:kworker.0 Request processed in 48us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759569.325275:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00080000:3.0:1782759569.325293:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759569.325317:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211980416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325468:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211979776:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759569.325525:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211980288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759569.325558:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759569.325563:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211980160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759569.325598:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979904 00000100:00100000:2.0:1782759569.325601:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979904 00000100:00100000:2.0:1782759569.325623:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980032 00000100:00100000:2.0:1782759569.325625:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980032 00000100:00100000:2.0:1782759569.325640:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980288 00000100:00100000:2.0:1782759569.325642:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980288 00000100:00100000:2.0:1782759569.325657:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:2.0:1782759569.325661:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211979904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325711:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211979904:12345-0@lo:400:kworker.0 Request processed in 41us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759569.325902:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:2.0:1782759569.325916:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1782759569.325921:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211980032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325952:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211980032:12345-0@lo:400:kworker.0 Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759569.325957:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:2.0:1782759569.325966:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:2.0:1782759569.325970:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211980288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.325991:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211980288:12345-0@lo:400:kworker.0 Request processed in 21us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759569.325996:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:2.0:1782759569.326008:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980160 00000100:00100000:2.0:1782759569.326011:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980160 00000100:00100000:2.0:1782759569.326045:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1782759569.326050:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211980160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.326074:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211980160:12345-0@lo:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759569.326079:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00080000:2.0:1782759569.326116:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759569.326119:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759569.326131:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211980160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.326139:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211980288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.326157:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211980032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759569.326164:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211979904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759569.326235:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211979776 00000100:00100000:3.0:1782759569.326238:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211979776 00000100:00100000:3.0:1782759569.326268:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:3.0:1782759569.326274:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211979776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759569.326302:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211979776:12345-0@lo:400:kworker.0 Request processed in 29us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759569.326307:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:2.0:1782759569.329934:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211979776:0@lo:400:kworker.0 00000001:00080000:0.0:1782759569.405722:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967418 is committed 00000100:00100000:0.0:1782759569.835977:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759569.835999:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211980544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759569.836087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759569.836163:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980544 00000100:00100000:0.0:1782759569.836170:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980544 00000100:00100000:0.0:1782759569.836218:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1782759569.836227:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211980544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759569.836266:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759569.842270:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211980544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759569.844284:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211980544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8051us (8190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759569.844297:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00010000:00010000:1.0:1782759570.223533:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759571.237051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759571.237921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759571.242187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759571.243887:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197302144 00000100:00100000:1.0:1782759571.243897:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197302144 00000100:00100000:0.0:1782759571.249056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759571.249089:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197302016 00000100:00100000:0.0:1782759571.249097:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197302016 00000100:00100000:1.0:1782759571.250838:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2062 00000100:00100000:1.0:1782759571.250854:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197302144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759571.250931:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197302144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (13012us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.259464:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2062 00000100:00100000:2.0:1782759571.270867:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301888 00000100:00100000:2.0:1782759571.270882:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301888 00010000:00010000:2.0:1782759571.272459:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759571.273472:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2063 00000100:00100000:0.0:1782759571.273484:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197302016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759571.273561:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197302016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (24512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759571.273568:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2063 00000100:00100000:0.0:1782759571.273670:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197301760 00000100:00100000:0.0:1782759571.273676:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197301760 00000100:00100000:0.0:1782759571.273704:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2854 00000100:00100000:0.0:1782759571.273709:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197301760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759571.273736:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197301760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (31560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759571.273741:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2854 00000100:00080000:1.0:1782759571.274464:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759571.274470:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759571.274473:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759571.365999:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2614 00000100:00100000:3.0:1782759571.366022:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197301888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759571.366115:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197301888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (129073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759571.366122:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2614 00000100:00100000:0.0:1782759571.916216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759571.916260:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197302400 00000100:00100000:0.0:1782759571.916269:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197302400 00000100:00100000:0.0:1782759571.916340:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2149 00000100:00100000:0.0:1782759571.916351:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103823:x1869355197302400:12345-192.168.204.31@tcp:101:cat.500 00010000:00010000:0.0:1782759571.916372:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759571.916395:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777dffdb lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf66ff9 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918631:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918650:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918665:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759571.918677:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00010000:00010000:0.0:1782759571.918707:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918715:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918751:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918758:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759571.918762:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918771:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918784:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759571.918788:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759571.918792:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918799:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777dffe2 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918871:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777dffdb lrc: 1/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ff9 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918883:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759571.918885:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759571.918890:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99600/0xdd99f5c4777dffdb lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66ff9 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.918905:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759571.918971:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103823:x1869355197302400:12345-192.168.204.31@tcp:101:cat.500 Request processed in 2621us (2765us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759571.921912:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2149 00000100:00100000:0.0:1782759571.935542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759571.935892:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197302656 00000100:00100000:3.0:1782759571.935902:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197302656 00000100:00100000:3.0:1782759571.936860:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2150 00000100:00100000:3.0:1782759571.936873:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:103823:x1869355197302656:12345-192.168.204.31@tcp:101:cat.500 00010000:00010000:3.0:1782759571.936894:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759571.936916:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffe9 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67000 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.937219:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfff0 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.937234:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfff0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.937245:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfff0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759571.937257:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x16:0x0]: returning size 3 00010000:00010000:3.0:1782759571.937596:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777dffe9 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67000 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.937617:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfff0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67000 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.937626:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759571.937629:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759571.937634:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759571.938198:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103823:x1869355197302656:12345-192.168.204.31@tcp:101:cat.500 Request processed in 1327us (2662us total) trans 4294968116 rc 0/0 00000100:00100000:3.0:1782759571.938224:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2150 00000100:00100000:1.0:1782759571.966282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759571.966380:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197302784 00000100:00100000:0.0:1782759571.966390:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197302784 00000100:00100000:0.0:1782759571.966449:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 183 00000100:00100000:0.0:1782759571.966460:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197302784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759571.966479:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759571.966504:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777dfff0 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67000 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.966523:0:134476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x16:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:0.0:1782759571.966534:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759571.966639:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197302784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759571.966649:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 183 00000100:00100000:2.0:1782759571.983532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759571.985206:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303040 00000100:00100000:1.0:1782759571.985219:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303040 00000100:00100000:1.0:1782759571.985586:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 280 00000100:00100000:1.0:1782759571.985599:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:103823:x1869355197303040:12345-192.168.204.31@tcp:35:cat.500 00000100:00100000:1.0:1782759571.986002:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:103823:x1869355197303040:12345-192.168.204.31@tcp:35:cat.500 Request processed in 405us (2478us total) trans 4294968117 rc 0/0 00000100:00100000:1.0:1782759571.986011:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 280 00010000:00010000:2.0:1782759572.341776:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759572.408869:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759572.408905:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211980672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759572.408989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759572.409323:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980672 00000100:00100000:3.0:1782759572.409330:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980672 00000100:00100000:3.0:1782759572.409404:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1782759572.409416:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211980672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759572.409453:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759572.409515:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211980672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759572.409523:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1782759572.409571:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211980672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759572.412978:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759573.358412:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759574.382737:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759574.444279:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211981056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759574.444375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759574.444448:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782759574.444454:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211980928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.444525:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211980800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.444568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759574.444597:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211981312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.444622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759574.444641:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759574.444646:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211981184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.444673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759574.444707:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981056 00000100:00100000:3.0:1782759574.444716:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981056 00000100:00100000:3.0:1782759574.444771:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981312 00000100:00100000:3.0:1782759574.444774:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981312 00000100:00100000:3.0:1782759574.444797:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1782759574.444805:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211981056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.444885:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211981056:12345-0@lo:400:kworker.0 Request processed in 79us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759574.444894:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1782759574.444911:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:3.0:1782759574.444918:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211981312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.444962:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211981312:12345-0@lo:400:kworker.0 Request processed in 44us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759574.444968:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:3.0:1782759574.445010:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211981312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.445069:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981184 00000100:00100000:3.0:1782759574.445072:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981184 00000100:00100000:3.0:1782759574.445099:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:3.0:1782759574.445105:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211981184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.445138:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211981184:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759574.445145:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:3.0:1782759574.445160:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980800 00000100:00100000:3.0:1782759574.445163:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980800 00000100:00100000:3.0:1782759574.445182:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1782759574.445188:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211980800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.445213:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211980800:12345-0@lo:400:kworker.0 Request processed in 25us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759574.445219:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1782759574.445248:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211981184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759574.445255:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211980800:0@lo:400:kworker.0 00000100:00080000:0.0:1782759574.445416:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759574.445423:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759574.445503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759574.445630:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211981440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759574.445661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759574.445697:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211981056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759574.445922:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981440 00000100:00100000:1.0:1782759574.447414:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981440 00000100:00100000:1.0:1782759574.447662:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:1.0:1782759574.447673:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211981440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759574.447759:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211981440:12345-0@lo:400:kworker.0 Request processed in 88us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759574.447767:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00080000:2.0:1782759574.449195:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759574.450449:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211980928 00000100:00100000:0.0:1782759574.450460:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211980928 00000100:00100000:0.0:1782759574.451670:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1782759574.451686:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211980928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759574.451791:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211980928:12345-0@lo:400:kworker.0 Request processed in 112us (6298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759574.451816:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1782759574.451909:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211980928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759574.451924:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211981440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759574.958188:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759574.958213:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211981568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759574.958302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759574.958454:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981568 00000100:00100000:3.0:1782759574.958462:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981568 00000100:00100000:3.0:1782759574.958512:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1782759574.958522:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211981568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759574.958557:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759574.958624:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211981568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759574.958632:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1782759574.960865:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211981568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759575.404040:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759576.432717:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782759577.152398:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968117 is committed 00000100:00100000:1.0:1782759577.309780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759577.309865:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759577.309910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759577.309954:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759577.309987:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303424 00000100:00100000:1.0:1782759577.309997:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303424 00000100:00100000:1.0:1782759577.310051:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303552 00000100:00100000:1.0:1782759577.310054:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303552 00000100:00100000:1.0:1782759577.310080:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2066 00000100:00100000:1.0:1782759577.310091:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197303424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759577.310163:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197303424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759577.310171:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2066 00000100:00100000:1.0:1782759577.310204:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2067 00000100:00100000:1.0:1782759577.310226:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197303552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759577.310255:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197303552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759577.310262:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2067 00000100:00080000:1.0:1782759577.310280:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759577.310284:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759577.310446:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303296 00000100:00100000:2.0:1782759577.310451:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303296 00000100:00100000:2.0:1782759577.310494:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2618 00000100:00100000:2.0:1782759577.310502:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197303296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759577.310541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197303296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759577.310564:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2618 00000100:00100000:0.0:1782759577.311157:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303168 00000100:00100000:0.0:1782759577.311162:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303168 00000100:00100000:0.0:1782759577.311203:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2856 00000100:00100000:0.0:1782759577.311211:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197303168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759577.311247:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197303168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759577.311253:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2856 00000100:00080000:1.0:1782759577.311593:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759577.453996:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759577.519046:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211981696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759577.519118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759577.519388:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981696 00000100:00100000:2.0:1782759577.519397:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981696 00000100:00100000:2.0:1782759577.519480:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1782759577.519489:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211981696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759577.519524:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759577.519585:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211981696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759577.519592:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00080000:1.0:1782759577.523078:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759577.523146:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211981696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759578.476044:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759579.500062:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759579.584124:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211982080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759579.584263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759579.584430:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211981952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759579.584477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759579.584557:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211982208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759579.584591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759579.584630:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982080 00000100:00100000:2.0:1782759579.584637:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982080 00000100:00100000:2.0:1782759579.584689:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981952 00000100:00100000:2.0:1782759579.584692:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981952 00000100:00100000:2.0:1782759579.584713:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1782759579.584722:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211982080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759579.584770:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211982080:12345-0@lo:400:kworker.0 Request processed in 49us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759579.584778:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1782759579.584794:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1782759579.584801:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211981952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759579.584873:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211981952:12345-0@lo:400:kworker.0 Request processed in 72us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759579.584892:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1782759579.584928:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982208 00000100:00100000:2.0:1782759579.584932:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982208 00000100:00100000:2.0:1782759579.584960:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:2.0:1782759579.584966:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211982208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759579.585001:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211982208:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759579.585008:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00080000:2.0:1782759579.585291:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759579.585296:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759579.589108:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211982080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.592279:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211981824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.592365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759579.605473:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211981952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759579.605492:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211982464:0@lo:400:kworker.0 00000100:00100000:3.0:1782759579.605557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759579.605636:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982464 00000100:00100000:3.0:1782759579.605643:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982464 00000100:00100000:3.0:1782759579.605697:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1782759579.605709:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211982464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759579.605762:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211982464:12345-0@lo:400:kworker.0 Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759579.605769:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00080000:3.0:1782759579.605787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759579.605808:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211982464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.607271:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211982336:0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.607334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759579.607376:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982336 00000100:00100000:0.0:1782759579.607381:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982336 00000100:00100000:0.0:1782759579.607423:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1782759579.607430:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211982336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.607470:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211982336:12345-0@lo:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759579.607477:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00080000:0.0:1782759579.607497:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759579.607519:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211982336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759579.607773:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211981824 00000100:00100000:2.0:1782759579.607777:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211981824 00000100:00100000:3.0:1782759579.608208:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211982208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.614279:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1782759579.615907:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211981824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.616020:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211981824:12345-0@lo:400:kworker.0 Request processed in 119us (23654us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759579.616092:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211981824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759579.627250:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:3.0:1782759580.076190:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211982592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759580.076261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759580.080186:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982592 00000100:00100000:1.0:1782759580.080200:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982592 00000100:00100000:1.0:1782759580.080266:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1782759580.080277:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211982592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759580.080326:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759580.085672:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211982592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5388us (9402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759580.085686:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1782759580.090730:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211982592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759580.524575:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759581.574594:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759581.890741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759581.890850:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303680 00000100:00100000:3.0:1782759581.890860:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303680 00000100:00100000:3.0:1782759581.890920:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2858 00000100:00100000:3.0:1782759581.890931:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197303680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759581.891002:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197303680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759581.891018:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2858 00000100:00100000:1.0:1782759581.891768:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759581.891811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759581.891861:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759581.891934:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303808 00000100:00100000:2.0:1782759581.891939:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303808 00000100:00100000:2.0:1782759581.891993:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2622 00000100:00100000:2.0:1782759581.892003:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197303808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759581.892047:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197303808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759581.892054:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2622 00000100:00100000:2.0:1782759581.892072:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304064 00000100:00100000:2.0:1782759581.892075:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304064 00000100:00100000:2.0:1782759581.892097:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197303936 00000100:00100000:2.0:1782759581.892111:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197303936 00000100:00100000:2.0:1782759581.892135:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2070 00000100:00100000:2.0:1782759581.892141:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197304064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759581.892169:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197304064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759581.892175:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2070 00000100:00100000:2.0:1782759581.892186:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2071 00000100:00100000:2.0:1782759581.892192:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197303936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759581.892215:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197303936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759581.892232:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2071 00000100:00080000:1.0:1782759581.892624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759581.892629:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759581.892631:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759582.636556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759582.636579:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211982720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759582.636652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759582.637046:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759582.637344:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982720 00000100:00100000:3.0:1782759582.637353:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982720 00000100:00100000:3.0:1782759582.637432:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1782759582.637444:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211982720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759582.637478:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759582.637535:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211982720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759582.637542:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:2.0:1782759582.637672:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211982720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759582.637731:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759583.663168:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759584.686022:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211982976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759584.686095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759584.686155:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211983488:0@lo:400:kworker.0 00000100:00100000:2.0:1782759584.686184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759584.686208:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759584.686214:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211983104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759584.686235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759584.686264:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982976 00000100:00100000:2.0:1782759584.686271:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982976 00000100:00100000:2.0:1782759584.686313:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983104 00000100:00100000:2.0:1782759584.686316:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983104 00000100:00100000:2.0:1782759584.686348:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:2.0:1782759584.686356:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211982976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759584.686406:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211982976:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759584.686413:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:2.0:1782759584.686447:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1782759584.686453:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211983104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759584.686481:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211983104:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759584.686487:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1782759584.686505:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983488 00000100:00100000:2.0:1782759584.686519:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983488 00000100:00100000:2.0:1782759584.686551:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:2.0:1782759584.686557:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211983488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759584.686587:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211983488:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759584.686594:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00080000:2.0:1782759584.686616:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759584.686620:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759584.686927:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211983232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.686960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759584.686985:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759584.686991:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211982848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759584.687038:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211983360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759584.687088:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759584.687110:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983232 00000100:00100000:3.0:1782759584.687114:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983232 00000100:00100000:3.0:1782759584.687150:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1782759584.687157:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211983232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687193:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211983232:12345-0@lo:400:kworker.0 Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759584.687200:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1782759584.687219:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211982848 00000100:00100000:3.0:1782759584.687229:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211982848 00000100:00100000:3.0:1782759584.687257:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:3.0:1782759584.687264:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211982848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687294:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211982848:12345-0@lo:400:kworker.0 Request processed in 31us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759584.687301:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:3.0:1782759584.687327:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983360 00000100:00100000:3.0:1782759584.687330:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983360 00000100:00100000:3.0:1782759584.687356:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:3.0:1782759584.687363:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211983360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687393:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211983360:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759584.687399:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00080000:3.0:1782759584.687424:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759584.687427:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759584.687452:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211982848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687463:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211983360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.687472:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211983232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.690996:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211983104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.691016:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211982976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759584.691028:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211983488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759585.203373:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211983616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759585.203459:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759585.203533:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983616 00000100:00100000:3.0:1782759585.203554:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983616 00000100:00100000:3.0:1782759585.203608:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1782759585.203617:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211983616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759585.203665:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759585.203731:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211983616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759585.203739:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1782759585.203804:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211983616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759585.708102:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759586.732897:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759587.001631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759587.001693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759587.001724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759587.001771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759587.001801:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304448 00000100:00100000:2.0:1782759587.001812:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304448 00000100:00100000:2.0:1782759587.001892:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304576 00000100:00100000:2.0:1782759587.001896:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304576 00000100:00100000:2.0:1782759587.001917:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2074 00000100:00100000:2.0:1782759587.001925:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197304448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759587.002006:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197304448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759587.002014:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2074 00000100:00100000:2.0:1782759587.002029:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2075 00000100:00100000:2.0:1782759587.002036:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197304576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759587.002059:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197304576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759587.002066:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2075 00000100:00080000:3.0:1782759587.003369:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759587.003376:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759587.005558:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304320 00000100:00100000:0.0:1782759587.005572:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304320 00000100:00100000:0.0:1782759587.005653:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2626 00000100:00100000:0.0:1782759587.005665:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197304320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759587.005775:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197304320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 111us (4049us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759587.005784:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2626 00000100:00080000:2.0:1782759587.005803:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759587.005879:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304192 00000100:00100000:1.0:1782759587.005886:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304192 00000100:00100000:1.0:1782759587.005915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2860 00000100:00100000:1.0:1782759587.005923:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197304192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759587.005956:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197304192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (4335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759587.005962:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2860 00000100:00100000:1.0:1782759587.761545:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211983744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759587.761648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759587.761781:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983744 00000100:00100000:1.0:1782759587.761792:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983744 00000100:00100000:1.0:1782759587.761914:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1782759587.761930:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211983744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759587.761990:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759587.762056:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211983744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759587.762066:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00080000:1.0:1782759587.762101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759587.762161:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211983744:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759587.762562:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759588.785125:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759589.809042:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211984256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.809116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759589.809171:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211983872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759589.809206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759589.809256:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211984384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759589.809283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759589.809368:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211983872 00000100:00100000:0.0:1782759589.809376:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211983872 00000100:00100000:0.0:1782759589.809418:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759589.809425:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211983872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759589.809472:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211983872:12345-0@lo:400:kworker.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759589.809479:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759589.809537:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211983872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.812774:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211984000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.812857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759589.821132:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211984512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.821219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759589.821248:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759589.821256:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211984128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.821283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759589.832298:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759589.836115:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984384 00000100:00100000:1.0:1782759589.836134:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984384 00000100:00100000:1.0:1782759589.836200:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984000 00000100:00100000:1.0:1782759589.836203:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984000 00000100:00100000:3.0:1782759589.837130:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984128 00000100:00100000:3.0:1782759589.837136:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984128 00000100:00100000:3.0:1782759589.837178:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1782759589.837188:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211984384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759589.837495:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:1.0:1782759589.837503:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211984128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.839707:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211984384:12345-0@lo:400:kworker.0 Request processed in 2511us (30413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759589.839730:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1782759589.839770:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:3.0:1782759589.839780:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211984000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.839843:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211984000:12345-0@lo:400:kworker.0 Request processed in 66us (26986us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759589.839851:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:3.0:1782759589.839885:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984256 00000100:00100000:3.0:1782759589.839892:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984256 00000100:00100000:3.0:1782759589.839941:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984512 00000100:00100000:3.0:1782759589.839945:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984512 00000100:00100000:3.0:1782759589.839970:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1782759589.839976:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211984256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.840023:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211984256:12345-0@lo:400:kworker.0 Request processed in 39us (30902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759589.840029:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1782759589.840041:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1782759589.840047:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211984512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.840076:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211984512:12345-0@lo:400:kworker.0 Request processed in 29us (18858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759589.840082:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1782759589.840164:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211984256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.840465:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211984000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759589.840476:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211984512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759589.844306:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211984384:0@lo:400:kworker.0 00000100:00080000:0.0:1782759589.847089:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759589.847100:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759589.847104:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759589.856141:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211984128:12345-0@lo:400:kworker.0 Request processed in 18628us (34845us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759589.856160:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1782759589.856652:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211984128:0@lo:400:kworker.0 00000020:00000080:0.0:1782759590.098502:0:150950:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2d2082b0 20000000:00000080:0.0:1782759590.098520:0:150950:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081256c00 uarg=0000000000000000 00010000:00010000:0.0:1782759590.098984:0:150950:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759590.098999:0:150950:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759590.099027:0:150950:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759590.099045:0:150950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759590.099062:0:150950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759590.099070:0:150950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759590.105581:0:150950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759590.105603:0:150950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 18 pid: 5796 timeout: 3758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759590.105620:0:150950:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150950:1869355211984640:0@lo:104: 00000100:00100000:0.0:1782759590.105699:0:150950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759590.105773:0:150950:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759590.106746:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984640 00000100:00100000:2.0:1782759590.106756:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984640 00000100:00100000:2.0:1782759590.106847:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1782759590.106857:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150950:x1869355211984640:12345-0@lo:104: 00010000:00010000:2.0:1782759590.106874:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.106965:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759590.106971:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:150950:x1869355211984640:12345-0@lo:104: Request processed in 117us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759590.106978:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00010000:00010000:3.0:1782759590.111251:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759590.111265:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759590.111276:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759590.111280:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759590.111291:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759590.111299:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759590.111304:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759590.111370:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759590.111377:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759590.111399:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759590.111406:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777dff64 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777dff6b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759590.111426:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759590.111428:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759590.111430:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759590.111447:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211984768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759590.111514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759590.111965:0:150950:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150950:1869355211984640:0@lo:104: 00010000:00010000:1.0:1782759590.111987:0:150950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759590.112330:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984768 00000100:00100000:2.0:1782759590.112337:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984768 00010000:00010000:2.0:1782759590.112375:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 19 pid: 5796 timeout: 3758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759590.112405:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1782759590.112415:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211984768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759590.112430:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759590.112435:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 19 pid: 5796 timeout: 3758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112445:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 19 pid: 5796 timeout: 3758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112462:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90a00/0xdd99f5c4777dff6b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777dff64 expref: 19 pid: 5796 timeout: 3758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112485:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112492:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112506:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112513:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112520:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112526:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112531:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759590.112535:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112542:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112566:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759590.112575:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759590.112634:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211984768:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759590.112648:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1782759590.112689:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211984768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759590.112737:0:150950:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759590.112746:0:150950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759590.112752:0:150950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98e00/0xdd99f5c4777dfffe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759590.317097:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759590.317121:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211984896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759590.317192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759590.317532:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211984896 00000100:00100000:0.0:1782759590.317540:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211984896 00000100:00100000:0.0:1782759590.317597:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:0.0:1782759590.317629:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211984896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759590.317668:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759590.317729:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211984896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759590.317736:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1782759590.317819:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211984896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759590.831205:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759591.853338:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759591.915922:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759591.915931:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759591.915936:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759591.915995:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759591.916007:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759591.916019:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759591.916046:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211985024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759591.916119:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759591.916331:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985024 00000100:00100000:1.0:1782759591.916339:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985024 00000100:00100000:1.0:1782759591.916393:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:1.0:1782759591.916403:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211985024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759591.916419:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759591.916433:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0005 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759591.916477:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759591.916487:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759591.916496:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782759591.916531:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211985024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759591.916537:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1782759591.916694:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759591.916716:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211985024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759591.916731:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759591.916741:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759591.916761:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759591.916766:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759591.916779:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759592.119309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759592.119354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759592.119377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759592.119403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759592.119428:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304960 00000100:00100000:3.0:1782759592.119437:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304960 00000100:00100000:3.0:1782759592.119490:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305088 00000100:00100000:3.0:1782759592.119493:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305088 00000100:00100000:3.0:1782759592.119519:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2078 00000100:00100000:3.0:1782759592.119529:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197304960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759592.119619:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197304960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759592.119627:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2078 00000100:00100000:3.0:1782759592.119643:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2079 00000100:00100000:3.0:1782759592.119649:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b47c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197305088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759592.119675:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b47c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197305088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759592.119682:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2079 00000100:00100000:0.0:1782759592.119999:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304704 00000100:00100000:0.0:1782759592.120004:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304704 00000100:00100000:0.0:1782759592.120035:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2863 00000100:00100000:0.0:1782759592.120042:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197304704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759592.120070:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197304704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759592.120077:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2863 00000100:00080000:0.0:1782759592.120101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759592.120106:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759592.123171:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197304832 00000100:00100000:3.0:1782759592.123186:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197304832 00000100:00100000:3.0:1782759592.123262:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2630 00000100:00100000:3.0:1782759592.123287:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197304832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759592.123367:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197304832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 96us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759592.123382:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2630 00000100:00080000:0.0:1782759592.124894:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759592.876109:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759592.876133:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211985152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759592.876205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759592.876275:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985152 00000100:00100000:1.0:1782759592.876283:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985152 00000100:00100000:1.0:1782759592.876343:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1782759592.876351:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211985152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759592.876388:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759592.876434:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211985152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759592.876441:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00080000:1.0:1782759592.876468:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759592.876502:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211985152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759592.882632:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759593.908810:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759594.927379:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211985280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.927464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759594.927543:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211985792:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.927572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759594.927602:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759594.927608:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211985408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.927629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759594.927647:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211985920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.927672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759594.927699:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211985664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.927723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759594.927741:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759594.927746:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211985536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.927768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759594.927798:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985792 00000100:00100000:3.0:1782759594.927807:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985792 00000100:00100000:3.0:1782759594.927894:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985408 00000100:00100000:3.0:1782759594.927897:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985408 00000100:00100000:3.0:1782759594.927915:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985536 00000100:00100000:3.0:1782759594.927918:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985536 00000100:00100000:3.0:1782759594.927939:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1782759594.927948:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211985792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928002:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211985792:12345-0@lo:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759594.928009:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1782759594.928038:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1782759594.928044:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211985408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928074:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211985408:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759594.928080:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1782759594.928091:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:3.0:1782759594.928096:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211985536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928129:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211985536:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759594.928134:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:3.0:1782759594.928155:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985920 00000100:00100000:3.0:1782759594.928159:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985920 00000100:00100000:3.0:1782759594.928183:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985664 00000100:00100000:3.0:1782759594.928185:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985664 00000100:00100000:3.0:1782759594.928201:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1782759594.928206:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211985920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928234:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211985920:12345-0@lo:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759594.928239:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1782759594.928249:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:3.0:1782759594.928254:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211985664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928293:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211985664:12345-0@lo:400:kworker.0 Request processed in 39us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759594.928298:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00080000:3.0:1782759594.928320:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759594.928323:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759594.928325:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759594.928378:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211985536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928388:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211985664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928417:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211985408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928426:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211985920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759594.928434:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211985792:0@lo:400:kworker.0 00010000:00010000:2.0:1782759594.928778:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759594.928875:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211985280 00000100:00100000:0.0:1782759594.928881:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211985280 00000100:00100000:0.0:1782759594.928911:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1782759594.928919:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211985280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759594.928963:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211985280:12345-0@lo:400:kworker.0 Request processed in 45us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759594.928969:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:3.0:1782759594.931508:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211985280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759595.437243:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759595.437267:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211986048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759595.437341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759595.437442:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986048 00000100:00100000:0.0:1782759595.437451:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986048 00000100:00100000:0.0:1782759595.437510:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1782759595.437528:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211986048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759595.437562:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759595.437607:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211986048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759595.437622:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1782759595.437705:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211986048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759595.948016:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759596.973073:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759597.250658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759597.250709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759597.250751:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759597.250801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759597.251023:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305600 00000100:00100000:0.0:1782759597.251034:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305600 00000100:00100000:3.0:1782759597.251135:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305472 00000100:00100000:3.0:1782759597.251139:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305472 00000100:00100000:1.0:1782759597.251206:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305216 00000100:00100000:1.0:1782759597.251210:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305216 00000100:00100000:1.0:1782759597.251262:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2865 00000100:00100000:1.0:1782759597.251272:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197305216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759597.251342:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197305216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759597.251349:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2865 00000100:00100000:0.0:1782759597.260465:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2082 00000100:00100000:0.0:1782759597.260501:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197305600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759597.260578:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197305600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (9868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759597.260585:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2082 00000100:00080000:1.0:1782759597.261141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759597.261148:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759597.264032:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2083 00000100:00100000:3.0:1782759597.264051:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197305472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759597.264140:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197305472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (13337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759597.264147:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2083 00000100:00100000:2.0:1782759597.266651:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305344 00000100:00100000:2.0:1782759597.266663:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305344 00000100:00100000:2.0:1782759597.272411:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2634 00000100:00100000:2.0:1782759597.272426:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197305344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759597.272519:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197305344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 96us (21870us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759597.272526:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2634 00000100:00080000:1.0:1782759597.272586:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759597.996545:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759598.010914:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759598.010936:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211986176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759598.011005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759598.011137:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986176 00000100:00100000:1.0:1782759598.011146:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986176 00000100:00100000:1.0:1782759598.011198:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1782759598.011207:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211986176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759598.011242:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759598.011302:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211986176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759598.011323:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1782759598.011376:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211986176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759598.017576:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782759598.438787:0:151196:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2f86ae90 20000000:00000080:2.0:1782759598.438805:0:151196:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170833e4000 uarg=0000000000000000 00010000:00010000:2.0:1782759598.439317:0:151196:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759598.439332:0:151196:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759598.439348:0:151196:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759598.439367:0:151196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759598.439395:0:151196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759598.439405:0:151196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759598.439443:0:151196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759598.439457:0:151196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 18 pid: 5794 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759598.439486:0:151196:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151196:1869355211986304:0@lo:104: 00000100:00100000:2.0:1782759598.439550:0:151196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759598.439602:0:151196:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759598.442542:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986304 00000100:00100000:0.0:1782759598.442554:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986304 00000100:00100000:0.0:1782759598.442614:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1782759598.442623:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151196:x1869355211986304:12345-0@lo:104: 00010000:00010000:0.0:1782759598.442640:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759598.442741:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759598.442747:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151196:x1869355211986304:12345-0@lo:104: Request processed in 125us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759598.442754:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1782759598.442882:0:151196:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151196:1869355211986304:0@lo:104: 00010000:00010000:3.0:1782759598.442920:0:151196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.442990:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759598.442997:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443018:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759598.443021:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443030:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759598.443048:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759598.443052:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759598.443092:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443097:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759598.443126:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443142:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0005 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e000c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443160:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759598.443162:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759598.443163:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759598.443170:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759598.443183:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211986432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759598.443219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759598.443268:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986432 00000100:00100000:1.0:1782759598.443273:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986432 00010000:00010000:1.0:1782759598.443292:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 19 pid: 5794 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759598.443329:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1782759598.443335:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211986432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759598.443346:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759598.443356:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 19 pid: 5794 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443367:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 19 pid: 5794 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443380:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e000c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0005 expref: 19 pid: 5794 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443393:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443400:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443414:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443422:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443429:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443434:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443439:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759598.443443:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443449:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443478:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759598.443487:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759598.443514:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211986432:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759598.443521:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1782759598.443552:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211986432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759598.445325:0:151196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759598.445340:0:151196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759598.445347:0:151196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e0013 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759599.020290:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759600.050518:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211986560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759600.050630:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211987072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759600.050675:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759600.050680:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211986944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759600.050723:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211986688:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759600.050770:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211987200:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759600.050803:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759600.050807:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211986816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759600.050883:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986560 00000100:00100000:3.0:1782759600.050890:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986560 00000100:00100000:3.0:1782759600.050930:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1782759600.050938:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211986560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.050984:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211986560:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759600.050990:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1782759600.051021:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987072 00000100:00100000:3.0:1782759600.051024:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987072 00000100:00100000:3.0:1782759600.051056:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986688 00000100:00100000:3.0:1782759600.051059:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986688 00000100:00100000:3.0:1782759600.051074:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986816 00000100:00100000:3.0:1782759600.051076:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986816 00000100:00100000:3.0:1782759600.051093:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1782759600.051099:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211987072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051132:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211987072:12345-0@lo:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759600.051139:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1782759600.051150:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:3.0:1782759600.051155:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051185:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211986688:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759600.051191:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:3.0:1782759600.051201:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:3.0:1782759600.051206:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051232:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211986816:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759600.051246:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:3.0:1782759600.051264:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211986944 00000100:00100000:3.0:1782759600.051268:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211986944 00000100:00100000:3.0:1782759600.051290:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987200 00000100:00100000:3.0:1782759600.051293:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987200 00000100:00100000:3.0:1782759600.051314:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1782759600.051319:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211986944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051350:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211986944:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759600.051355:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1782759600.051366:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:3.0:1782759600.051371:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211987200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051395:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211987200:12345-0@lo:400:kworker.0 Request processed in 25us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759600.051400:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:3.0:1782759600.051457:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211986944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051467:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211986560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051475:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211987072:0@lo:400:kworker.0 00000100:00080000:3.0:1782759600.051508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759600.051512:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759600.051515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759600.051539:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211986816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051549:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211986688:0@lo:400:kworker.0 00000100:00100000:3.0:1782759600.051556:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211987200:0@lo:400:kworker.0 00010000:00010000:3.0:1782759600.072293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759600.225066:0:151245:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc8a99070 20000000:00000080:1.0:1782759600.225084:0:151245:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b357f400 uarg=0000000000000000 00010000:00010000:1.0:1782759600.225490:0:151245:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759600.225508:0:151245:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759600.225526:0:151245:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759600.225547:0:151245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225564:0:151245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225575:0:151245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225581:0:151245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225588:0:151245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225594:0:151245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225608:0:151245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759600.225613:0:151245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225622:0:151245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225636:0:151245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225643:0:151245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759600.225649:0:151245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e001a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759600.428640:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759600.428648:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759600.428653:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759600.428701:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759600.428714:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759600.428725:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759600.428760:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211987328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759600.428904:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759600.428965:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171813773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759600.433869:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987328 00000100:00100000:0.0:1782759600.433883:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987328 00000100:00100000:0.0:1782759600.433947:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1782759600.433956:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211987328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759600.433973:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759600.433992:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0021 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759600.434036:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759600.434047:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759600.434056:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99000, rc 0) 00000100:00100000:0.0:1782759600.434137:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211987328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (5233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759600.434144:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1782759600.434204:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211987328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759600.434222:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759600.434232:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759600.434252:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759600.434257:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759600.434264:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759600.558872:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211987456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759600.558946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759600.559023:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987456 00000100:00100000:0.0:1782759600.559031:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987456 00000100:00100000:0.0:1782759600.559076:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1782759600.559085:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211987456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759600.559121:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759600.559167:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211987456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759600.559174:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1782759600.559219:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211987456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759601.133268:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759601.951667:0:151293:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1a582c80 20000000:00000080:1.0:1782759601.951686:0:151293:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082be3000 uarg=0000000000000000 00010000:00010000:1.0:1782759601.951935:0:151293:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759601.951949:0:151293:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759601.951964:0:151293:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759601.951980:0:151293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759601.951998:0:151293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759601.952007:0:151293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759601.952048:0:151293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759601.952062:0:151293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 18 pid: 5793 timeout: 3770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759601.952077:0:151293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151293:1869355211987584:0@lo:104: 00000100:00100000:1.0:1782759601.952136:0:151293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759601.952184:0:151293:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759601.952274:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759601.952286:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987584 00000100:00100000:2.0:1782759601.952292:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987584 00000100:00100000:2.0:1782759601.952337:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1782759601.952346:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170826b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151293:x1869355211987584:12345-0@lo:104: 00010000:00010000:2.0:1782759601.952358:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759601.952421:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759601.952427:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170826b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151293:x1869355211987584:12345-0@lo:104: Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759601.952434:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00010000:00010000:3.0:1782759601.957022:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759601.957036:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957049:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759601.957054:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957066:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759601.957074:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759601.957080:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759601.957144:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957150:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759601.957172:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957179:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e0021 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0028 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957200:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759601.957202:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759601.957204:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759601.957220:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211987712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759601.957298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759601.957358:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987712 00000100:00100000:3.0:1782759601.957365:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987712 00010000:00010000:3.0:1782759601.957409:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 19 pid: 5793 timeout: 3770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759601.957437:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1782759601.957445:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211987712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759601.957459:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759601.957465:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 19 pid: 5793 timeout: 3770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957477:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 19 pid: 5793 timeout: 3770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957496:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957505:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957519:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957527:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957534:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957541:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957553:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759601.957557:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957565:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957573:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957583:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759601.957617:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211987712:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759601.957624:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1782759601.957660:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211987712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759601.957698:0:151293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99000/0xdd99f5c4777e0028 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0021 expref: 18 pid: 5793 timeout: 3770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759601.957709:0:151293:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151293:1869355211987584:0@lo:104: 00010000:00010000:3.0:1782759601.957722:0:151293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957731:0:151293:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957738:0:151293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759601.957755:0:151293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e002f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759602.157018:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759602.362620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759602.362668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759602.362697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759602.362734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759602.362779:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197306112 00000100:00100000:0.0:1782759602.362790:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197306112 00000100:00100000:0.0:1782759602.362887:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305984 00000100:00100000:0.0:1782759602.362891:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305984 00000100:00100000:0.0:1782759602.363368:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2086 00000100:00100000:0.0:1782759602.363379:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197306112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759602.363459:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197306112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.363467:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2086 00000100:00100000:0.0:1782759602.363482:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2087 00000100:00100000:0.0:1782759602.363488:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197305984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759602.363510:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197305984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.363529:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2087 00000100:00100000:0.0:1782759602.363548:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305728 00000100:00100000:0.0:1782759602.363551:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305728 00000100:00100000:0.0:1782759602.363572:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2868 00000100:00100000:0.0:1782759602.363577:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197305728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759602.363600:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197305728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.363607:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2868 00000100:00080000:0.0:1782759602.363631:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759602.363634:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759602.365552:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197305856 00000100:00100000:2.0:1782759602.365564:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197305856 00000100:00100000:2.0:1782759602.365637:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2638 00000100:00100000:2.0:1782759602.365647:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197305856:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759602.365720:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197305856:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759602.365727:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2638 00000100:00080000:0.0:1782759602.368043:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1782759603.052475:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759603.052484:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759603.052490:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759603.052558:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759603.052573:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759603.052611:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759603.052647:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211987840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759603.052739:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759603.052804:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759603.052818:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987840 00000100:00100000:1.0:1782759603.052846:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987840 00000100:00100000:1.0:1782759603.052912:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:1.0:1782759603.052923:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211987840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759603.052937:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759603.052952:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0036 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.052977:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.052998:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.053009:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759603.053059:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211987840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759603.053066:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1782759603.053146:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211987840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759603.053161:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759603.053170:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759603.053189:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759603.053194:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759603.053200:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759603.118138:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211987968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759603.118234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759603.119458:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211987968 00000100:00100000:1.0:1782759603.119490:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211987968 00000100:00100000:1.0:1782759603.119583:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1782759603.119596:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211987968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759603.119648:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782759603.119760:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759603.121965:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211987968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2363us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759603.121980:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1782759603.122933:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211987968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759603.189487:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759604.215006:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759605.180545:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759605.180567:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211988352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.180630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759605.180700:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988352 00000100:00100000:1.0:1782759605.180707:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988352 00000100:00100000:1.0:1782759605.180773:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1782759605.180782:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211988352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.180852:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211988352:12345-0@lo:400:kworker.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759605.180860:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00080000:1.0:1782759605.180883:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759605.180912:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211988352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.180944:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211988480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.180971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759605.180999:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988480 00000100:00100000:1.0:1782759605.181002:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988480 00000100:00100000:1.0:1782759605.181028:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1782759605.181034:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211988480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.181068:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211988480:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759605.181086:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00080000:1.0:1782759605.181101:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759605.181118:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211988480:0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181597:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211988096:0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759605.181681:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211988608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759605.181724:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759605.181729:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211988224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759605.181764:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211988736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759605.181805:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988608 00000100:00100000:2.0:1782759605.181809:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988608 00000100:00100000:2.0:1782759605.181861:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988224 00000100:00100000:2.0:1782759605.181864:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988224 00000100:00100000:2.0:1782759605.181882:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1782759605.181888:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211988608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181925:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211988608:12345-0@lo:400:kworker.0 Request processed in 37us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759605.181931:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1782759605.181951:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:2.0:1782759605.181958:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211988224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.181987:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211988224:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759605.181993:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:2.0:1782759605.182025:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211988224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759605.182035:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211988608:0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.182363:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988096 00000100:00100000:1.0:1782759605.182368:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988096 00000100:00100000:1.0:1782759605.182405:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1782759605.182412:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211988096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759605.182451:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211988096:12345-0@lo:400:kworker.0 Request processed in 39us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759605.182457:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00080000:1.0:1782759605.182485:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759605.182502:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211988096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759605.182680:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988736 00000100:00100000:0.0:1782759605.182690:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988736 00000100:00100000:0.0:1782759605.182740:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:0.0:1782759605.182747:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211988736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759605.182783:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211988736:12345-0@lo:400:kworker.0 Request processed in 38us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759605.182789:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:0.0:1782759605.183910:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211988736:0@lo:400:kworker.0 00000100:00080000:1.0:1782759605.184961:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759605.228756:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759605.677106:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759605.677130:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211988864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759605.677201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759605.677378:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988864 00000100:00100000:0.0:1782759605.677386:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988864 00000100:00100000:0.0:1782759605.677442:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1782759605.677451:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211988864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759605.677488:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759605.677536:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211988864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759605.677542:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1782759605.677625:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211988864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759606.252205:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759607.276171:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759607.476162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759607.476213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759607.476374:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197306240 00000100:00100000:2.0:1782759607.476384:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197306240 00000100:00100000:2.0:1782759607.476442:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2871 00000100:00100000:2.0:1782759607.476451:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197306240:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759607.476537:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197306240:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759607.476544:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2871 00000100:00100000:1.0:1782759607.476985:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197306368 00000100:00100000:1.0:1782759607.476990:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197306368 00000100:00100000:1.0:1782759607.477044:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2642 00000100:00100000:1.0:1782759607.477051:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197306368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759607.477087:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197306368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759607.477093:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2642 00000100:00080000:0.0:1782759607.477147:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759607.480369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759607.480412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759607.480638:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197306496 00000100:00100000:1.0:1782759607.480650:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197306496 00000100:00100000:1.0:1782759607.480940:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197306624 00000100:00100000:1.0:1782759607.480944:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197306624 00000100:00080000:0.0:1782759607.481136:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759607.481141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759607.484214:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2090 00000100:00100000:2.0:1782759607.484244:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197306496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759607.484532:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197306496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 304us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759607.484542:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2090 00000100:00100000:2.0:1782759607.484572:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2091 00000100:00100000:2.0:1782759607.484580:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197306624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759607.485152:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197306624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 570us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759607.485178:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2091 00000100:00100000:1.0:1782759608.238112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759608.238147:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211988992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759608.238215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759608.238406:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211988992 00000100:00100000:0.0:1782759608.238414:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211988992 00000100:00100000:0.0:1782759608.238479:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1782759608.238490:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211988992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759608.238534:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759608.238605:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211988992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759608.238620:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1782759608.238668:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211988992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759608.240428:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759608.300776:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759609.328346:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782759609.408121:0:151491:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64h: Nodemap enforces local_admin RBAC roles ========================================================== 15:00:06 (1782759606) 00000100:00100000:2.0:1782759610.285634:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211989504:0@lo:400:kworker.0 00000100:00100000:2.0:1782759610.285705:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759610.285765:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759610.285771:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211989376:0@lo:400:kworker.0 00000100:00100000:2.0:1782759610.285800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759610.285855:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989376 00000100:00100000:2.0:1782759610.285862:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989376 00000100:00100000:2.0:1782759610.285914:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:2.0:1782759610.285924:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211989376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759610.285979:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211989376:12345-0@lo:400:kworker.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759610.285986:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00080000:2.0:1782759610.286005:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759610.286035:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211989376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.286183:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211989120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.286217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759610.286257:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211989632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.286299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759610.286317:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782759610.286323:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211989248:0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.286349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759610.286365:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211989760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.286386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759610.286415:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989504 00000100:00100000:0.0:1782759610.286418:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989504 00000100:00100000:0.0:1782759610.286448:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989760 00000100:00100000:0.0:1782759610.286451:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989760 00000100:00100000:0.0:1782759610.286474:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1782759610.286552:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211989504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.286589:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211989504:12345-0@lo:400:kworker.0 Request processed in 41us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759610.286720:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989120 00000100:00100000:2.0:1782759610.286724:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989120 00000100:00100000:2.0:1782759610.286750:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1782759610.286756:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211989120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759610.286792:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211989120:12345-0@lo:400:kworker.0 Request processed in 37us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759610.286798:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1782759610.286846:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989632 00000100:00100000:2.0:1782759610.286850:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989632 00000100:00100000:2.0:1782759610.286873:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989248 00000100:00100000:2.0:1782759610.286875:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989248 00000100:00100000:2.0:1782759610.286909:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:2.0:1782759610.286915:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211989632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759610.286946:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211989632:12345-0@lo:400:kworker.0 Request processed in 31us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759610.286952:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:2.0:1782759610.286980:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:2.0:1782759610.286986:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211989248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759610.287013:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211989248:12345-0@lo:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759610.287018:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1782759610.294058:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1782759610.294084:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211989760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759610.294195:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211989760:12345-0@lo:400:kworker.0 Request processed in 124us (7806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759610.294203:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00080000:3.0:1782759610.294301:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759610.294307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759610.294310:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759610.294351:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211989504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759610.294637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211989248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759610.294650:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211989760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759610.294678:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211989120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759610.294689:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211989632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759610.298711:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00010000:00010000:0.0:1782759610.348023:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759610.797879:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211989888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759610.797965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759610.798141:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211989888 00000100:00100000:0.0:1782759610.798150:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211989888 00000100:00100000:0.0:1782759610.798236:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1782759610.798245:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211989888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759610.798290:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759610.798346:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211989888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759610.798353:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1782759610.798402:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211989888:0@lo:13:osp-pre-1-0.0 00000004:00000400:1.0:1782759611.292088:0:151539:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782759611.292095:0:151539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1782759611.379057:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759611.395149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759611.395192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759611.395242:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197306752 00000100:00100000:3.0:1782759611.395251:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197306752 00000100:00100000:3.0:1782759611.395319:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197307008 00000100:00100000:3.0:1782759611.395323:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197307008 00000100:00100000:2.0:1782759611.395338:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2151 00000100:00100000:2.0:1782759611.395350:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197306752:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:2.0:1782759611.395411:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1782759611.395480:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197306752:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00080000:1.0:1782759611.395609:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759611.395896:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2152 00000100:00100000:3.0:1782759611.395906:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:104641:x1869355197307008:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782759611.395943:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759611.395947:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777dfc5b) 00010000:00010000:3.0:1782759611.395949:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759611.397887:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.397906:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.397920:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.397986:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.397994:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.398000:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759611.401760:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00010000:00010000:3.0:1782759611.401781:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.401792:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.401801:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.401807:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759611.401813:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.401841:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.401860:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759611.401863:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759611.401869:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.401875:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0044 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759611.401896:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065192198 reply state 000000009ee91ae3 transno 4294968118 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759611.401906:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759611.401997:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104641:x1869355197307008:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 6089us (6799us total) trans 4294968118 rc 0/0 00000100:00100000:3.0:1782759611.402020:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2152 00000100:00100000:2.0:1782759611.405556:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2151 00010000:00010000:1.0:1782759611.410150:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.410165:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.410173:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.410180:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759611.410185:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.410193:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.410224:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff9171908a1800) 00010000:00010000:1.0:1782759611.410228:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759611.410233:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.410252:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e004b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759611.430320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.430465:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197307136 00000100:00100000:2.0:1782759611.430476:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197307136 00000100:00100000:2.0:1782759611.430543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2153 00000100:00100000:2.0:1782759611.430554:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:104642:x1869355197307136:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759611.430590:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759611.430611:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67007 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.430667:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0059 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.430697:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.430709:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759611.430770:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1782759611.430773:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759611.430798:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.430855:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67007 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.430876:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67007 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.430885:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759611.430889:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759611.430893:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759611.430961:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:104642:x1869355197307136:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 408us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.430968:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2153 00000100:00100000:3.0:1782759611.434368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759611.434628:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197307264 00000100:00100000:1.0:1782759611.434641:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197307264 00000100:00100000:1.0:1782759611.434701:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2154 00000100:00100000:1.0:1782759611.434712:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:104642:x1869355197307264:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759611.434733:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759611.434753:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e0060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6700e expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.434844:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.434858:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.434869:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.434884:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.434890:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.434896:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435006:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0075 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435014:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0075 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435022:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0075 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759611.435062:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00000004:00200000:1.0:1782759611.435066:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759611.435090:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0075 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435116:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435123:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435129:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435135:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759611.435140:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435148:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435159:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:1.0:1782759611.435169:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759611.435174:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435180:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e0067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435193:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435199:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435214:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435219:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759611.435222:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435227:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435234:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff9171889c5f00) 00010000:00010000:1.0:1782759611.435237:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759611.435239:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.435244:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e006e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.436268:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e0060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6700e expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.436307:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0075 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6700e expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.436316:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759611.436318:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759611.436321:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759611.439077:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104642:x1869355197307264:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 4354us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759611.439090:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2154 00000100:00100000:3.0:1782759611.448295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.448384:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197307520 00000100:00100000:2.0:1782759611.448394:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197307520 00000100:00100000:2.0:1782759611.448459:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2155 00000100:00100000:2.0:1782759611.448470:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104642:x1869355197307520:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:2.0:1782759611.448536:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759611.448575:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0075 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6700e expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.448604:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171889c5100) 00010000:00010000:2.0:1782759611.448616:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759611.448642:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.448654:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.448664:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759611.448927:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d652e42 reply state 00000000bf63a66c transno 4294968119 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759611.448937:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759611.448950:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00000100:00100000:2.0:1782759611.449049:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:104642:x1869355197307520:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 579us (763us total) trans 4294968119 rc 0/0 00000100:00100000:2.0:1782759611.449057:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2155 00010000:00010000:1.0:1782759611.451928:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.451947:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.451955:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.451961:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759611.451966:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.451975:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.451990:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171c08f6400) 00010000:00010000:1.0:1782759611.451994:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759611.451998:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.452015:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90a00/0xdd99f5c4777e007c lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759611.488167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759611.488265:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197307648 00000100:00100000:0.0:1782759611.488276:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197307648 00000100:00100000:0.0:1782759611.488344:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2156 00000100:00100000:0.0:1782759611.488354:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104643:x1869355197307648:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759611.488383:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759611.488404:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e0083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67015 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488463:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488478:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488490:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488506:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488513:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488536:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488653:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e0098 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488663:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e0098 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488670:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e0098 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759611.488709:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00000004:00200000:0.0:1782759611.488713:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759611.488739:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e0098 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488752:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488759:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488765:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488770:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759611.488774:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488781:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488801:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:0.0:1782759611.488804:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759611.488809:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488815:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e008a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488855:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488862:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488868:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488874:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759611.488876:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488883:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488890:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff917183a70f00) 00010000:00010000:0.0:1782759611.488893:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759611.488896:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488902:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0091 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488945:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e0083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67015 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488960:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e0098 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67015 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.488968:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff917183a70700) 00010000:00010000:0.0:1782759611.488970:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759611.488972:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99200, rc 0) 00000100:00100000:0.0:1782759611.489031:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:104643:x1869355197307648:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 678us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759611.489039:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2156 00000100:00100000:0.0:1782759611.498169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759611.498338:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197307904 00000100:00100000:3.0:1782759611.498348:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197307904 00000100:00100000:3.0:1782759611.498409:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2157 00000100:00100000:3.0:1782759611.498419:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:104643:x1869355197307904:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759611.498440:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759611.498460:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e009f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6701c expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759611.498573:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00010000:00010000:3.0:1782759611.498712:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e009f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6701c expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.498727:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:3.0:1782759611.498730:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759611.498736:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e009f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6701c expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.498747:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759611.498815:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104643:x1869355197307904:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 396us (655us total) trans 4294968120 rc 301/301 00000100:00100000:3.0:1782759611.498851:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2157 00000100:00100000:1.0:1782759611.501464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.501527:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197308160 00000100:00100000:2.0:1782759611.501536:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197308160 00000100:00100000:2.0:1782759611.501596:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2158 00000100:00100000:2.0:1782759611.501606:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104643:x1869355197308160:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759611.501655:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759611.501681:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e0098 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67015 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.501715:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff917183a70700) 00010000:00010000:2.0:1782759611.501726:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759611.501749:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.501761:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.501771:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759611.502037:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c44db3a reply state 0000000045b92208 transno 4294968121 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759611.502048:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759611.502061:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00000100:00100000:2.0:1782759611.502140:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104643:x1869355197308160:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 534us (683us total) trans 4294968121 rc 0/0 00000100:00100000:2.0:1782759611.502148:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2158 00010000:00010000:1.0:1782759611.503763:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.503777:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.503783:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.503790:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759611.503795:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.503803:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.503818:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171c08f6600) 00010000:00010000:1.0:1782759611.503944:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782759611.503948:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759611.503954:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e00ad lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759611.505460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.507757:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197308416 00000100:00100000:2.0:1782759611.507771:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197308416 00000100:00100000:2.0:1782759611.507846:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 281 00000100:00100000:2.0:1782759611.507862:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104643:x1869355197308416:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1782759611.508112:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104643:x1869355197308416:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 256us (2659us total) trans 4294968122 rc 0/0 00000100:00100000:2.0:1782759611.508121:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 281 00000100:00100000:2.0:1782759611.510715:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759611.511080:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197308672 00000100:00100000:0.0:1782759611.511090:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197308672 00000100:00100000:0.0:1782759611.511148:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2159 00000100:00100000:0.0:1782759611.511159:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104643:x1869355197308672:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759611.511185:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759611.511212:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e00b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67023 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511365:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511384:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511411:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511428:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511436:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511443:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759611.511715:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00010000:00010000:0.0:1782759611.511815:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511845:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511851:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511857:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759611.511861:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511870:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511882:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:0.0:1782759611.511885:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759611.511897:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511905:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e00bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511919:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511925:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511931:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511936:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759611.511939:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511945:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511953:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff917183a70f00) 00010000:00010000:0.0:1782759611.511956:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759611.511959:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.511965:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e00c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.512004:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e00b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67023 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.512026:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:0.0:1782759611.512029:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759611.512033:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e00b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67023 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759611.512044:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759611.512113:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:104643:x1869355197308672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 956us (1407us total) trans 4294968123 rc 301/301 00000100:00100000:0.0:1782759611.512121:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2159 00000100:00100000:1.0:1782759611.515237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759611.515580:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197308800 00000100:00100000:3.0:1782759611.515595:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197308800 00000100:00100000:3.0:1782759611.515656:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2160 00000100:00100000:3.0:1782759611.515666:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:104643:x1869355197308800:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759611.515694:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759611.515720:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e00d0 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6702a expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.515848:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e00d7 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.515861:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e00d7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.515873:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e00d7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759611.515921:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00000004:00200000:3.0:1782759611.515925:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759611.515949:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e00d7 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.515975:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e00d0 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6702a expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.515991:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e00d7 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6702a expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.515999:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759611.516002:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759611.516006:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759611.516069:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:104643:x1869355197308800:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 403us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759611.516375:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2160 00000100:00100000:2.0:1782759611.522883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759611.522972:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197308928 00000100:00100000:1.0:1782759611.522990:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197308928 00000100:00100000:1.0:1782759611.523043:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 282 00000100:00100000:1.0:1782759611.523057:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:104643:x1869355197308928:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759611.531126:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:104643:x1869355197308928:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 8064us (8243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759611.531141:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 282 00000100:00100000:1.0:1782759611.538418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759611.538460:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197309184 00000100:00100000:1.0:1782759611.538471:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197309184 00000100:00100000:1.0:1782759611.538534:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 283 00000100:00100000:1.0:1782759611.538546:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:104643:x1869355197309184:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759611.538927:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:104643:x1869355197309184:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 383us (517us total) trans 4294968124 rc 0/0 00000100:00100000:1.0:1782759611.538935:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 283 00000100:00100000:0.0:1782759611.576861:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.577095:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197309312 00000100:00100000:2.0:1782759611.577105:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197309312 00000100:00100000:2.0:1782759611.577162:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2161 00000100:00100000:2.0:1782759611.577171:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:104644:x1869355197309312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759611.577196:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759611.577226:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e00de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67031 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577285:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577300:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577311:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577325:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577332:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577338:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577438:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e00f3 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577446:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e00f3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577467:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e00f3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759611.577509:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00000004:00200000:2.0:1782759611.577513:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759611.577537:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e00f3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577550:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577557:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577564:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577570:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759611.577574:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577724:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577738:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759611.577742:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759611.577747:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577752:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e00e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577775:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577781:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577786:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577791:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759611.577793:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577799:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577806:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff9171c08f6c00) 00010000:00010000:2.0:1782759611.577808:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759611.577810:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577815:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e00ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577866:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e00de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67031 expref: 16 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577880:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e00f3 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67031 expref: 15 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.577899:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1700) 00010000:00010000:2.0:1782759611.577901:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759611.577903:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91200, rc 0) 00000100:00100000:2.0:1782759611.577958:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:104644:x1869355197309312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 788us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.577965:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2161 00000100:00100000:1.0:1782759611.583318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759611.583416:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197309568 00000100:00100000:3.0:1782759611.583426:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197309568 00000100:00100000:3.0:1782759611.583486:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2162 00000100:00100000:3.0:1782759611.583497:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:104644:x1869355197309568:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759611.583534:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759611.583555:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e00fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67038 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.583673:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0101 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.583688:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0101 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.583700:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0101 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759611.583712:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 512 00010000:00010000:3.0:1782759611.583881:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e00fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67038 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.583900:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0101 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67038 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759611.583909:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759611.583912:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782759611.583931:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:2.0:1782759611.584198:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:104644:x1869355197309568:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 700us (887us total) trans 4294968125 rc 0/0 00000100:00100000:2.0:1782759611.584217:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2162 00000100:00100000:1.0:1782759611.587339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759611.587384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.587480:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197309824 00000100:00100000:2.0:1782759611.587490:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197309824 00000100:00100000:2.0:1782759611.587557:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 184 00000100:00100000:2.0:1782759611.587567:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:2362:x1869355197309824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759611.587592:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759611.587607:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197309696 00000100:00100000:0.0:1782759611.587611:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197309696 00010000:00010000:2.0:1782759611.587618:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e00f3 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67031 expref: 18 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759611.587638:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1700) 00010000:00010000:2.0:1782759611.587644:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759611.587646:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2163 00000100:00100000:0.0:1782759611.587652:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:104644:x1869355197309696:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759611.587702:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:2362:x1869355197309824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 136us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.587709:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 184 00000001:00080000:3.0:1782759611.649080:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968123 is committed 00000001:00080000:3.0:1782759611.649098:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968124 is committed 00000001:00080000:3.0:1782759611.649113:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968125 is committed 00000100:00100000:2.0:1782759611.749909:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104644:x1869355197309696:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 162247us (162572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.749924:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2163 00000100:00100000:1.0:1782759611.864593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.864749:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197309952 00000100:00100000:2.0:1782759611.864759:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197309952 00000100:00100000:2.0:1782759611.864868:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2164 00000100:00100000:2.0:1782759611.864878:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104646:x1869355197309952:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759611.865400:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104646:x1869355197309952:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 522us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.865409:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2164 00000100:00100000:0.0:1782759611.869023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.869209:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310080 00000100:00100000:2.0:1782759611.869220:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310080 00000100:00100000:2.0:1782759611.869285:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2165 00000100:00100000:2.0:1782759611.869295:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104646:x1869355197310080:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759611.869692:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104646:x1869355197310080:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 397us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.869701:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2165 00000100:00100000:1.0:1782759611.883057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759611.884721:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310208 00000100:00100000:2.0:1782759611.884734:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310208 00000100:00100000:2.0:1782759611.884818:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1025 00000100:00100000:2.0:1782759611.884849:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:104646:x1869355197310208:12345-192.168.204.31@tcp:19:lfs.0 00000100:00080000:1.0:1782759611.885158:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759611.885321:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:104646:x1869355197310208:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 474us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759611.885329:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1025 00000100:00100000:3.0:1782759611.887703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759611.887865:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310336 00000100:00100000:1.0:1782759611.887874:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310336 00000100:00100000:1.0:1782759611.887942:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1026 00000100:00100000:1.0:1782759611.887952:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:104646:x1869355197310336:12345-192.168.204.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759611.888238:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:104646:x1869355197310336:12345-192.168.204.31@tcp:19:lfs.0 Request processed in 287us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759611.888256:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1026 00000100:00080000:3.0:1782759611.888758:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759612.399002:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759612.599414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759612.604662:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310464 00000100:00100000:3.0:1782759612.604676:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310464 00000100:00100000:3.0:1782759612.604743:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2873 00000100:00100000:3.0:1782759612.604754:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197310464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759612.604860:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197310464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 108us (5455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759612.604867:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2873 00000100:00100000:0.0:1782759613.363068:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211990016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759613.363142:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759613.364646:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990016 00000100:00100000:2.0:1782759613.364657:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990016 00000100:00100000:2.0:1782759613.364723:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1782759613.364734:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211990016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759613.364773:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759613.364874:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211990016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759613.364881:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00080000:2.0:1782759613.364914:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759613.365011:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211990016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759613.425036:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759614.444077:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759615.414489:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211990272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.414560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759615.414609:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211990784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.414635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759615.414668:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782759615.414675:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211990144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.414702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759615.414724:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211990656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.414744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759615.414771:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211990400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.414795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759615.414814:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759615.414819:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211990528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.414860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759615.414893:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990272 00000100:00100000:1.0:1782759615.414900:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990272 00000100:00100000:1.0:1782759615.414950:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990656 00000100:00100000:1.0:1782759615.414953:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990656 00000100:00100000:1.0:1782759615.414976:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990400 00000100:00100000:1.0:1782759615.414979:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990400 00000100:00100000:1.0:1782759615.414997:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:1.0:1782759615.415005:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211990272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415056:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211990272:12345-0@lo:400:kworker.0 Request processed in 51us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759615.415075:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:1.0:1782759615.415095:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1782759615.415101:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211990656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415143:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211990656:12345-0@lo:400:kworker.0 Request processed in 41us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759615.415148:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1782759615.415160:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1782759615.415166:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211990400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415197:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211990400:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759615.415203:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1782759615.415221:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990784 00000100:00100000:1.0:1782759615.415225:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990784 00000100:00100000:1.0:1782759615.415251:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990528 00000100:00100000:1.0:1782759615.415254:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990528 00000100:00100000:1.0:1782759615.415275:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1782759615.415280:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211990784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415311:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211990784:12345-0@lo:400:kworker.0 Request processed in 31us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759615.415317:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1782759615.415328:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1782759615.415333:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211990528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415359:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211990528:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759615.415365:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1782759615.415393:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990144 00000100:00100000:1.0:1782759615.415397:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990144 00000100:00100000:1.0:1782759615.415421:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:1.0:1782759615.415427:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211990144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415457:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211990144:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759615.415463:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00080000:1.0:1782759615.415502:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759615.415506:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759615.415508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759615.415546:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211990528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415557:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211990400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415583:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211990144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415592:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211990656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415599:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211990272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759615.415607:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211990784:0@lo:400:kworker.0 00010000:00010000:1.0:1782759615.468669:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759615.923537:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211990912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759615.923613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759615.924547:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211990912 00000100:00100000:0.0:1782759615.924556:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211990912 00000100:00100000:0.0:1782759615.924610:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1782759615.924620:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211990912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759615.924684:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759615.925055:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211990912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 435us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759615.925064:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1782759615.925253:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211990912:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1782759616.163803:0:151736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4784fb20 20000000:00000080:1.0:1782759616.163845:0:151736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb93d400 uarg=0000000000000000 10000000:01000000:1.0:1782759616.164279:0:151736:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759616.164297:0:151736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.164316:0:151736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.164335:0:151736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.164372:0:151736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.164385:0:151736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 18 pid: 5796 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759616.164402:0:151736:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151736:1869355211991040:0@lo:104: 00000100:00100000:1.0:1782759616.166055:0:151736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759616.166159:0:151736:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759616.170100:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991040 00000100:00100000:2.0:1782759616.170122:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991040 00000100:00100000:2.0:1782759616.170182:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1782759616.170191:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151736:x1869355211991040:12345-0@lo:104: 00010000:00010000:2.0:1782759616.170213:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.170303:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759616.170309:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151736:x1869355211991040:12345-0@lo:104: Request processed in 120us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759616.170317:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1782759616.170436:0:151736:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151736:1869355211991040:0@lo:104: 00010000:00010000:1.0:1782759616.170471:0:151736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.170643:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759616.170650:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.170657:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759616.170661:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.170670:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759616.170677:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759616.170682:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759616.170723:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.170741:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759616.170769:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.170776:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e0036 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e003d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.170791:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759616.170793:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759616.170795:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759616.170983:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211991168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759616.171020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759616.171086:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991168 00000100:00100000:3.0:1782759616.171090:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991168 00010000:00010000:3.0:1782759616.171110:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 19 pid: 5796 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759616.171147:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1782759616.171153:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211991168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759616.171164:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759616.171168:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 19 pid: 5796 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171178:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 19 pid: 5796 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171190:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e003d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0036 expref: 19 pid: 5796 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171202:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171221:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171236:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171243:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171250:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171256:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171262:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759616.171265:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171272:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171289:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.171301:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759616.171336:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211991168:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.171342:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1782759616.171371:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211991168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759616.171451:0:151736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.171460:0:151736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.171466:0:151736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e010f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759616.495868:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759617.016088:0:151785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6001d180 20000000:00000080:1.0:1782759617.016120:0:151785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b769a400 uarg=0000000000000000 10000000:01000000:1.0:1782759617.016576:0:151785:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759617.016596:0:151785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016612:0:151785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016622:0:151785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016629:0:151785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016636:0:151785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016642:0:151785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016648:0:151785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759617.016652:0:151785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016659:0:151785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016670:0:151785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016677:0:151785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759617.016692:0:151785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4600/0xdd99f5c4777e0116 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759617.519728:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759617.721862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759617.721906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759617.721937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759617.721960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759617.721984:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310592 00000100:00100000:2.0:1782759617.721993:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310592 00000100:00100000:2.0:1782759617.722037:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2875 00000100:00100000:2.0:1782759617.722046:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197310592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759617.722126:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197310592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759617.722139:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2875 00000100:00100000:2.0:1782759617.722171:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310976 00000100:00100000:2.0:1782759617.722174:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310976 00000100:00100000:2.0:1782759617.722202:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310848 00000100:00100000:2.0:1782759617.722204:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310848 00000100:00100000:2.0:1782759617.722223:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2096 00000100:00100000:2.0:1782759617.722229:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197310976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759617.722254:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197310976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759617.722260:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2096 00000100:00100000:2.0:1782759617.722271:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2097 00000100:00100000:2.0:1782759617.722277:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197310848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759617.722295:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197310848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 18us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759617.722300:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2097 00000100:00080000:2.0:1782759617.722421:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759617.722424:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759617.724749:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197310720 00000100:00100000:1.0:1782759617.724762:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197310720 00000100:00100000:1.0:1782759617.725674:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2649 00000100:00100000:1.0:1782759617.725687:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197310720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759617.725766:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197310720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759617.725773:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2649 00000100:00080000:2.0:1782759617.726568:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1782759618.030521:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759618.030529:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759618.030534:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759618.030592:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759618.030604:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759618.030630:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759618.030657:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211991296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759618.030738:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759618.030797:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759618.030964:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991296 00000100:00100000:1.0:1782759618.030971:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991296 00000100:00100000:1.0:1782759618.031015:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1782759618.031023:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211991296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759618.031036:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759618.031050:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e011d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759618.031072:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759618.031095:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759618.031104:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759618.031143:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211991296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759618.031159:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:3.0:1782759618.031963:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211991296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759618.031983:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759618.031993:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759618.032012:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759618.032018:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759618.032025:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759618.476084:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759618.476109:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211991424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759618.476186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759618.476302:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991424 00000100:00100000:2.0:1782759618.476312:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991424 00000100:00100000:2.0:1782759618.476372:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1782759618.476382:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211991424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759618.476417:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759618.476476:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211991424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759618.476484:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00080000:0.0:1782759618.476650:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759618.476693:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211991424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759618.540097:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759619.567926:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759620.372673:0:151933:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd290ff990 20000000:00000080:3.0:1782759620.372695:0:151933:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d4c00 uarg=0000000000000000 10000000:01000000:3.0:1782759620.373133:0:151933:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759620.373153:0:151933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759620.373172:0:151933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759620.373181:0:151933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759620.373220:0:151933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759620.373247:0:151933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 18 pid: 5793 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759620.373262:0:151933:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151933:1869355211991552:0@lo:104: 00000100:00100000:3.0:1782759620.373327:0:151933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759620.373386:0:151933:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759620.373566:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991552 00000100:00100000:1.0:1782759620.373573:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991552 00000100:00100000:1.0:1782759620.373628:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1782759620.373637:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151933:x1869355211991552:12345-0@lo:104: 00010000:00010000:1.0:1782759620.373651:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.373717:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759620.373723:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:151933:x1869355211991552:12345-0@lo:104: Request processed in 87us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.373730:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00010000:00010000:1.0:1782759620.373754:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759620.373760:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.373767:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759620.373771:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.373780:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759620.373787:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759620.373793:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759620.373840:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.373854:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759620.373876:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.373883:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e011d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0124 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.373899:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759620.373900:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759620.373902:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759620.373915:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759620.373926:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211991680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759620.373960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759620.373991:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991680 00000100:00100000:1.0:1782759620.373994:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991680 00010000:00010000:1.0:1782759620.374011:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 19 pid: 5793 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759620.374044:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1782759620.374051:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211991680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759620.374062:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759620.374067:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 19 pid: 5793 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374076:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 19 pid: 5793 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374091:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374105:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374119:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374125:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374133:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374140:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374146:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759620.374150:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374158:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374167:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759620.374177:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759620.374205:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211991680:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.374212:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1782759620.374273:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211991680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759620.374372:0:151933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0124 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e011d expref: 18 pid: 5793 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759620.374382:0:151933:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151933:1869355211991552:0@lo:104: 00010000:00010000:2.0:1782759620.374396:0:151933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759620.374405:0:151933:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759620.374410:0:151933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759620.374427:0:151933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e012b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759620.531289:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211991936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759620.531362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759620.531416:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782759620.531422:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211991808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759620.531447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759620.531467:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211992320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759620.531493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759620.536156:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211992064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759620.536290:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759620.536297:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211992192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759620.536365:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991936 00000100:00100000:1.0:1782759620.536372:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991936 00000100:00100000:1.0:1782759620.536425:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211991808 00000100:00100000:1.0:1782759620.536429:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211991808 00000100:00100000:1.0:1782759620.536451:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992192 00000100:00100000:1.0:1782759620.536454:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992192 00000100:00100000:1.0:1782759620.536475:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1782759620.536483:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211991936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536539:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869355211991936:12345-0@lo:400:kworker.0 Request processed in 57us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.536547:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1782759620.536568:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:1.0:1782759620.536573:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211991808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536605:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869355211991808:12345-0@lo:400:kworker.0 Request processed in 32us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.536611:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:1.0:1782759620.536623:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:1.0:1782759620.536629:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211992192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536658:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211992192:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.536665:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:1.0:1782759620.536702:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992320 00000100:00100000:1.0:1782759620.536705:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992320 00000100:00100000:1.0:1782759620.536728:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992064 00000100:00100000:1.0:1782759620.536730:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992064 00000100:00100000:1.0:1782759620.536747:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1782759620.536753:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211992320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536783:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211992320:12345-0@lo:400:kworker.0 Request processed in 30us (5289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.536790:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:1.0:1782759620.536800:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1782759620.536806:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211992064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536852:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211992064:12345-0@lo:400:kworker.0 Request processed in 46us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759620.536857:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00080000:1.0:1782759620.536876:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759620.536880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759620.536883:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759620.536922:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211992192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536931:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211992064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536962:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355211991808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536972:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211992320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759620.536984:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355211991936:0@lo:400:kworker.0 00010000:00010000:3.0:1782759620.588288:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759621.036889:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759621.036915:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211992448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759621.036985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759621.037350:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992448 00000100:00100000:0.0:1782759621.037360:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992448 00000100:00100000:0.0:1782759621.037411:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1782759621.037421:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211992448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759621.037458:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759621.037670:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211992448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 250us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759621.037678:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1782759621.037810:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211992448:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1782759621.243031:0:151981:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda215c3c0 20000000:00000080:1.0:1782759621.243049:0:151981:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2cc00 uarg=0000000000000000 10000000:01000000:1.0:1782759621.243326:0:151981:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759621.243368:0:151981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243385:0:151981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243396:0:151981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243403:0:151981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243411:0:151981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243418:0:151981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243424:0:151981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759621.243429:0:151981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243436:0:151981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243449:0:151981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243456:0:151981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.243473:0:151981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0132 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759621.431863:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759621.431871:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759621.431876:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759621.431924:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.431935:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.431947:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759621.431974:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211992576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759621.432054:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759621.432102:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c4cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759621.432124:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992576 00000100:00100000:2.0:1782759621.432131:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992576 00000100:00100000:2.0:1782759621.432177:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1782759621.432186:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211992576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759621.432199:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759621.432212:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0139 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.432250:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.432260:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.432270:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91200, rc 0) 00000100:00100000:2.0:1782759621.432307:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211992576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759621.432314:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1782759621.432370:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211992576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759621.432392:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.432400:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759621.432417:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759621.432422:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759621.432430:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759621.612145:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759622.156146:0:152030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd544d71e0 20000000:00000080:1.0:1782759622.156164:0:152030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2d400 uarg=0000000000000000 10000000:01000000:1.0:1782759622.156663:0:152030:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759622.156682:0:152030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.156700:0:152030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.156709:0:152030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.156749:0:152030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.156765:0:152030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 18 pid: 5794 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759622.156780:0:152030:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152030:1869355211992704:0@lo:104: 00000100:00100000:1.0:1782759622.156946:0:152030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.157047:0:152030:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759622.158631:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992704 00000100:00100000:0.0:1782759622.158643:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992704 00000100:00100000:1.0:1782759622.158762:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1782759622.158772:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152030:x1869355211992704:12345-0@lo:104: 00010000:00010000:1.0:1782759622.158788:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.159093:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759622.159101:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152030:x1869355211992704:12345-0@lo:104: Request processed in 331us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759622.159109:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1782759622.159214:0:152030:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152030:1869355211992704:0@lo:104: 00010000:00010000:2.0:1782759622.159241:0:152030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.159313:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759622.159385:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.159393:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759622.159397:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.159406:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759622.159414:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759622.159430:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759622.159472:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.159478:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759622.159532:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1782759622.159613:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.159621:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91800/0xdd99f5c4777e0139 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0140 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.159637:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759622.159639:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759622.159641:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759622.163758:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211992832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759622.164004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.164129:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992832 00000100:00100000:1.0:1782759622.164137:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992832 00010000:00010000:1.0:1782759622.164173:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 19 pid: 5794 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759622.164212:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1782759622.164221:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211992832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759622.164236:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759622.164241:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 19 pid: 5794 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164252:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 19 pid: 5794 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164271:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0140 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0139 expref: 19 pid: 5794 timeout: 3790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164288:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164297:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164312:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164348:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164355:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164362:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164368:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759622.164372:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164380:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164399:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.164412:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759622.164459:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355211992832:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759622.164467:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00010000:00010000:2.0:1782759622.164530:0:152030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759622.164540:0:152030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759622.164547:0:152030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e0147 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759622.165536:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211992832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759622.636541:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759622.847453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759622.847501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759622.847529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759622.847532:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311104 00000100:00100000:1.0:1782759622.847542:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311104 00000100:00100000:2.0:1782759622.847553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759622.847572:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311360 00000100:00100000:2.0:1782759622.847576:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311360 00000100:00100000:1.0:1782759622.847590:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2878 00000100:00100000:1.0:1782759622.847600:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197311104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759622.847607:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311488 00000100:00100000:2.0:1782759622.847609:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311488 00000100:00100000:2.0:1782759622.847627:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2100 00000100:00100000:2.0:1782759622.847635:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197311360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759622.847671:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197311360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.847678:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2100 00000100:00100000:2.0:1782759622.847701:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2101 00000100:00100000:2.0:1782759622.847708:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197311488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759622.857654:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197311104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 10041us (10199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759622.857679:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2878 00000100:00100000:2.0:1782759622.865151:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197311488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 17434us (17587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.865176:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2101 00000100:00100000:2.0:1782759622.865224:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311232 00000100:00100000:2.0:1782759622.865233:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311232 00000100:00100000:2.0:1782759622.865301:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2653 00000100:00100000:2.0:1782759622.865313:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197311232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759622.865397:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197311232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (17867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.865405:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2653 00000100:00080000:2.0:1782759622.865431:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759622.865435:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759622.865438:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782759623.178696:0:152078:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd2203cd0 20000000:00000080:2.0:1782759623.178713:0:152078:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc1400 uarg=0000000000000000 10000000:01000000:2.0:1782759623.178951:0:152078:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759623.178974:0:152078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180010:0:152078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180022:0:152078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180029:0:152078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180037:0:152078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180058:0:152078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180065:0:152078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759623.180069:0:152078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180077:0:152078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180092:0:152078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180100:0:152078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759623.180106:0:152078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e014e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759623.597853:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211992960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759623.597927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759623.598029:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211992960 00000100:00100000:1.0:1782759623.598036:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211992960 00000100:00100000:1.0:1782759623.598093:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:1.0:1782759623.598102:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211992960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759623.598145:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759623.598190:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211992960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759623.598197:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00080000:1.0:1782759623.598218:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759623.598254:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211992960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759623.670155:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759624.038528:0:152126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd685e17d0 20000000:00000080:2.0:1782759624.038547:0:152126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7cc3c00 uarg=0000000000000000 00010000:00010000:2.0:1782759624.038755:0:152126:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1782759624.038788:0:152126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1700) 00010000:00010000:2.0:1782759624.038792:0:152126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782759624.038803:0:152126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0101 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67038 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039022:0:152126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759624.039026:0:152126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759624.039038:0:152126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0059 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67007 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039061:0:152126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1700) 00010000:00010000:2.0:1782759624.039063:0:152126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759624.039067:0:152126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e00d7 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6702a expref: 5 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039080:0:152126:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 3 locks, left on hash table 0. 10000000:01000000:2.0:1782759624.039096:0:152126:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759624.039111:0:152126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039124:0:152126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039135:0:152126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039143:0:152126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039149:0:152126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039156:0:152126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039162:0:152126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759624.039166:0:152126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039183:0:152126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039192:0:152126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039200:0:152126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.039206:0:152126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0155 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759624.044997:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759624.045005:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759624.045011:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759624.045069:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.045083:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759624.045095:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759624.045121:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211993088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759624.045260:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759624.045327:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b77710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759624.045577:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993088 00000100:00100000:0.0:1782759624.045587:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993088 00000100:00100000:0.0:1782759624.045648:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1782759624.045659:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211993088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759624.045674:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759624.045690:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e015c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759624.045712:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759624.045723:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759624.045733:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98000, rc 0) 00000100:00100000:0.0:1782759624.045781:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211993088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759624.045788:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1782759624.045863:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211993088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759624.045878:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759624.045886:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759624.045907:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759624.045912:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759624.045934:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759624.685217:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759625.646255:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211993216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759625.646398:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211993728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759625.646462:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782759625.646467:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211993344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759625.646503:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211993856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759625.646563:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211993472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759625.646619:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759625.646624:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211993600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759625.646678:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993216 00000100:00100000:1.0:1782759625.646685:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993216 00000100:00100000:1.0:1782759625.646730:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:1.0:1782759625.646740:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211993216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646793:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211993216:12345-0@lo:400:kworker.0 Request processed in 55us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759625.646800:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:1.0:1782759625.646866:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993728 00000100:00100000:1.0:1782759625.646869:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993728 00000100:00100000:1.0:1782759625.646900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993344 00000100:00100000:1.0:1782759625.646903:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993344 00000100:00100000:1.0:1782759625.646920:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993472 00000100:00100000:1.0:1782759625.646923:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993472 00000100:00100000:1.0:1782759625.646955:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1782759625.646960:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211993728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.646992:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211993728:12345-0@lo:400:kworker.0 Request processed in 31us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759625.646998:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1782759625.647009:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1782759625.647014:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211993344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647037:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211993344:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759625.647042:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1782759625.647061:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1782759625.647066:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211993472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647103:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211993472:12345-0@lo:400:kworker.0 Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759625.647109:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1782759625.647130:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993856 00000100:00100000:1.0:1782759625.647133:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993856 00000100:00100000:1.0:1782759625.647159:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993600 00000100:00100000:1.0:1782759625.647161:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993600 00000100:00100000:1.0:1782759625.647183:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1782759625.647188:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211993856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647218:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211993856:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759625.647223:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1782759625.647234:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1782759625.647240:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211993600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647264:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211993600:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759625.647270:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00080000:1.0:1782759625.647291:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759625.647294:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759625.647297:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759625.647338:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211993600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647348:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211993472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647375:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211993344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647384:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211993856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647402:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211993216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759625.647411:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211993728:0@lo:400:kworker.0 00010000:00010000:3.0:1782759625.707958:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759626.156554:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759626.156582:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211993984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759626.156653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759626.156731:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211993984 00000100:00100000:0.0:1782759626.156740:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211993984 00000100:00100000:0.0:1782759626.156788:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1782759626.156797:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211993984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759626.156849:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759626.156898:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211993984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759626.156907:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1782759626.156972:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211993984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759626.736378:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759627.756042:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759627.958452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759627.958498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759627.958545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759627.958568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759627.958595:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311616 00000100:00100000:2.0:1782759627.958605:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311616 00000100:00100000:2.0:1782759627.958650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2881 00000100:00100000:2.0:1782759627.958659:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197311616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759627.958730:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197311616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759627.958738:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2881 00000100:00100000:1.0:1782759627.958958:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311744 00000100:00100000:1.0:1782759627.958964:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311744 00000100:00100000:1.0:1782759627.959014:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2657 00000100:00100000:1.0:1782759627.959021:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197311744:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759627.959064:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197311744:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.959071:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2657 00000100:00100000:1.0:1782759627.959095:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197312000 00000100:00100000:1.0:1782759627.959099:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197312000 00000100:00100000:1.0:1782759627.959123:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197311872 00000100:00100000:1.0:1782759627.959126:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197311872 00000100:00100000:1.0:1782759627.959149:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2104 00000100:00100000:1.0:1782759627.959156:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197312000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759627.959183:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197312000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.959189:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2104 00000100:00100000:1.0:1782759627.959201:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2105 00000100:00100000:1.0:1782759627.959214:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197311872:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759627.959237:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197311872:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.959254:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2105 00000100:00080000:2.0:1782759627.959642:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759627.959647:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759627.959649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759628.717040:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759628.717063:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211994112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759628.717131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759628.717236:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994112 00000100:00100000:2.0:1782759628.717244:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994112 00000100:00100000:2.0:1782759628.717362:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1782759628.717373:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211994112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759628.717419:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759628.717472:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211994112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759628.717480:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1782759628.717524:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211994112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759628.725512:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759628.782739:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759629.013130:0:152370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc961cd70 20000000:00000080:1.0:1782759629.013149:0:152370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb2c00 uarg=0000000000000000 00010000:00010000:1.0:1782759629.013670:0:152370:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759629.013686:0:152370:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759629.013700:0:152370:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759629.013717:0:152370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.013735:0:152370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.013744:0:152370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.013780:0:152370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.013796:0:152370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 18 pid: 5793 timeout: 3797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759629.013812:0:152370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152370:1869355211994240:0@lo:104: 00000100:00100000:1.0:1782759629.014152:0:152370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759629.014293:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994240 00000100:00100000:3.0:1782759629.014300:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994240 00000100:00100000:1.0:1782759629.014467:0:152370:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759629.014516:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1782759629.014527:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152370:x1869355211994240:12345-0@lo:104: 00010000:00010000:3.0:1782759629.014541:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759629.014607:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759629.014614:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152370:x1869355211994240:12345-0@lo:104: Request processed in 90us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759629.014621:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1782759629.014682:0:152370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152370:1869355211994240:0@lo:104: 00010000:00010000:1.0:1782759629.014702:0:152370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.014773:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759629.014780:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.014788:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759629.014792:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.014806:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759629.014812:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759629.014818:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759629.014885:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.014892:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759629.014913:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.014921:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90000/0xdd99f5c4777e015c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0163 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.014934:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759629.014936:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759629.014938:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759629.014949:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211994368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759629.014981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759629.015015:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994368 00000100:00100000:2.0:1782759629.015020:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994368 00010000:00010000:2.0:1782759629.015038:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 19 pid: 5793 timeout: 3797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759629.015063:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1782759629.015070:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211994368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759629.015088:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759629.015096:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 19 pid: 5793 timeout: 3797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015106:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 19 pid: 5793 timeout: 3797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015120:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98000/0xdd99f5c4777e0163 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e015c expref: 19 pid: 5793 timeout: 3797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015132:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015141:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015155:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015163:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015170:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015176:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015192:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759629.015197:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015215:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015225:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.015234:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759629.015274:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355211994368:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759629.015280:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1782759629.015310:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211994368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759629.015996:0:152370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.016006:0:152370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.016013:0:152370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5000/0xdd99f5c4777e016a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759629.761624:0:152418:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd2df76e0 20000000:00000080:1.0:1782759629.761644:0:152418:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084cb1400 uarg=0000000000000000 00010000:00010000:1.0:1782759629.761921:0:152418:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759629.761936:0:152418:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759629.761951:0:152418:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759629.761972:0:152418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.761989:0:152418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.761999:0:152418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762006:0:152418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762011:0:152418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762018:0:152418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762030:0:152418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759629.762035:0:152418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762043:0:152418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762056:0:152418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762063:0:152418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.762069:0:152418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4a00/0xdd99f5c4777e0171 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.804514:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759630.187926:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759630.187933:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759630.187938:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759630.187988:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759630.188001:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759630.188012:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759630.188037:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211994496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759630.188113:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759630.188176:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759630.188283:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994496 00000100:00100000:0.0:1782759630.188291:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994496 00000100:00100000:0.0:1782759630.188344:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1782759630.188353:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211994496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759630.188366:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759630.188379:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0178 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759630.188402:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759630.188425:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759630.188433:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99600, rc 0) 00000100:00100000:0.0:1782759630.188489:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211994496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759630.188496:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1782759630.188600:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211994496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759630.188612:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759630.188620:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759630.188638:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759630.188643:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759630.188650:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759630.765287:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211994880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759630.765362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759630.765412:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782759630.765419:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211994752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759630.765443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759630.765654:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211994624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759630.765689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759630.765717:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211995136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759630.765737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759630.765750:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759630.765755:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211995008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759630.765778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759630.766651:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994880 00000100:00100000:1.0:1782759630.766660:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994880 00000100:00100000:1.0:1782759630.766709:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994752 00000100:00100000:1.0:1782759630.766713:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994752 00000100:00100000:1.0:1782759630.766731:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995136 00000100:00100000:1.0:1782759630.766734:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995136 00000100:00100000:1.0:1782759630.766755:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:1.0:1782759630.766765:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211994880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.766852:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355211994880:12345-0@lo:400:kworker.0 Request processed in 87us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759630.766860:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:1.0:1782759630.766882:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:1.0:1782759630.766889:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211994752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.766929:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355211994752:12345-0@lo:400:kworker.0 Request processed in 41us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759630.766936:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:1.0:1782759630.766948:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1782759630.766954:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211995136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.766990:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355211995136:12345-0@lo:400:kworker.0 Request processed in 36us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759630.766996:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1782759630.767013:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211994624 00000100:00100000:1.0:1782759630.767017:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211994624 00000100:00100000:1.0:1782759630.767040:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1782759630.767248:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355211994752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759630.767258:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211995264:0@lo:400:kworker.0 00000100:00100000:3.0:1782759630.767289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759630.767318:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355211994880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.768620:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211994624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.768679:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211994624:12345-0@lo:400:kworker.0 Request processed in 67us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759630.768686:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:1.0:1782759630.768734:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995008 00000100:00100000:1.0:1782759630.768741:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995008 00000100:00100000:1.0:1782759630.768776:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995264 00000100:00100000:1.0:1782759630.768780:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995264 00000100:00100000:1.0:1782759630.768799:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1782759630.768805:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211995008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.768864:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211995008:12345-0@lo:400:kworker.0 Request processed in 59us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759630.768871:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1782759630.768883:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1782759630.768890:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211995264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.768939:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211995264:12345-0@lo:400:kworker.0 Request processed in 49us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759630.768945:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00080000:1.0:1782759630.768961:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759630.768965:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759630.768967:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759630.769010:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211995008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.769023:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355211995136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.769032:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211994624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759630.771020:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211995264:0@lo:400:kworker.0 00010000:00010000:3.0:1782759630.828386:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759631.276616:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759631.276648:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211995392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759631.276746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759631.277495:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995392 00000100:00100000:0.0:1782759631.277506:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995392 00000100:00100000:0.0:1782759631.277573:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1782759631.277584:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211995392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759631.277635:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759631.277723:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211995392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759631.277731:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1782759631.277918:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211995392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759631.854102:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759632.693914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759632.694053:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197312256 00000100:00100000:1.0:1782759632.694062:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197312256 00000100:00100000:1.0:1782759632.694277:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2166 00000100:00100000:1.0:1782759632.694288:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:104970:x1869355197312256:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:1.0:1782759632.694308:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759632.694311:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782759632.694315:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e00d7) 00010000:00010000:1.0:1782759632.694317:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759632.694378:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0186 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6703f expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.694710:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 3/0,1 mode: --/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.695262:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.695276:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.695308:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.695317:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.695323:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759632.696257:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1782759632.696453:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35:0x0], index 1: 0 00010000:00010000:1.0:1782759632.696777:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e019b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.696798:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e019b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.696808:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e019b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.696984:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.696992:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697000:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697011:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759632.697016:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697024:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697038:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759632.697041:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759632.697046:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 2/0,0 mode: --/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697053:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5000/0xdd99f5c4777e018d lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759632.697066:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000461cdf11 reply state 00000000a4dacdd6 transno 4294968126 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759632.697075:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759632.697236:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e0186 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6703f expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697259:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e019b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6703f expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.697266:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759632.697268:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759632.697271:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:1.0:1782759632.697384:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104970:x1869355197312256:12345-192.168.204.31@tcp:101:touch.500 Request processed in 3098us (3477us total) trans 4294968126 rc 0/0 00000100:00100000:1.0:1782759632.697397:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2166 00010000:00010000:0.0:1782759632.699053:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.699076:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.699084:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.699090:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759632.699095:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.699103:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.699130:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171889c5300) 00010000:00010000:0.0:1782759632.699133:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759632.699136:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.699142:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0194 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759632.705744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759632.706028:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197312512 00000100:00100000:3.0:1782759632.706038:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197312512 00000100:00100000:3.0:1782759632.706088:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2167 00000100:00100000:3.0:1782759632.706097:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:104970:x1869355197312512:12345-192.168.204.31@tcp:36:touch.500 00010000:00010000:3.0:1782759632.706168:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759632.706195:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e019b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6703f expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.706214:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:3.0:1782759632.706225:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759632.706270:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.706284:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.706307:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759632.706434:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000225415c9 reply state 00000000d4b647f8 transno 4294968127 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759632.706443:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759632.706530:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104970:x1869355197312512:12345-192.168.204.31@tcp:36:touch.500 Request processed in 433us (793us total) trans 4294968127 rc 0/0 00000100:00100000:3.0:1782759632.706537:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2167 00000100:00100000:3.0:1782759632.713633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782759632.713662:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713675:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713684:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713691:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759632.713696:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713703:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713719:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759632.713723:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759632.713727:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713743:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01a9 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759632.713779:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197312640 00000100:00100000:3.0:1782759632.713789:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197312640 00000100:00100000:3.0:1782759632.713860:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2168 00000100:00100000:3.0:1782759632.713870:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:104970:x1869355197312640:12345-192.168.204.31@tcp:101:touch.500 00010000:00010000:3.0:1782759632.713894:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759632.713911:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e01b0 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67046 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713967:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e01b0 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67046 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713980:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e01b0 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67046 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.713998:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759632.714001:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759632.714004:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759632.714054:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104970:x1869355197312640:12345-192.168.204.31@tcp:101:touch.500 Request processed in 186us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759632.714062:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2168 00000100:00100000:3.0:1782759632.719238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759632.719427:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197312768 00000100:00100000:0.0:1782759632.719438:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197312768 00000100:00100000:0.0:1782759632.719510:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1027 00000100:00100000:0.0:1782759632.719521:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197312768:12345-192.168.204.31@tcp:2:touch.500 00000100:00100000:0.0:1782759632.719883:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197312768:12345-192.168.204.31@tcp:2:touch.500 Request processed in 362us (652us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1782759632.719892:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1027 00000100:00080000:3.0:1782759632.719977:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759632.722899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759632.722966:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313024 00000100:00100000:3.0:1782759632.722974:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313024 00000100:00100000:3.0:1782759632.723035:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 284 00000100:00100000:3.0:1782759632.723045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:104970:x1869355197313024:12345-192.168.204.31@tcp:35:touch.500 00000100:00100000:3.0:1782759632.723378:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:104970:x1869355197313024:12345-192.168.204.31@tcp:35:touch.500 Request processed in 333us (484us total) trans 4294968128 rc 0/0 00000100:00100000:3.0:1782759632.723386:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 284 00000100:00100000:3.0:1782759632.736713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759632.736755:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313152 00000100:00100000:3.0:1782759632.736765:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313152 00000100:00100000:3.0:1782759632.736842:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2169 00000100:00100000:3.0:1782759632.736854:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:104971:x1869355197313152:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782759632.736880:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759632.736958:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e01b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6704d expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737022:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737036:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737047:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737058:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737066:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737073:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737517:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e01cc lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737527:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e01cc lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737536:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e01cc lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759632.737563:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000004:00200000:3.0:1782759632.737568:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759632.737591:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e01cc lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737602:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737609:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737616:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737623:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759632.737627:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737634:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737646:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759632.737656:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759632.737662:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737668:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e01be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737681:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737687:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737693:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737698:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759632.737701:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737707:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737714:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff9171908a1500) 00010000:00010000:3.0:1782759632.737717:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759632.737719:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737725:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e01c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737753:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e01b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6704d expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737782:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e01cc lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6704d expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.737799:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759632.737802:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759632.737805:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759632.737899:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104971:x1869355197313152:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 1046us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759632.737907:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2169 00000100:00100000:3.0:1782759632.744813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759632.744867:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313280 00000100:00100000:3.0:1782759632.744877:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313280 00000100:00100000:3.0:1782759632.744934:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2170 00000100:00100000:3.0:1782759632.744945:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104971:x1869355197313280:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782759632.744968:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759632.744988:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e01d3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67054 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745053:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745067:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745079:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745129:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745138:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745145:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745259:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745267:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745274:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759632.745305:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1782759632.745309:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759632.745330:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745341:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745350:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745357:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745373:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745379:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759632.745383:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745391:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745404:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1800) 00010000:00010000:3.0:1782759632.745407:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759632.745411:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745417:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e01da lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745431:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745437:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745443:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745448:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759632.745451:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745467:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745476:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171908a1900) 00010000:00010000:3.0:1782759632.745478:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759632.745481:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745487:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e01e1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745520:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e01d3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67054 expref: 12 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745533:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67054 expref: 11 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.745540:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759632.745542:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759632.745544:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759632.745600:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104971:x1869355197313280:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 657us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759632.745608:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2170 00000100:00100000:3.0:1782759632.751816:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759632.755313:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313408 00000100:00100000:1.0:1782759632.755324:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313408 00000100:00100000:1.0:1782759632.755378:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00100000:1.0:1782759632.755387:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197313408:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759632.755406:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759632.755425:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777e01ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6705b expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759632.755453:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x6a42c0cf, atime: 0x6a42c0cf, ctime: 0x6a42c0cf, blocks: 0x1 00010000:00010000:1.0:1782759632.755470:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=3701s v=(0 0) 00010000:00010000:1.0:1782759632.755475:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759632.755485:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777e01ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6705b expref: 8 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.755503:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777e01ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6705b expref: 8 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759632.755516:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5000, rc 0) 00000100:00100000:1.0:1782759632.755580:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197313408:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 194us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759632.755587:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1028 00000100:00100000:3.0:1782759632.758948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759632.758978:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313664 00000100:00100000:3.0:1782759632.758986:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313664 00000100:00100000:3.0:1782759632.759032:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2171 00000100:00100000:3.0:1782759632.759046:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104971:x1869355197313664:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782759632.759099:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759632.760615:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e01e8 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67054 expref: 11 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760637:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759632.760642:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759632.760670:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760683:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760692:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760726:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760733:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760741:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760747:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759632.760752:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760759:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760781:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:3.0:1782759632.760785:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759632.760799:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759632.760806:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e01f6 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759632.760911:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104971:x1869355197313664:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 1864us (1972us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759632.760919:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2171 00000100:00100000:1.0:1782759632.780486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759632.780936:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313792 00000100:00100000:2.0:1782759632.780946:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313792 00000100:00100000:2.0:1782759632.781003:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2172 00000100:00100000:2.0:1782759632.781013:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104972:x1869355197313792:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759632.781031:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759632.781053:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e01fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67062 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759632.781233:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0204 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759632.781266:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0204 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759632.781279:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0204 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759632.781340:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000004:00200000:2.0:1782759632.781344:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759632.781369:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0204 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759632.781394:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e01fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67062 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759632.781415:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0204 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67062 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759632.781425:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1800) 00010000:00010000:2.0:1782759632.781428:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759632.781432:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759632.781495:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104972:x1869355197313792:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 484us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759632.781503:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2172 00000100:00100000:2.0:1782759632.789092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759632.789267:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197313920 00000100:00100000:2.0:1782759632.789276:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197313920 00000100:00100000:2.0:1782759632.789356:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2173 00000100:00100000:2.0:1782759632.789365:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104972:x1869355197313920:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759632.789453:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104972:x1869355197313920:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 89us (370us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759632.789461:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2173 00000100:00100000:2.0:1782759632.853280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759632.856213:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197314176 00000100:00100000:0.0:1782759632.856241:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197314176 00000100:00100000:0.0:1782759632.856308:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2174 00000100:00100000:0.0:1782759632.856318:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:104973:x1869355197314176:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759632.856366:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759632.856392:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0204 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67062 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856412:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1800) 00010000:00010000:0.0:1782759632.856417:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759632.856437:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856450:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856459:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856514:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856521:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856527:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856534:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759632.856538:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856554:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856563:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1800) 00010000:00010000:0.0:1782759632.856565:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759632.856569:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759632.856575:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e020b lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759632.856646:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:104973:x1869355197314176:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 329us (3375us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759632.856653:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2174 00010000:00010000:1.0:1782759632.876849:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759633.077122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759633.077173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759633.077201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759633.077229:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197314304 00000100:00100000:2.0:1782759633.077239:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197314304 00000100:00100000:2.0:1782759633.077289:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2884 00000100:00100000:2.0:1782759633.077298:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197314304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759633.077368:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197314304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759633.077376:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2884 00000100:00100000:2.0:1782759633.077405:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197314432 00000100:00100000:2.0:1782759633.077408:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197314432 00000100:00100000:2.0:1782759633.077437:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197314560 00000100:00100000:2.0:1782759633.077439:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197314560 00000100:00100000:2.0:1782759633.077455:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2108 00000100:00100000:2.0:1782759633.077461:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197314432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759633.077485:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197314432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759633.077491:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2108 00000100:00100000:2.0:1782759633.077501:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2109 00000100:00100000:2.0:1782759633.077507:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197314560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759633.077543:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197314560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759633.077549:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2109 00000100:00080000:3.0:1782759633.077895:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782759633.374995:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967405 is committed 00000020:00000080:1.0:1782759633.614349:0:152616:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedfbeb650 20000000:00000080:1.0:1782759633.614372:0:152616:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2cc00 uarg=0000000000000000 00010000:00010000:1.0:1782759633.614903:0:152616:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782759633.614940:0:152616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1d00) 00010000:00010000:1.0:1782759633.614945:0:152616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759633.614957:0:152616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e01b0 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67046 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.614984:0:152616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1800) 00010000:00010000:1.0:1782759633.614987:0:152616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759633.614992:0:152616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e01cc lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6704d expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.615006:0:152616:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 2 locks, left on hash table 0. 10000000:01000000:1.0:1782759633.615024:0:152616:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759633.615039:0:152616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.615052:0:152616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.615061:0:152616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.615097:0:152616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.615111:0:152616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 18 pid: 5793 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759633.615126:0:152616:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152616:1869355211995520:0@lo:104: 00000100:00100000:1.0:1782759633.615196:0:152616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759633.615245:0:152616:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759633.615535:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995520 00000100:00100000:2.0:1782759633.615542:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995520 00000100:00100000:2.0:1782759633.615587:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1782759633.615596:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152616:x1869355211995520:12345-0@lo:104: 00010000:00010000:2.0:1782759633.615609:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759633.615670:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759633.615677:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152616:x1869355211995520:12345-0@lo:104: Request processed in 82us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759633.615684:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00010000:00010000:0.0:1782759633.615987:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759633.615994:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616003:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759633.616008:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616017:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759633.616025:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759633.616043:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759633.616092:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616099:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759633.616127:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616133:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5e00/0xdd99f5c4777e0178 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e017f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616147:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759633.616149:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759633.616151:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759633.616158:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759633.616169:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211995648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759633.616201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759633.616246:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995648 00000100:00100000:0.0:1782759633.616250:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995648 00010000:00010000:0.0:1782759633.616268:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 19 pid: 5793 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759633.616288:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1782759633.616294:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211995648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759633.616304:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759633.616309:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 19 pid: 5793 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616329:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 19 pid: 5793 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616344:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616352:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616366:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616547:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616553:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616559:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616565:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759633.616569:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616575:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616583:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.616603:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759633.616727:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211995648:12345-0@lo:103:ldlm_bl.0 Request processed in 432us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759633.616734:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00010000:00010000:1.0:1782759633.617097:0:152616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99600/0xdd99f5c4777e017f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0178 expref: 18 pid: 5793 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759633.617109:0:152616:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152616:1869355211995520:0@lo:104: 00010000:00010000:1.0:1782759633.617124:0:152616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.617132:0:152616:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.617138:0:152616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.617144:0:152616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4200/0xdd99f5c4777e0212 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759633.618584:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211995648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759633.835924:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759633.835945:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211995776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759633.836017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759633.836086:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995776 00000100:00100000:2.0:1782759633.836093:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995776 00000100:00100000:2.0:1782759633.836144:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1782759633.836155:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211995776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759633.836192:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759633.836262:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211995776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759633.836270:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00080000:2.0:1782759633.836292:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759633.836328:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211995776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759633.900355:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759634.428277:0:152665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd10165d40 20000000:00000080:1.0:1782759634.428293:0:152665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2cc00 uarg=0000000000000000 00010000:00010000:1.0:1782759634.428581:0:152665:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759634.428595:0:152665:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759634.428609:0:152665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759634.428629:0:152665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428644:0:152665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428655:0:152665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428668:0:152665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428743:0:152665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428753:0:152665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428767:0:152665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759634.428771:0:152665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428779:0:152665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428792:0:152665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428800:0:152665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.428806:0:152665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5600/0xdd99f5c4777e0219 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759634.926644:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759635.243903:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759635.243911:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759635.243917:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759635.243971:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759635.243983:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759635.243993:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759635.244017:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211995904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759635.244084:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759635.244136:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759635.244172:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211995904 00000100:00100000:1.0:1782759635.244181:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211995904 00000100:00100000:1.0:1782759635.244283:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:1.0:1782759635.244293:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211995904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759635.244313:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759635.244326:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0220 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759635.244350:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759635.244361:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759635.244370:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4800, rc 0) 00000100:00100000:1.0:1782759635.244425:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211995904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759635.244433:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1782759635.244911:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211995904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759635.244927:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759635.244939:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759635.244957:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759635.244962:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759635.244971:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759635.884365:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211996288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759635.884484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759635.884544:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759635.884550:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211996416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759635.884575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759635.884610:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996288 00000100:00100000:3.0:1782759635.884619:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996288 00000100:00100000:3.0:1782759635.884688:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1782759635.884701:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211996288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759635.884764:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211996288:12345-0@lo:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759635.884772:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00080000:3.0:1782759635.884793:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759635.885069:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211996288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.885291:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211996032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.885330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759635.885364:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211996544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.885385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759635.885414:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996032 00000100:00100000:1.0:1782759635.885416:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759635.885421:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996032 00000100:00100000:1.0:1782759635.885424:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211996160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.885451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759635.885463:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:2.0:1782759635.885474:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211996032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.885475:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211996672:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.885503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759635.885529:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211996032:12345-0@lo:400:kworker.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759635.885536:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1782759635.886637:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996544 00000100:00100000:0.0:1782759635.886644:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996544 00000100:00100000:0.0:1782759635.886704:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996160 00000100:00100000:0.0:1782759635.886708:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996160 00000100:00100000:0.0:1782759635.886746:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1782759635.886754:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211996544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759635.886799:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355211996544:12345-0@lo:400:kworker.0 Request processed in 46us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759635.886805:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1782759635.886818:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1782759635.886841:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211996160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759635.886871:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211996160:12345-0@lo:400:kworker.0 Request processed in 31us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759635.886877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00080000:2.0:1782759635.887282:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759635.887480:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996416 00000100:00100000:3.0:1782759635.887485:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996416 00000100:00100000:3.0:1782759635.887532:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:3.0:1782759635.887539:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211996416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759635.887579:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211996416:12345-0@lo:400:kworker.0 Request processed in 41us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759635.887592:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1782759635.887671:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211996416:0@lo:400:kworker.0 00000100:00080000:2.0:1782759635.887716:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759635.887876:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211996032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.887887:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355211996544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759635.887905:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211996160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759635.890216:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996672 00000100:00100000:2.0:1782759635.890229:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996672 00000100:00100000:2.0:1782759635.890285:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1782759635.890298:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211996672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759635.890387:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211996672:12345-0@lo:400:kworker.0 Request processed in 93us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759635.890404:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00080000:3.0:1782759635.890476:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759635.890998:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211996672:0@lo:400:kworker.0 00010000:00010000:0.0:1782759635.948196:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759636.397113:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759636.397135:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211996800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759636.397208:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759636.397275:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996800 00000100:00100000:0.0:1782759636.397282:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996800 00000100:00100000:0.0:1782759636.397333:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1782759636.397342:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211996800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759636.397380:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759636.397427:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211996800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759636.397433:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1782759636.397494:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211996800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759636.978128:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759637.199591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759637.199674:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197314688 00000100:00100000:1.0:1782759637.199684:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197314688 00000100:00100000:1.0:1782759637.199777:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2175 00000100:00100000:1.0:1782759637.199788:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105055:x1869355197314688:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759637.199811:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759637.199854:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e022e lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67069 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.199927:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.199940:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.199952:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.199964:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.199970:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.199976:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200112:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200120:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200141:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759637.200169:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1782759637.200174:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759637.200192:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200204:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200213:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200219:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200225:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200230:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759637.200235:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200243:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200255:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759637.200258:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759637.200262:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200277:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0235 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200290:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200295:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200300:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200304:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759637.200306:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200311:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200319:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171889c5400) 00010000:00010000:1.0:1782759637.200321:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759637.200324:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200329:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4000/0xdd99f5c4777e023c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200358:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e022e lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67069 expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200386:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67069 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.200393:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759637.200395:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759637.200397:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4a00, rc 0) 00000100:00100000:1.0:1782759637.200457:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105055:x1869355197314688:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 670us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759637.200464:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2175 00000100:00080000:2.0:1782759637.203156:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759637.203396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759637.203463:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197314944 00000100:00100000:1.0:1782759637.203473:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197314944 00000100:00100000:1.0:1782759637.203536:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2176 00000100:00100000:1.0:1782759637.203547:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105055:x1869355197314944:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782759637.203600:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759637.203627:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e0243 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67069 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203645:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759637.203656:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759637.203685:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203698:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203728:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203773:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203781:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203787:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203793:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759637.203797:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203805:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203815:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5100) 00010000:00010000:1.0:1782759637.203818:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759637.203850:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.203856:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4c00/0xdd99f5c4777e024a lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759637.203930:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105055:x1869355197314944:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 384us (538us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759637.203938:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2176 00000100:00100000:1.0:1782759637.220341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759637.220410:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315072 00000100:00100000:3.0:1782759637.220420:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315072 00000100:00100000:3.0:1782759637.220473:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2177 00000100:00100000:3.0:1782759637.220484:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105056:x1869355197315072:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759637.220504:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759637.220526:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e0251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67070 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759637.220590:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0258 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759637.220604:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0258 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759637.220614:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0258 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759637.220669:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000004:00200000:3.0:1782759637.220673:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759637.220694:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0258 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759637.221532:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e0251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67070 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759637.221559:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0258 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67070 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759637.221584:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759637.221587:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759637.221590:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce400, rc 0) 00000100:00100000:3.0:1782759637.221651:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105056:x1869355197315072:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1168us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759637.221658:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2177 00000100:00100000:1.0:1782759637.230003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759637.230129:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315200 00000100:00100000:3.0:1782759637.230141:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315200 00000100:00100000:3.0:1782759637.230204:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2178 00000100:00100000:3.0:1782759637.230214:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105056:x1869355197315200:12345-192.168.204.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759637.230303:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105056:x1869355197315200:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 90us (308us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759637.230310:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2178 00000100:00100000:3.0:1782759637.279543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759637.279638:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315456 00000100:00100000:0.0:1782759637.279650:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315456 00000100:00100000:0.0:1782759637.279720:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2179 00000100:00100000:0.0:1782759637.279731:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105057:x1869355197315456:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759637.279788:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759637.279819:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0258 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67070 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.279864:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1500) 00010000:00010000:0.0:1782759637.279877:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759637.279905:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.279920:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.279930:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.279998:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.280005:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.280011:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.280017:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759637.280198:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.280207:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.280218:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff917183a70c00) 00010000:00010000:0.0:1782759637.280221:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759637.280224:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759637.280230:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e025f lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759637.280571:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105057:x1869355197315456:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 840us (1036us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759637.280580:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2179 00000001:00080000:2.0:1782759637.498641:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968126 is committed 00000001:00080000:2.0:1782759637.498658:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968128 is committed 00010000:00010000:3.0:1782759637.997608:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759638.078051:0:152861:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa14b0360 20000000:00000080:1.0:1782759638.079081:0:152861:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186c2cc00 uarg=0000000000000000 00010000:00010000:1.0:1782759638.079605:0:152861:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759638.079622:0:152861:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759638.079638:0:152861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759638.079658:0:152861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.079677:0:152861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.079699:0:152861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.079736:0:152861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.079751:0:152861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 18 pid: 5793 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759638.079765:0:152861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152861:1869355211996928:0@lo:104: 00000100:00100000:1.0:1782759638.080273:0:152861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759638.080332:0:152861:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759638.081018:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211996928 00000100:00100000:0.0:1782759638.081027:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211996928 00000100:00100000:0.0:1782759638.081093:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1782759638.081103:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152861:x1869355211996928:12345-0@lo:104: 00010000:00010000:0.0:1782759638.081118:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081201:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759638.081207:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:152861:x1869355211996928:12345-0@lo:104: Request processed in 106us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759638.081216:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00010000:00010000:3.0:1782759638.081230:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759638.081239:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.081248:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759638.081253:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.081262:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759638.081294:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759638.081299:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759638.081337:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.081344:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759638.081375:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759638.081627:0:152861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152861:1869355211996928:0@lo:104: 00010000:00010000:1.0:1782759638.081650:0:152861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.081679:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e0220 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0227 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.081705:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759638.081707:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759638.081708:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759638.081712:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211997056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759638.081752:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759638.081788:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997056 00000100:00100000:0.0:1782759638.081793:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997056 00010000:00010000:0.0:1782759638.081817:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 19 pid: 5793 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759638.081875:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1782759638.081883:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355211997056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759638.081896:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759638.081900:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 19 pid: 5793 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081909:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 19 pid: 5793 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081922:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4800/0xdd99f5c4777e0227 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0220 expref: 19 pid: 5793 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081934:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081942:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081955:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081962:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081969:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081975:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.081987:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759638.081991:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.082008:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.082024:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759638.082034:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759638.082037:0:152861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.082044:0:152861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.082056:0:152861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5200/0xdd99f5c4777e0266 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759638.082070:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355211997056:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759638.082077:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1782759638.082201:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355211997056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759638.195983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759638.196128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759638.196157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759638.197528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759638.197564:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315840 00000100:00100000:2.0:1782759638.197573:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315840 00000100:00100000:2.0:1782759638.197621:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315968 00000100:00100000:2.0:1782759638.197624:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315968 00000100:00100000:2.0:1782759638.197647:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2112 00000100:00100000:2.0:1782759638.197658:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197315840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759638.197742:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197315840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759638.197749:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2112 00000100:00100000:2.0:1782759638.197765:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2113 00000100:00100000:2.0:1782759638.197771:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197315968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759638.197797:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197315968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759638.197809:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2113 00000100:00080000:2.0:1782759638.197861:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759638.197865:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759638.197994:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315584 00000100:00100000:1.0:1782759638.197999:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315584 00000100:00100000:1.0:1782759638.198032:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2887 00000100:00100000:1.0:1782759638.198039:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197315584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759638.198904:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197315584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 861us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759638.198912:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2887 00000100:00100000:0.0:1782759638.201158:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197315712 00000100:00100000:0.0:1782759638.201170:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197315712 00000100:00100000:0.0:1782759638.201233:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2664 00000100:00100000:0.0:1782759638.201242:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197315712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759638.201323:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197315712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759638.201332:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2664 00000100:00100000:1.0:1782759638.955968:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759638.955990:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211997184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759638.956053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759638.956201:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997184 00000100:00100000:2.0:1782759638.956209:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997184 00000100:00100000:2.0:1782759638.956270:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:2.0:1782759638.956281:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211997184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759638.956315:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759638.956366:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211997184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759638.956374:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00080000:3.0:1782759638.956407:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759638.958236:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211997184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759639.022989:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759639.985433:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759639.985440:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759639.985444:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759639.985490:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759639.985502:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759639.985513:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759639.985537:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211997312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759639.985604:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759639.985644:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759639.987905:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997312 00000100:00100000:2.0:1782759639.987917:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997312 00000100:00100000:2.0:1782759639.988072:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1782759639.988082:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211997312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759639.988100:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759639.988117:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e026d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759639.988143:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759639.988154:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759639.988164:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90200, rc 0) 00000100:00100000:2.0:1782759639.988235:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211997312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759639.988250:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:0.0:1782759639.988327:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211997312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759639.988343:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759639.988351:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759639.988380:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759639.988384:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759639.988391:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.047133:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759640.962996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759640.963113:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197316096 00000100:00100000:3.0:1782759640.963124:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197316096 00000100:00100000:3.0:1782759640.963203:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2180 00000100:00100000:3.0:1782759640.963213:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:105130:x1869355197316096:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:3.0:1782759640.963235:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759640.963259:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e027b lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67077 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963319:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963339:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963351:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963365:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963371:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963377:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963769:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963779:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963787:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759640.963818:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1782759640.963851:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759640.963873:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963885:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963904:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963910:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963917:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963923:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759640.963927:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963933:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963944:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759640.963947:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759640.963951:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963958:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0282 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963968:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963973:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963978:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963989:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfa00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759640.963993:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.963998:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.964007:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171908a1a00) 00010000:00010000:3.0:1782759640.964010:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759640.964012:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.964018:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0289 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.964047:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e027b lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67077 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.964062:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67077 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.964069:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759640.964070:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759640.964073:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf200, rc 0) 00000100:00100000:3.0:1782759640.964134:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105130:x1869355197316096:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 923us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759640.964143:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2180 00000100:00080000:2.0:1782759640.964383:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759640.966658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759640.966793:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197316352 00000100:00100000:3.0:1782759640.966811:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197316352 00000100:00100000:3.0:1782759640.967484:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2181 00000100:00100000:3.0:1782759640.967495:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105130:x1869355197316352:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:3.0:1782759640.967559:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759640.967586:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e0290 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67077 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.967603:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759640.967613:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759640.967658:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.967670:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.967679:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759640.968791:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000686e1442 reply state 000000001278789b transno 4294968129 ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759640.968916:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759640.969652:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105130:x1869355197316352:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 2152us (2999us total) trans 4294968129 rc 0/0 00000100:00100000:2.0:1782759640.969662:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2181 00000100:00100000:3.0:1782759640.972203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759640.972276:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197316480 00000100:00100000:2.0:1782759640.972287:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197316480 00000100:00100000:2.0:1782759640.972359:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1029 00000100:00100000:2.0:1782759640.972370:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197316480:12345-192.168.204.31@tcp:2:chmod.0 00002000:00010000:2.0:1782759640.972653:0:9120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759640.972657:0:9120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb mtime from disk: 1782759631 -> 1782759631 00002000:00010000:2.0:1782759640.972660:0:9120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb atime from disk: 1782759631 -> 1782759631 00002000:00010000:2.0:1782759640.972662:0:9120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb ctime from disk: 1782759631 -> 1782759640 00002000:00010000:2.0:1782759640.972664:0:9120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759640.973103:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197316480:12345-192.168.204.31@tcp:2:chmod.0 Request processed in 733us (908us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1782759640.973112:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1029 00010000:00010000:1.0:1782759640.973443:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759640.973455:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759640.973464:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759640.973468:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759640.973470:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759640.973474:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759640.973482:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759640.973500:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1200) 00010000:00010000:1.0:1782759640.973504:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759640.973508:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759640.973515:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0297 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759640.996966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759640.997214:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197316608 00000100:00100000:3.0:1782759640.997224:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197316608 00000100:00100000:3.0:1782759640.997284:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2182 00000100:00100000:3.0:1782759640.997293:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105131:x1869355197316608:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759640.997318:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759640.997351:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e029e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6707e expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.997420:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e02a5 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.997435:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e02a5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.997447:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e02a5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759640.997650:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000004:00200000:3.0:1782759640.997655:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759640.997735:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e02a5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.997766:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e029e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6707e expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.997786:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e02a5 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6707e expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759640.997795:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759640.997798:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759640.997802:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce600, rc 0) 00000100:00100000:3.0:1782759640.999082:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105131:x1869355197316608:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1782us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759640.999094:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2182 00000100:00100000:3.0:1782759641.005169:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211997568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759641.005242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759641.005287:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211998080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759641.005313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759641.005341:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759641.005348:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211997696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759641.005369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759641.006712:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211997440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.006781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759641.006815:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211997952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.006856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759641.006880:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759641.006887:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211997824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759641.007281:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997440 00000100:00100000:2.0:1782759641.007291:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997440 00000100:00100000:2.0:1782759641.007341:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1782759641.007349:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211997440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007398:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355211997440:12345-0@lo:400:kworker.0 Request processed in 50us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.007405:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1782759641.007435:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997568 00000100:00100000:2.0:1782759641.007438:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997568 00000100:00100000:2.0:1782759641.007459:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997696 00000100:00100000:2.0:1782759641.007462:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997696 00000100:00100000:2.0:1782759641.007485:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997952 00000100:00100000:2.0:1782759641.007487:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997952 00000100:00100000:2.0:1782759641.007503:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1782759641.007509:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211997568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007542:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355211997568:12345-0@lo:400:kworker.0 Request processed in 34us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.007548:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1782759641.007558:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1782759641.007563:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211997696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007587:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355211997696:12345-0@lo:400:kworker.0 Request processed in 23us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.007592:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1782759641.007600:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1782759641.007605:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211997952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007640:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869355211997952:12345-0@lo:400:kworker.0 Request processed in 22us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.007656:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1782759641.007674:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998080 00000100:00100000:2.0:1782759641.007678:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998080 00000100:00100000:2.0:1782759641.007698:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211997824 00000100:00100000:2.0:1782759641.007700:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211997824 00000100:00100000:2.0:1782759641.007792:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1782759641.007801:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211998080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007855:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211998080:12345-0@lo:400:kworker.0 Request processed in 56us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.007861:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1782759641.007874:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1782759641.007880:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211997824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.007908:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211997824:12345-0@lo:400:kworker.0 Request processed in 29us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.007913:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1782759641.008114:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355211997696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.008127:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355211997568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.008137:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211998080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.008176:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211997824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.008185:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355211997440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.008196:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355211997952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759641.008369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759641.008386:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197316736 00000100:00100000:2.0:1782759641.008394:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197316736 00000100:00100000:2.0:1782759641.008419:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2183 00000100:00100000:2.0:1782759641.008424:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105131:x1869355197316736:12345-192.168.204.31@tcp:48:lfs.0 00000100:00080000:3.0:1782759641.009197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759641.009202:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759641.009205:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1782759641.029433:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968129 is committed 00000100:00100000:2.0:1782759641.029554:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105131:x1869355197316736:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 21122us (21179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.029567:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2183 00000100:00100000:2.0:1782759641.047455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759641.047520:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197316992 00000100:00100000:0.0:1782759641.047530:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197316992 00000100:00100000:0.0:1782759641.047592:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2184 00000100:00100000:0.0:1782759641.047602:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105132:x1869355197316992:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759641.047666:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759641.047695:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e02a5 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6707e expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.047713:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1600) 00010000:00010000:0.0:1782759641.047737:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759641.047763:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.047776:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.047785:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759641.048397:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098bce45e reply state 00000000c95173db transno 4294968130 ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759641.048408:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759641.048493:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000100:00100000:0.0:1782759641.048600:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105132:x1869355197316992:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 997us (1155us total) trans 4294968130 rc 0/0 00000100:00100000:0.0:1782759641.048609:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2184 00010000:00010000:1.0:1782759641.051648:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.051665:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.051691:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.051698:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759641.051703:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.051711:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.051737:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759641.051740:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782759641.051750:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.051756:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99000/0xdd99f5c4777e02ac lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759641.053642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759641.053741:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197317120 00000100:00100000:3.0:1782759641.053752:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197317120 00000100:00100000:3.0:1782759641.053899:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2185 00000100:00100000:3.0:1782759641.053910:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105132:x1869355197317120:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759641.053936:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759641.053971:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e02b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67085 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.054036:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e02ba lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.054051:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e02ba lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.054061:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e02ba lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759641.054298:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000004:00200000:3.0:1782759641.054315:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759641.054401:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e02ba lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.054434:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e02b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67085 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.054457:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e02ba lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67085 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.054467:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759641.054470:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759641.054473:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcfa00, rc 0) 00000100:00100000:3.0:1782759641.054543:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105132:x1869355197317120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 635us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759641.054551:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2185 00000100:00100000:3.0:1782759641.060588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759641.060683:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197317248 00000100:00100000:1.0:1782759641.060693:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197317248 00000100:00100000:1.0:1782759641.060754:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 285 00000100:00100000:1.0:1782759641.060766:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105132:x1869355197317248:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:2.0:1782759641.068651:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105132:x1869355197317248:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 7875us (8059us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.068665:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 285 00010000:00010000:3.0:1782759641.068764:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759641.074797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759641.077896:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197317376 00000100:00100000:3.0:1782759641.077914:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197317376 00000100:00100000:3.0:1782759641.078081:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2186 00000100:00100000:3.0:1782759641.078093:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105132:x1869355197317376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759641.078116:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759641.078140:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e02c1 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6708c expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078202:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078216:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078245:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078259:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078266:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078273:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078584:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078592:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078599:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759641.078641:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1782759641.078646:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759641.078669:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078681:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078689:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078705:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078711:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078718:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759641.078722:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078730:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078743:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759641.078746:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759641.078750:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078755:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e02c8 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078768:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078774:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078779:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078784:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcec00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759641.078793:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078799:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078806:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171908a1a00) 00010000:00010000:3.0:1782759641.078809:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759641.078811:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078816:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e02cf lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078906:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e02c1 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6708c expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078924:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6708c expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759641.078930:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1400) 00010000:00010000:3.0:1782759641.078932:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759641.078935:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf400, rc 0) 00000100:00100000:3.0:1782759641.079567:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105132:x1869355197317376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1474us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759641.079577:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2186 00000100:00100000:0.0:1782759641.088243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759641.088411:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197317632 00000100:00100000:2.0:1782759641.088420:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197317632 00000100:00100000:2.0:1782759641.088512:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2187 00000100:00100000:2.0:1782759641.088523:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105132:x1869355197317632:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759641.088545:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759641.088563:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e02dd lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67093 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.088664:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e02e4 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.088680:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e02e4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.088693:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e02e4 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759641.088725:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1782759641.089171:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e02dd lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67093 expref: 11 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.089191:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e02e4 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67093 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.089199:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1400) 00010000:00010000:2.0:1782759641.089202:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759641.089205:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782759641.089273:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105132:x1869355197317632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 752us (1038us total) trans 4294968131 rc 0/0 00000100:00100000:2.0:1782759641.089281:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2187 00000100:00100000:0.0:1782759641.092755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759641.093435:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197317888 00000100:00100000:2.0:1782759641.093446:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197317888 00000100:00100000:2.0:1782759641.093538:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2188 00000100:00100000:2.0:1782759641.093549:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105132:x1869355197317888:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759641.093606:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782759641.093645:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e02e4 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67093 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.093667:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e02d6 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6708c expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.093678:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1400) 00010000:00010000:2.0:1782759641.093689:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759641.093898:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.093912:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.093922:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759641.095465:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].49, 88 off11448 00000004:00080000:2.0:1782759641.095481:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3709498657946ns, next at 3710498655003ns, rc = 0 00000004:00010000:2.0:1782759641.095577:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea5d3972 reply state 0000000062667683 transno 4294968132 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759641.095590:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759641.095900:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105132:x1869355197317888:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 2348us (3152us total) trans 4294968132 rc 0/0 00000100:00100000:2.0:1782759641.095909:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2188 00010000:00010000:1.0:1782759641.098767:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.098786:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.098794:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.098819:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759641.098842:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.098850:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.098868:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171c08f6500) 00010000:00010000:1.0:1782759641.098872:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782759641.098877:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.098882:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e02f2 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759641.099363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759641.099451:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197318144 00000100:00100000:1.0:1782759641.099460:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197318144 00000100:00100000:1.0:1782759641.099566:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 286 00000100:00100000:1.0:1782759641.099577:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105132:x1869355197318144:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759641.100125:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105132:x1869355197318144:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 547us (823us total) trans 4294968133 rc 0/0 00000100:00100000:1.0:1782759641.100135:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 286 00000100:00100000:0.0:1782759641.518220:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211998208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759641.518301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759641.518420:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998208 00000100:00100000:3.0:1782759641.518428:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998208 00000100:00100000:3.0:1782759641.518491:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1782759641.518518:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211998208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759641.518560:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759641.518634:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211998208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759641.518642:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1782759641.518691:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211998208:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759641.824394:0:153058:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc00c78600 20000000:00000080:2.0:1782759641.824413:0:153058:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91719327d000 uarg=0000000000000000 00010000:00010000:2.0:1782759641.824984:0:153058:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782759641.825017:0:153058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782759641.825021:0:153058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759641.825032:0:153058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e02ba lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67085 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.825055:0:153058:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1782759641.825070:0:153058:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759641.825085:0:153058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.825291:0:153058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.825300:0:153058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.825337:0:153058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.825351:0:153058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 18 pid: 5796 timeout: 3810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759641.825365:0:153058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153058:1869355211998336:0@lo:104: 00000100:00100000:2.0:1782759641.825430:0:153058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759641.825548:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759641.825562:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998336 00000100:00100000:1.0:1782759641.825569:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998336 00000100:00100000:1.0:1782759641.825646:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1782759641.825657:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170833e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:153058:x1869355211998336:12345-0@lo:104: 00010000:00010000:1.0:1782759641.825670:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.825736:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759641.825742:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170833e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:153058:x1869355211998336:12345-0@lo:104: Request processed in 88us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759641.825750:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1782759641.825948:0:153058:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833daf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759641.825972:0:153058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb960a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153058:1869355211998336:0@lo:104: 00010000:00010000:0.0:1782759641.826115:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759641.826122:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826131:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759641.826136:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826146:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759641.826153:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759641.826160:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759641.826173:0:153058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826191:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826207:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759641.826240:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826247:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5c00/0xdd99f5c4777e026d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0274 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759641.826255:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211998464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759641.826263:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759641.826266:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759641.826269:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759641.826293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759641.826384:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998464 00000100:00100000:0.0:1782759641.826388:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998464 00010000:00010000:0.0:1782759641.826408:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 19 pid: 5796 timeout: 3810 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759641.826438:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1782759641.826446:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355211998464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759641.826457:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759641.826462:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 19 pid: 5796 timeout: 3810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826472:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 19 pid: 5796 timeout: 3810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826483:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0274 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e026d expref: 19 pid: 5796 timeout: 3810 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826494:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826513:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826527:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826533:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826539:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826544:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826550:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759641.826553:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826560:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826580:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.826699:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759641.826747:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355211998464:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759641.826753:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1782759641.826815:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355211998464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759641.826955:0:153058:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.827031:0:153058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.827039:0:153058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e02f9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.093414:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759642.689780:0:153106:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0b807530 20000000:00000080:0.0:1782759642.689806:0:153106:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312c000 uarg=0000000000000000 00010000:00010000:0.0:1782759642.690304:0:153106:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759642.690319:0:153106:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759642.690334:0:153106:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759642.690356:0:153106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690373:0:153106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690384:0:153106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690390:0:153106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690397:0:153106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690404:0:153106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690410:0:153106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759642.690415:0:153106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690422:0:153106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690435:0:153106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690454:0:153106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.690461:0:153106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99200/0xdd99f5c4777e0300 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759642.861640:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759642.861646:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759642.861650:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759642.861692:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759642.861938:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759642.861951:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759642.861977:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211998592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759642.862127:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759642.862180:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998592 00000100:00100000:1.0:1782759642.862188:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759642.862189:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998592 00000100:00100000:0.0:1782759642.862244:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1782759642.862253:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355211998592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759642.862268:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759642.862282:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0307 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.862306:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.862315:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.862324:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98400, rc 0) 00000100:00100000:0.0:1782759642.862371:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355211998592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759642.862379:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1782759642.864029:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355211998592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759642.864058:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.864083:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759642.864110:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759642.864116:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759642.864124:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759643.120885:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759643.317152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759643.317201:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759643.317236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759643.317274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759643.317306:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197318656 00000100:00100000:2.0:1782759643.317316:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197318656 00000100:00100000:2.0:1782759643.317374:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197318528 00000100:00100000:2.0:1782759643.317377:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197318528 00000100:00100000:2.0:1782759643.317401:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2116 00000100:00100000:2.0:1782759643.317410:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197318656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759643.317482:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197318656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759643.317490:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2116 00000100:00100000:2.0:1782759643.317509:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2117 00000100:00100000:2.0:1782759643.317515:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197318528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759643.317541:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197318528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759643.317547:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2117 00000100:00080000:2.0:1782759643.317563:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759643.317567:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759643.317642:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197318272 00000100:00100000:1.0:1782759643.317647:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197318272 00000100:00100000:1.0:1782759643.317676:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2891 00000100:00100000:1.0:1782759643.317684:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197318272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759643.317710:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197318272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.317716:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2891 00000100:00100000:0.0:1782759643.317865:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197318400 00000100:00100000:0.0:1782759643.317871:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197318400 00000100:00100000:0.0:1782759643.317907:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2668 00000100:00100000:0.0:1782759643.317914:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2364:x1869355197318400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759643.317951:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2364:x1869355197318400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759643.317958:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2668 00000100:00080000:1.0:1782759643.318040:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1782759643.629175:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967406 is committed 00000100:00100000:3.0:1782759644.077145:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211998720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759644.077229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759644.077313:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998720 00000100:00100000:0.0:1782759644.077321:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998720 00000100:00100000:0.0:1782759644.077455:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1782759644.077469:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211998720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759644.077512:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759644.077591:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355211998720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.077599:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1782759644.077957:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211998720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759644.078042:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759644.144726:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759645.164817:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759645.527167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759645.527391:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197318784 00000100:00100000:1.0:1782759645.527413:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197318784 00000100:00100000:1.0:1782759645.527491:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2189 00000100:00100000:1.0:1782759645.527503:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105216:x1869355197318784:12345-192.168.204.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759645.527525:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759645.527557:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0315 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6709a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.527624:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.527639:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.527653:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.527666:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.527673:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.527680:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759645.528286:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759645.529440:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529456:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529467:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759645.529509:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1782759645.529514:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759645.529536:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529556:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529564:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529581:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529589:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529595:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759645.529600:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529608:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529621:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171889c5500) 00010000:00010000:3.0:1782759645.529624:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759645.529631:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529636:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e031c lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529650:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529656:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529662:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529667:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759645.529676:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529683:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529691:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171889c5e00) 00010000:00010000:3.0:1782759645.529693:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759645.529696:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529703:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e0323 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529740:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0315 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6709a expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529756:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6709a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759645.529765:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759645.529767:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759645.529769:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf200, rc 0) 00000100:00100000:3.0:1782759645.530091:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105216:x1869355197318784:12345-192.168.204.31@tcp:101:chmod.0 Request processed in 2589us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759645.530100:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2189 00000100:00100000:3.0:1782759645.535902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759645.535978:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319040 00000100:00100000:1.0:1782759645.535995:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319040 00000100:00100000:1.0:1782759645.536058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2190 00000100:00100000:1.0:1782759645.536068:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105216:x1869355197319040:12345-192.168.204.31@tcp:36:chmod.0 00010000:00010000:1.0:1782759645.536125:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759645.536154:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e032a lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6709a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.536173:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:1.0:1782759645.536186:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759645.536217:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.536229:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.536237:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759645.536558:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007133953f reply state 00000000fbfdca72 transno 4294968134 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759645.536568:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759645.536691:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:105216:x1869355197319040:12345-192.168.204.31@tcp:36:chmod.0 Request processed in 624us (799us total) trans 4294968134 rc 0/0 00000100:00100000:1.0:1782759645.536698:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2190 00010000:00010000:1.0:1782759645.538362:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.538376:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.538398:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.538414:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759645.538419:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.538427:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.538441:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5900) 00010000:00010000:1.0:1782759645.538445:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759645.538449:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.538455:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0331 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759645.539086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759645.539163:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319168 00000100:00100000:1.0:1782759645.539172:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319168 00000100:00100000:1.0:1782759645.539236:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1030 00000100:00100000:1.0:1782759645.539246:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197319168:12345-192.168.204.31@tcp:2:chmod.0 00002000:00010000:1.0:1782759645.540100:0:126932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782759645.540105:0:126932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb mtime from disk: 1782759631 -> 1782759631 00002000:00010000:1.0:1782759645.540108:0:126932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb atime from disk: 1782759631 -> 1782759631 00002000:00010000:1.0:1782759645.540111:0:126932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb ctime from disk: 1782759640 -> 1782759644 00002000:00010000:1.0:1782759645.540113:0:126932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782759645.540175:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197319168:12345-192.168.204.31@tcp:2:chmod.0 Request processed in 928us (1090us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1782759645.540194:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1030 00000100:00080000:0.0:1782759645.541513:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759645.582153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759645.584816:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319296 00000100:00100000:2.0:1782759645.584843:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319296 00000100:00100000:2.0:1782759645.584921:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2191 00000100:00100000:2.0:1782759645.584932:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105217:x1869355197319296:12345-192.168.204.31@tcp:48:lfs.0 00000001:00080000:1.0:1782759645.620699:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968130 is committed 00000001:00080000:1.0:1782759645.620716:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968134 is committed 00000004:00080000:1.0:1782759645.620732:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 122 committed 00000100:00100000:1.0:1782759645.621045:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211998848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782759645.621120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759645.621234:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998848 00000100:00100000:0.0:1782759645.621241:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998848 00000100:00100000:0.0:1782759645.621309:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1782759645.621318:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211998848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782759645.621476:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759645.621479:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb mtime from disk: 1782759631 -> 1782759631 00002000:00010000:0.0:1782759645.621482:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb atime from disk: 1782759631 -> 1782759631 00002000:00010000:0.0:1782759645.621485:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb ctime from disk: 1782759644 -> 1782759644 00002000:00010000:0.0:1782759645.621487:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759645.621554:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355211998848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (434us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1782759645.621562:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:1.0:1782759645.621621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1782759645.621653:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917084d75c00/2, rc 0, transno 4294967408 00000100:00100000:1.0:1782759645.621660:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211998848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759645.622064:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:105217:x1869355197319296:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 37131us (39917us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759645.622075:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2191 00000100:00100000:3.0:1782759645.635419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759645.635679:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319552 00000100:00100000:2.0:1782759645.635688:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319552 00000100:00100000:2.0:1782759645.635754:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2192 00000100:00100000:2.0:1782759645.635764:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:105218:x1869355197319552:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759645.635809:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759645.635812:0:146757:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e02ba) 00010000:00010000:2.0:1782759645.635814:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759645.635882:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.635897:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.635909:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759645.636490:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001214923b reply state 000000007ab55ea4 transno 4294968135 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759645.636502:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759645.636587:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000100:00100000:2.0:1782759645.636679:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105218:x1869355197319552:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 914us (1276us total) trans 4294968135 rc 0/0 00000100:00100000:2.0:1782759645.636687:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2192 00010000:00010000:0.0:1782759645.639679:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.639695:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.639702:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.639708:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759645.639713:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.639738:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.639756:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:0.0:1782759645.639759:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759645.639764:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.639771:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0338 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759645.640982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759645.641104:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319680 00000100:00100000:2.0:1782759645.641116:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319680 00000100:00100000:2.0:1782759645.641578:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2193 00000100:00100000:2.0:1782759645.641588:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:105218:x1869355197319680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759645.641613:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759645.641633:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e033f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670a1 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.641695:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0346 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.641708:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0346 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.641728:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0346 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759645.642288:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1e:0x0]: returning size 7680 00000004:00200000:2.0:1782759645.642294:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759645.642377:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0346 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.642407:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e033f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670a1 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.642430:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0346 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670a1 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.642439:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759645.642442:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759645.642445:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782759645.642521:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105218:x1869355197319680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 935us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759645.642536:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2193 00000100:00100000:1.0:1782759645.646426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759645.646470:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319808 00000100:00100000:2.0:1782759645.646480:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319808 00000100:00100000:2.0:1782759645.646547:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 287 00000100:00100000:2.0:1782759645.646557:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105218:x1869355197319808:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:2.0:1782759645.651351:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105218:x1869355197319808:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 4784us (4922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759645.651365:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 287 00000100:00100000:3.0:1782759645.655849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759645.655914:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197319936 00000100:00100000:2.0:1782759645.655926:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197319936 00000100:00100000:2.0:1782759645.655981:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2194 00000100:00100000:2.0:1782759645.655991:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:105218:x1869355197319936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759645.656013:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759645.656032:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e034d lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670a8 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656097:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656112:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656128:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656155:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656192:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656201:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656884:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656891:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656896:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759645.656933:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1782759645.656936:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759645.656952:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656959:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656965:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656969:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656973:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.656984:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759645.657083:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657090:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657100:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:2.0:1782759645.657102:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759645.657105:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657110:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0354 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657118:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657121:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657124:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657128:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759645.657130:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657135:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657152:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x6a16dcec (ffff9171c08f6000) 00010000:00010000:2.0:1782759645.657154:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759645.657157:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657163:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e035b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657195:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91800/0xdd99f5c4777e034d lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670a8 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657208:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670a8 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759645.657215:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:2.0:1782759645.657217:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759645.657219:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759645.657289:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105218:x1869355197319936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1298us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759645.657297:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2194 00000100:00100000:1.0:1782759645.663965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759645.664035:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197320192 00000100:00100000:0.0:1782759645.664048:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197320192 00000100:00100000:0.0:1782759645.664113:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2195 00000100:00100000:0.0:1782759645.664123:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:105218:x1869355197320192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759645.664147:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759645.664168:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0369 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670af expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.664271:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e0370 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.664289:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e0370 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.664302:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e0370 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759645.664314:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1782759645.664477:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0369 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670af expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.664496:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e0370 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670af expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759645.664504:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:0.0:1782759645.664522:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759645.664527:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98800, rc 0) 00000100:00100000:0.0:1782759645.664605:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105218:x1869355197320192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 483us (820us total) trans 4294968136 rc 0/0 00000100:00100000:0.0:1782759645.664613:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2195 00000100:00100000:0.0:1782759645.667976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759645.668110:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197320448 00000100:00100000:1.0:1782759645.668121:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197320448 00000100:00100000:1.0:1782759645.668197:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2196 00000100:00100000:1.0:1782759645.668208:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105218:x1869355197320448:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759645.668266:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759645.668295:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e0370 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670af expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.668321:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0362 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670a8 expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.668332:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171c08f6200) 00010000:00010000:1.0:1782759645.668344:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759645.668372:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,1 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.668405:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.668415:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759645.669305:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].50, 88 off11536 00000004:00080000:1.0:1782759645.669318:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3714072494401ns, next at 3715072491633ns, rc = 0 00000004:00010000:1.0:1782759645.669400:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007dc87787 reply state 00000000f0875c34 transno 4294968137 ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759645.669410:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759645.669522:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105218:x1869355197320448:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1314us (1554us total) trans 4294968137 rc 0/0 00000100:00100000:1.0:1782759645.669530:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2196 00010000:00010000:1.0:1782759645.674792:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.674812:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.674865:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.674873:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759645.674878:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.674886:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.674927:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1f:0x0].0x0 (ffff9171889c5500) 00010000:00010000:1.0:1782759645.674931:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782759645.674935:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 2/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759645.674942:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e037e lrc: 0/0,0 mode: --/PW res: [0x200000418:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759645.675682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759645.675903:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197320704 00000100:00100000:2.0:1782759645.675913:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197320704 00000100:00100000:2.0:1782759645.675964:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 288 00000100:00100000:2.0:1782759645.675977:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:105218:x1869355197320704:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1782759645.676231:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:105218:x1869355197320704:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 257us (554us total) trans 4294968138 rc 0/0 00000100:00100000:2.0:1782759645.676237:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 288 00000100:00100000:3.0:1782759646.124390:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211999104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.124466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759646.124542:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759646.124549:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211999232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.124575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759646.124612:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211999360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.124645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759646.124668:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759646.124676:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211998976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.124711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759646.124734:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999104 00000100:00100000:2.0:1782759646.124743:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999104 00000100:00100000:2.0:1782759646.124782:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999232 00000100:00100000:2.0:1782759646.124785:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999232 00000100:00100000:2.0:1782759646.124818:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1782759646.124855:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:0.0:1782759646.124867:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211999232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759646.124922:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355211999232:12345-0@lo:400:kworker.0 Request processed in 58us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759646.124930:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00080000:1.0:1782759646.124945:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759646.124974:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999360 00000100:00100000:0.0:1782759646.124979:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999360 00000100:00100000:0.0:1782759646.125033:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1782759646.125039:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211999360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759646.125070:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355211999360:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759646.125076:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00080000:1.0:1782759646.125146:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759646.125284:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211999488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.125309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759646.125404:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355211999360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.125437:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355211999232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759646.125440:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211999104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759646.125503:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355211999104:12345-0@lo:400:kworker.0 Request processed in 70us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759646.125511:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211998976 00000100:00100000:2.0:1782759646.125512:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1782759646.125518:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211998976 00000100:00100000:0.0:1782759646.125571:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:0.0:1782759646.125577:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211998976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759646.125587:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999488 00000100:00100000:2.0:1782759646.125594:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999488 00000100:00100000:0.0:1782759646.125614:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355211998976:12345-0@lo:400:kworker.0 Request processed in 36us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759646.125622:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00080000:0.0:1782759646.125670:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759646.125676:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355211999104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759646.125701:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355211998976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759646.127084:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1782759646.127101:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211999488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759646.127274:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355211999488:12345-0@lo:400:kworker.0 Request processed in 179us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759646.127281:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:3.0:1782759646.129399:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355211999488:0@lo:400:kworker.0 00010000:00010000:2.0:1782759646.188238:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759646.636195:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759646.647620:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211999616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759646.647727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759646.647818:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999616 00000100:00100000:2.0:1782759646.647855:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999616 00000100:00100000:2.0:1782759646.647922:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1782759646.647933:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211999616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759646.647999:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759646.648068:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355211999616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759646.648076:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1782759646.648142:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355211999616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759647.212334:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759648.236290:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759648.444718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759648.444773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759648.444812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759648.444861:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197320832 00000100:00100000:0.0:1782759648.444871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759648.444875:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197320832 00000100:00100000:0.0:1782759648.444901:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321088 00000100:00100000:0.0:1782759648.444906:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321088 00000100:00100000:0.0:1782759648.444984:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321216 00000100:00100000:0.0:1782759648.444987:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321216 00000100:00100000:1.0:1782759648.444992:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2893 00000100:00100000:1.0:1782759648.445006:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197320832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759648.445021:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2119 00000100:00100000:0.0:1782759648.445033:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197321088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759648.445075:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197320960 00000100:00100000:2.0:1782759648.445081:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197320960 00000100:00100000:1.0:1782759648.445102:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197320832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759648.445111:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2893 00000100:00100000:2.0:1782759648.445190:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2672 00000100:00100000:2.0:1782759648.445202:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2363:x1869355197320960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759648.445336:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197321088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 306us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759648.445344:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2119 00000100:00100000:0.0:1782759648.445360:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2120 00000100:00100000:0.0:1782759648.445367:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197321216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759648.445395:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197321216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759648.445403:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2120 00000100:00100000:2.0:1782759648.445416:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2363:x1869355197320960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 215us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759648.445427:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2672 00000100:00080000:0.0:1782759648.445429:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759648.445443:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759648.445445:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1782759648.756025:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967408 is committed 00000001:00080000:1.0:1782759648.756048:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967407 is committed 00000100:00100000:0.0:1782759649.197216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759649.197260:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211999744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759649.197362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759649.197859:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999744 00000100:00100000:3.0:1782759649.197870:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999744 00000100:00100000:3.0:1782759649.197968:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1782759649.197980:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211999744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759649.198030:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759649.198119:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355211999744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759649.198127:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00080000:0.0:1782759649.198327:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759649.198379:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355211999744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759649.260001:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759650.285602:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759650.781554:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968136 is committed 00000001:00080000:0.0:1782759650.781577:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968137 is committed 00000004:00080000:0.0:1782759650.781583:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 123 committed 00000001:00080000:0.0:1782759650.781609:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968138 is committed 00000100:00100000:0.0:1782759650.783800:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759650.783848:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211999872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782759650.783924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759650.783967:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355211999872 00000100:00100000:1.0:1782759650.783977:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355211999872 00000100:00080000:0.0:1782759650.784028:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759650.784054:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1782759650.784109:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355211999872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782759650.784333:0:126932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782759650.784337:0:126932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb mtime from disk: 1782759631 -> 1782759631 00002000:00010000:1.0:1782759650.784340:0:126932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb atime from disk: 1782759631 -> 1782759631 00002000:00010000:1.0:1782759650.784342:0:126932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb ctime from disk: 1782759644 -> 1782759644 00002000:00010000:1.0:1782759650.784344:0:126932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x35:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782759650.784399:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355211999872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 336us (474us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1782759650.784475:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967408 gen 2 00000004:00080000:2.0:1782759650.784481:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917084d75c00, transno 4294967408 00000100:00100000:2.0:1782759650.784497:0:3308:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9171b33c2d80 x1869355211999872/t4294967409(4294967409) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782759666 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1782759650.784509:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b33c2d80/2, rc 0, transno 4294967409 00000100:00100000:2.0:1782759650.784514:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355211999872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782759650.789727:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000020:00000080:3.0:1782759651.182363:0:153450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1a5af180 20000000:00000080:3.0:1782759651.182380:0:153450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b76d5400 uarg=0000000000000000 00010000:00010000:3.0:1782759651.185656:0:153450:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759651.185717:0:153450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171c08f6b00) 00010000:00010000:3.0:1782759651.185721:0:153450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759651.185734:0:153450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0346 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670a1 expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.185755:0:153450:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782759651.185818:0:153450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759651.186038:0:153450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.186051:0:153450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.186059:0:153450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.186095:0:153450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.186109:0:153450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 18 pid: 5796 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759651.186124:0:153450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153450:1869355212000000:0@lo:104: 00000100:00100000:3.0:1782759651.186183:0:153450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759651.186239:0:153450:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759651.186318:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000000 00000100:00100000:0.0:1782759651.186326:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000000 00000100:00100000:0.0:1782759651.186408:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1782759651.186417:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:153450:x1869355212000000:12345-0@lo:104: 00010000:00010000:0.0:1782759651.186442:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.186510:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759651.186517:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:153450:x1869355212000000:12345-0@lo:104: Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759651.186524:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00010000:00010000:2.0:1782759651.186571:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759651.186579:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186587:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759651.186591:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186599:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759651.186607:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759651.186613:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759651.186641:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186658:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759651.186679:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186687:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5a00/0xdd99f5c4777e0307 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e030e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186702:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759651.186705:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759651.186707:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759651.186718:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212000128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759651.186748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759651.186783:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000128 00000100:00100000:2.0:1782759651.186787:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000128 00010000:00010000:2.0:1782759651.186808:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 19 pid: 5796 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759651.186855:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1782759651.186862:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212000128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759651.186873:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759651.186878:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 19 pid: 5796 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186887:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 19 pid: 5796 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186901:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186919:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186933:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186941:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186948:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186954:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186960:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759651.186964:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186972:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186980:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.186988:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759651.187018:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212000128:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759651.187025:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1782759651.187055:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212000128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759651.187158:0:153450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98400/0xdd99f5c4777e030e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0307 expref: 18 pid: 5796 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759651.187169:0:153450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153450:1869355212000000:0@lo:104: 00010000:00010000:3.0:1782759651.187182:0:153450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.187267:0:153450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.187275:0:153450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759651.187281:0:153450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bce800/0xdd99f5c4777e0385 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759651.244460:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759651.244488:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212000384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.244564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759651.244636:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212000256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.244749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759651.244817:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000384 00000100:00100000:1.0:1782759651.244844:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000384 00000100:00100000:1.0:1782759651.244901:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000256 00000100:00100000:1.0:1782759651.244904:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000256 00000100:00100000:1.0:1782759651.244933:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:1.0:1782759651.244944:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355212000384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.245001:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355212000384:12345-0@lo:400:kworker.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759651.245010:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:1.0:1782759651.245036:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:1.0:1782759651.245044:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355212000256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.245094:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869355212000256:12345-0@lo:400:kworker.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759651.245103:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00080000:1.0:1782759651.245129:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759651.245170:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212000384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.245188:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212000256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.246917:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212000640:0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.246960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759651.247042:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000640 00000100:00100000:3.0:1782759651.247049:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000640 00000100:00100000:3.0:1782759651.247103:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:3.0:1782759651.247112:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355212000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759651.247161:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355212000640:12345-0@lo:400:kworker.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759651.247168:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00080000:3.0:1782759651.247190:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759651.253943:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212000512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.253997:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212000640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759651.254044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759651.254192:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000512 00000100:00100000:1.0:1782759651.254200:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000512 00000100:00100000:1.0:1782759651.254255:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1782759651.254264:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212000512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759651.254321:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212000512:12345-0@lo:400:kworker.0 Request processed in 57us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759651.254328:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1782759651.254531:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212000512:0@lo:400:kworker.0 00000100:00080000:3.0:1782759651.255451:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759651.308298:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759651.757966:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212000768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759651.758038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759651.758115:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000768 00000100:00100000:3.0:1782759651.758123:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000768 00000100:00100000:3.0:1782759651.758175:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1782759651.758184:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355212000768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759651.758219:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759651.758266:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355212000768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759651.758273:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1782759651.758335:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212000768:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759651.919351:0:153498:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd15b2c1b0 20000000:00000080:2.0:1782759651.919370:0:153498:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917088d80400 uarg=0000000000000000 00010000:00010000:2.0:1782759651.919678:0:153498:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759651.919694:0:153498:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759651.919712:0:153498:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759651.919732:0:153498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919748:0:153498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919759:0:153498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919766:0:153498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919772:0:153498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919779:0:153498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919785:0:153498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759651.919789:0:153498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919798:0:153498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919846:0:153498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919855:0:153498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.919861:0:153498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e038c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759652.335278:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759652.547178:0:153547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5b8ea980 20000000:00000080:1.0:1782759652.547194:0:153547:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b5bc00 uarg=0000000000000000 00010000:00010000:1.0:1782759652.547400:0:153547:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759652.547428:0:153547:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759652.547447:0:153547:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759652.547465:0:153547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547482:0:153547:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547500:0:153547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547507:0:153547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547514:0:153547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547522:0:153547:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547528:0:153547:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759652.547532:0:153547:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547540:0:153547:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547551:0:153547:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547559:0:153547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.547565:0:153547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0393 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759653.164859:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759653.164867:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759653.164872:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759653.164925:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759653.164938:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759653.164950:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759653.164980:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212000896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759653.165043:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759653.165089:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759653.165210:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212000896 00000100:00100000:1.0:1782759653.165219:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212000896 00000100:00100000:1.0:1782759653.165284:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:1.0:1782759653.165294:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212000896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759653.165309:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759653.165321:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e039a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.165344:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.165354:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.165363:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5e00, rc 0) 00000100:00100000:1.0:1782759653.165424:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212000896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759653.165432:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:1.0:1782759653.165479:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212000896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759653.165492:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.165502:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759653.165520:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759653.165524:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.165532:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759653.176215:0:153595:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe40a7f1c0 20000000:00000080:2.0:1782759653.176232:0:153595:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917088d80400 uarg=0000000000000000 00010000:00010000:2.0:1782759653.176987:0:153595:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759653.177003:0:153595:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759653.177019:0:153595:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759653.177035:0:153595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.177051:0:153595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.177060:0:153595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.177094:0:153595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.177107:0:153595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 18 pid: 5793 timeout: 3821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759653.177134:0:153595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153595:1869355212001024:0@lo:104: 00000100:00100000:2.0:1782759653.177188:0:153595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759653.177267:0:153595:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759653.177307:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001024 00000100:00100000:3.0:1782759653.177314:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001024 00000100:00100000:3.0:1782759653.177512:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1782759653.177522:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:153595:x1869355212001024:12345-0@lo:104: 00010000:00010000:3.0:1782759653.177535:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759653.177608:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759653.177614:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:153595:x1869355212001024:12345-0@lo:104: Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759653.177621:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00010000:00010000:1.0:1782759653.177668:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759653.177675:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177683:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759653.177687:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177695:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759653.177703:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759653.177719:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759653.177746:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177752:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759653.177770:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177776:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082bce800/0xdd99f5c4777e039a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e03a1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177789:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759653.177791:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759653.177792:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759653.177802:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212001152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759653.177859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759653.177891:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001152 00000100:00100000:1.0:1782759653.177894:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001152 00010000:00010000:1.0:1782759653.177922:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 19 pid: 5793 timeout: 3821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759653.177943:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1782759653.177949:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917182c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212001152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759653.177959:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759653.177964:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 19 pid: 5793 timeout: 3821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177975:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 19 pid: 5793 timeout: 3821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177989:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.177997:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178008:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178014:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178021:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178027:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178038:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759653.178042:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178049:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178057:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759653.178069:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759653.178093:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917182c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212001152:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759653.178099:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1782759653.178153:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212001152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759653.178234:0:153595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03a1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e039a expref: 18 pid: 5793 timeout: 3821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759653.178244:0:153595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153595:1869355212001024:0@lo:104: 00010000:00010000:2.0:1782759653.178255:0:153595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.178263:0:153595:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.178270:0:153595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.178276:0:153595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e03a8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.355966:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759653.556678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759653.556877:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321472 00000100:00100000:0.0:1782759653.556878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759653.556889:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321472 00000100:00100000:0.0:1782759653.556952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759653.556966:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2676 00000100:00100000:2.0:1782759653.556980:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197321472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759653.556985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759653.557141:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197321472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 163us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.557150:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2676 00000100:00080000:2.0:1782759653.557199:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759653.559997:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321344 00000100:00100000:0.0:1782759653.560009:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321344 00000100:00100000:0.0:1782759653.560054:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2895 00000100:00100000:0.0:1782759653.560063:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197321344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759653.560117:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197321344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 55us (3166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759653.560124:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2895 00000100:00100000:3.0:1782759653.563498:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321728 00000100:00100000:2.0:1782759653.563510:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321600 00000100:00100000:3.0:1782759653.563511:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321728 00000100:00100000:2.0:1782759653.563518:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321600 00000100:00100000:2.0:1782759653.563644:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2122 00000100:00100000:2.0:1782759653.563655:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197321600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759653.563731:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197321600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (6748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.563738:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2122 00000100:00080000:0.0:1782759653.563787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759653.569688:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2123 00000100:00100000:2.0:1782759653.569700:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197321728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759653.569842:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759653.569964:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197321728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 264us (13139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.569971:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2123 00000001:00080000:1.0:1782759653.875851:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967409 is committed 00000100:00100000:0.0:1782759654.316321:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212001280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759654.316398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759654.316839:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001280 00000100:00100000:2.0:1782759654.316847:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001280 00000100:00100000:2.0:1782759654.316907:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:2.0:1782759654.316930:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212001280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759654.316965:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782759654.318037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759654.320366:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212001280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3441us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759654.320389:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1782759654.320983:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212001280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759654.380058:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759655.084974:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759655.084983:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759655.084988:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759655.085048:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085124:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085137:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759655.085164:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212001408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759655.085244:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759655.085302:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b28c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759655.085323:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001408 00000100:00100000:1.0:1782759655.085330:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001408 00000100:00100000:1.0:1782759655.085383:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:1.0:1782759655.085393:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212001408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759655.085423:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759655.085436:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e03af expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085459:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085470:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085478:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759655.085515:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212001408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759655.085521:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:1.0:1782759655.085648:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212001408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759655.085662:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085671:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759655.085689:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759655.085700:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.085708:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.404757:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759656.023265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759656.023368:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321856 00000100:00100000:3.0:1782759656.023380:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321856 00000100:00100000:3.0:1782759656.023468:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2197 00000100:00100000:3.0:1782759656.023482:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:105738:x1869355197321856:12345-192.168.204.31@tcp:48:lfs.0 00000100:00080000:0.0:1782759656.024199:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759656.203190:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:105738:x1869355197321856:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 179702us (179925us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759656.203205:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2197 00000100:00100000:1.0:1782759656.364312:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212001664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759656.364397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759656.364455:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212002176:0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.364623:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212001536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.364660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759656.364720:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212002048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.364745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759656.364771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759656.364777:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212001920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.364804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759656.364859:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001664 00000100:00100000:3.0:1782759656.364867:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001664 00000100:00100000:3.0:1782759656.364912:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002048 00000100:00100000:3.0:1782759656.364915:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002048 00000100:00100000:3.0:1782759656.364945:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1782759656.364955:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355212001664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.365022:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355212001664:12345-0@lo:400:kworker.0 Request processed in 68us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759656.365044:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1782759656.365060:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1782759656.365065:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355212002048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.365095:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869355212002048:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759656.365101:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1782759656.365119:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001536 00000100:00100000:3.0:1782759656.365122:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001536 00000100:00100000:3.0:1782759656.365147:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:3.0:1782759656.365153:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212001536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759656.365179:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212001536:12345-0@lo:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759656.365185:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00100000:1.0:1782759656.365629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759656.365673:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212001664:0@lo:400:kworker.0 00000100:00080000:2.0:1782759656.366039:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759656.366068:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001920 00000100:00100000:2.0:1782759656.366072:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001920 00000100:00100000:2.0:1782759656.366107:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002176 00000100:00100000:2.0:1782759656.366110:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002176 00000100:00100000:2.0:1782759656.366131:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:2.0:1782759656.366138:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212001920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.366177:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212001920:12345-0@lo:400:kworker.0 Request processed in 39us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759656.366183:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:2.0:1782759656.366324:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1782759656.366343:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212002176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.366380:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212002176:12345-0@lo:400:kworker.0 Request processed in 50us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759656.366385:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00080000:2.0:1782759656.366409:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759656.366411:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759656.366444:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212001920:0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.366455:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212001536:0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.366542:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212002048:0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.366591:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212001792:0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.366623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759656.366652:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212001792 00000100:00100000:2.0:1782759656.366656:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212001792 00000100:00100000:2.0:1782759656.366683:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:2.0:1782759656.366689:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355212001792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759656.366810:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967409 gen 2 00000004:00080000:1.0:1782759656.366817:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b33c2d80, transno 4294967409 00000100:00100000:1.0:1782759656.366840:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212002176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759656.368157:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869355212001792:12345-0@lo:400:kworker.0 Request processed in 1463us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759656.368180:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00080000:2.0:1782759656.368229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759656.369451:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212001792:0@lo:400:kworker.0 00010000:00010000:2.0:1782759656.428161:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759656.877049:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759656.877077:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212002304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759656.877148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759656.877492:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002304 00000100:00100000:3.0:1782759656.877501:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002304 00000100:00100000:3.0:1782759656.877558:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1782759656.877568:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212002304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759656.877603:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759656.877660:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212002304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759656.877675:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1782759656.877797:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212002304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759657.467493:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759657.955265:0:153795:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64i: Nodemap quota enforcement with local_admin RBAC and offsets ========================================================== 15:00:55 (1782759655) 00010000:00010000:1.0:1782759658.476103:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759658.676211:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759658.676251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759658.676301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759658.676334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759658.676359:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197322368 00000100:00100000:3.0:1782759658.676360:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197322240 00000100:00100000:2.0:1782759658.676369:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197322368 00000100:00100000:3.0:1782759658.676380:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197322240 00000100:00100000:0.0:1782759658.676462:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197322112 00000100:00100000:0.0:1782759658.676467:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197322112 00000100:00100000:2.0:1782759658.676498:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2126 00000100:00100000:0.0:1782759658.676498:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2680 00000100:00100000:2.0:1782759658.676508:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197322368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759658.676511:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197322112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759658.676957:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197322112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 445us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759658.676966:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2680 00000100:00100000:3.0:1782759658.679504:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2127 00000100:00100000:3.0:1782759658.679524:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197322240:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759658.679630:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197322368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 3120us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.679640:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2126 00000100:00080000:2.0:1782759658.679673:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759658.679679:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759658.679682:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759658.679922:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197321984 00000100:00100000:2.0:1782759658.679930:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197321984 00000100:00100000:2.0:1782759658.679962:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2898 00000100:00100000:2.0:1782759658.679969:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197321984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759658.679996:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197321984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.680002:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2898 00000100:00100000:3.0:1782759658.687055:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197322240:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 7526us (10709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759658.687073:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2127 00000004:00000400:0.0:1782759659.123513:0:153843:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1782759659.123520:0:153843:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:1.0:1782759659.436256:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759659.436289:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212002432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759659.436356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759659.436464:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002432 00000100:00100000:2.0:1782759659.436472:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002432 00000100:00100000:2.0:1782759659.437914:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1782759659.437927:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212002432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759659.437976:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759659.438035:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212002432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759659.438042:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1782759659.438096:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212002432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759659.445730:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759659.500181:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759660.523956:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759661.206972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759661.207087:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197322624 00000100:00100000:2.0:1782759661.207098:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197322624 00000100:00100000:2.0:1782759661.207176:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2198 00000100:00100000:2.0:1782759661.207187:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:106000:x1869355197322624:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759661.207252:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759661.207257:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e0059) 00010000:00010000:2.0:1782759661.207259:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759661.207530:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.207561:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.207575:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.207627:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.207635:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.207642:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759661.208524:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 512 00010000:00010000:2.0:1782759661.208536:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.208544:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.208551:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.208557:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759661.208562:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.208570:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.208582:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6f00) 00010000:00010000:2.0:1782759661.208585:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759661.208588:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.208594:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759661.208612:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ad18a0d reply state 00000000ceb42ed6 transno 4294968139 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759661.208620:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759661.208704:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106000:x1869355197322624:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 1517us (1741us total) trans 4294968139 rc 0/0 00000100:00100000:2.0:1782759661.208721:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2198 00000100:00080000:3.0:1782759661.208954:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759661.210500:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759661.210515:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759661.210522:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759661.210527:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759661.210532:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759661.210538:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759661.210566:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff9171c08f6a00) 00010000:00010000:3.0:1782759661.210570:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759661.210575:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759661.210582:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e03c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759661.247674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759661.247715:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197322752 00000100:00100000:1.0:1782759661.247724:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197322752 00000100:00100000:1.0:1782759661.247773:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2199 00000100:00100000:1.0:1782759661.247790:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:106001:x1869355197322752:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:1.0:1782759661.247815:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759661.247853:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e03cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670b6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759661.247910:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e03d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759661.247923:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e03d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759661.247934:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e03d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759661.247990:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1782759661.247994:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759661.248031:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e03d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759661.248055:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e03cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670b6 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759661.248070:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e03d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670b6 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759661.248079:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759661.248082:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759661.248086:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782759661.248140:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106001:x1869355197322752:12345-192.168.204.31@tcp:101:chown.0 Request processed in 352us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759661.248154:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2199 00000100:00100000:1.0:1782759661.255749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759661.256116:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197322880 00000100:00100000:0.0:1782759661.256127:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197322880 00000100:00100000:0.0:1782759661.256187:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2200 00000100:00100000:0.0:1782759661.256197:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106001:x1869355197322880:12345-192.168.204.31@tcp:101:chown.0 00010000:00010000:0.0:1782759661.256218:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759661.256253:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e03d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670bd expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256314:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256328:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256340:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256353:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256361:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256379:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256481:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777e03ee lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256488:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777e03ee lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256495:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777e03ee lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759661.256535:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 512 00000004:00200000:0.0:1782759661.256539:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759661.256578:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777e03ee lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256590:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256597:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256604:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256611:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759661.256614:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256622:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256642:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5300) 00010000:00010000:0.0:1782759661.256644:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759661.256649:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256654:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99e00/0xdd99f5c4777e03e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256665:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256672:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256677:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.256681:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759661.256684:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.257142:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.257153:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff917183a70f00) 00010000:00010000:0.0:1782759661.257155:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759661.257158:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.257164:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98200/0xdd99f5c4777e03e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.257206:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99200/0xdd99f5c4777e03d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670bd expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.257221:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777e03ee lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670bd expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759661.257228:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759661.257230:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759661.257244:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99c00, rc 0) 00000100:00100000:0.0:1782759661.257314:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106001:x1869355197322880:12345-192.168.204.31@tcp:101:chown.0 Request processed in 1118us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759661.257321:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2200 00000100:00100000:3.0:1782759661.279087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759661.279490:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323136 00000100:00100000:2.0:1782759661.279501:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323136 00000100:00100000:2.0:1782759661.279549:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2201 00000100:00100000:2.0:1782759661.280659:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106001:x1869355197323136:12345-192.168.204.31@tcp:36:chown.0 00010000:00010000:2.0:1782759661.280893:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759661.280923:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99c00/0xdd99f5c4777e03ee lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670bd expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.280942:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917183a70600) 00010000:00010000:2.0:1782759661.280954:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759661.280980:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.280994:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.281003:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759661.369797:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001caea37e reply state 000000001adcecae transno 4294968140 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759661.369816:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759661.369998:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 7680 00000100:00100000:1.0:1782759661.370125:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:106001:x1869355197323136:12345-192.168.204.31@tcp:36:chown.0 Request processed in 89471us (91042us total) trans 4294968140 rc 0/0 00000100:00100000:1.0:1782759661.370135:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2201 00000001:00080000:1.0:1782759661.370607:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968140 is committed 00010000:00010000:2.0:1782759661.371462:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.371475:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.371482:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.371487:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759661.371504:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.371513:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.371529:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171c08f6f00) 00010000:00010000:2.0:1782759661.371532:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759661.371537:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759661.371543:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e03f5 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759661.484950:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212002688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759661.485022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759661.485080:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212003200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759661.485108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759661.485131:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759661.485136:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212002816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759661.485158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759661.485273:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212002944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759661.485305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759661.485328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759661.485334:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212002560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759661.485362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759661.485384:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212003072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759661.485412:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003200 00000100:00100000:0.0:1782759661.485419:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003200 00000100:00100000:0.0:1782759661.485467:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002944 00000100:00100000:0.0:1782759661.485470:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002944 00000100:00100000:0.0:1782759661.485498:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1782759661.485507:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212003200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759661.485558:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212003200:12345-0@lo:400:kworker.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759661.485577:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1782759661.485596:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1782759661.485602:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759661.485640:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212002944:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759661.485646:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1782759661.485663:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002560 00000100:00100000:0.0:1782759661.485667:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002560 00000100:00100000:0.0:1782759661.485690:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1782759661.485696:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212002560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759661.485744:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212002560:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759661.485750:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00080000:0.0:1782759661.485775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759661.485779:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759661.496058:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212003200:0@lo:400:kworker.0 00000100:00100000:1.0:1782759661.496182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759661.499312:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002688 00000100:00100000:3.0:1782759661.499332:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002688 00000100:00100000:0.0:1782759661.499473:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212002816 00000100:00100000:0.0:1782759661.499479:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212002816 00000100:00100000:3.0:1782759661.499558:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1782759661.499569:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355212002688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759661.499660:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355212002688:12345-0@lo:400:kworker.0 Request processed in 94us (14638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759661.499667:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1782759661.503271:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:3.0:1782759661.503302:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355212002816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759661.503403:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355212002816:12345-0@lo:400:kworker.0 Request processed in 117us (18243us total) trans 0 rc 0/0 00000100:00080000:0.0:1782759661.507351:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759661.507619:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212002816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759661.507637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212002688:0@lo:400:kworker.0 00000100:00100000:1.0:1782759661.508282:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212002944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759661.508302:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212002560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759661.508386:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:3.0:1782759661.508418:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003072 00000100:00100000:3.0:1782759661.508426:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003072 00000100:00100000:3.0:1782759661.508607:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1782759661.508618:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355212003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759661.508695:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355212003072:12345-0@lo:400:kworker.0 Request processed in 80us (12515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759661.508702:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00080000:0.0:1782759661.508770:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759661.508993:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212003072:0@lo:400:kworker.0 00010000:00010000:1.0:1782759661.549128:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759661.996463:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212003328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759661.996545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759661.996653:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003328 00000100:00100000:3.0:1782759661.996661:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003328 00000100:00100000:3.0:1782759661.996714:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1782759661.996724:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212003328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759661.996758:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759661.996815:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212003328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759661.996840:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1782759661.996885:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212003328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759662.572970:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759663.596233:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759663.804154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759663.804205:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323264 00000100:00100000:1.0:1782759663.804214:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323264 00000100:00100000:1.0:1782759663.804261:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2900 00000100:00100000:1.0:1782759663.804341:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197323264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759663.804409:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197323264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759663.804428:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2900 00000100:00100000:1.0:1782759663.804489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759663.804783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759663.804933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759663.806445:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323392 00000100:00100000:0.0:1782759663.806456:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323392 00000100:00080000:1.0:1782759663.806515:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759663.806519:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2684 00000100:00100000:0.0:1782759663.806529:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197323392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759663.806601:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197323392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.806608:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2684 00000100:00100000:0.0:1782759663.806635:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323520 00000100:00100000:0.0:1782759663.806638:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323520 00000100:00100000:0.0:1782759663.806662:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323648 00000100:00100000:0.0:1782759663.806665:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323648 00000100:00100000:0.0:1782759663.806681:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2130 00000100:00100000:0.0:1782759663.806687:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197323520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759663.806711:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197323520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.806718:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2130 00000100:00100000:0.0:1782759663.806727:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2131 00000100:00100000:0.0:1782759663.806732:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197323648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759663.806749:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197323648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 17us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.806755:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2131 00000100:00080000:1.0:1782759663.810812:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759663.810835:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759664.555990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759664.556011:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212003456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759664.556074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759664.556243:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003456 00000100:00100000:2.0:1782759664.556251:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003456 00000100:00100000:2.0:1782759664.556320:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1782759664.556330:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212003456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759664.556373:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759664.556429:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212003456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759664.556437:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1782759664.556524:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212003456:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759664.556570:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759664.619993:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759664.631704:0:154147:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee351b6d0 20000000:00000080:1.0:1782759664.631720:0:154147:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b5bc00 uarg=0000000000000000 10000000:01000000:1.0:1782759664.632370:0:154147:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759664.632391:0:154147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.632410:0:154147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.632419:0:154147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.632455:0:154147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.632470:0:154147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 18 pid: 5796 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759664.632485:0:154147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154147:1869355212003584:0@lo:104: 00000100:00100000:1.0:1782759664.632541:0:154147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759664.632681:0:154147:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759664.632724:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003584 00000100:00100000:0.0:1782759664.632730:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003584 00000100:00100000:0.0:1782759664.632953:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1782759664.632965:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154147:x1869355212003584:12345-0@lo:104: 00010000:00010000:0.0:1782759664.632977:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759664.633080:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759664.633087:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154147:x1869355212003584:12345-0@lo:104: Request processed in 125us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759664.633094:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00010000:00010000:2.0:1782759664.633136:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759664.633144:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633161:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759664.633165:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633183:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759664.633190:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759664.633196:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759664.633225:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633231:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759664.633250:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633257:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c5200/0xdd99f5c4777e03af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e03b6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633272:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759664.633280:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759664.633282:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759664.633299:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212003712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759664.633329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759664.633371:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003712 00000100:00100000:2.0:1782759664.633375:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003712 00010000:00010000:2.0:1782759664.633394:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 19 pid: 5796 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759664.633415:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1782759664.633421:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212003712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759664.633430:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759664.633435:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 19 pid: 5796 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633445:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 19 pid: 5796 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633461:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633470:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633482:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633488:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633494:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633506:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633512:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759664.633516:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633524:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633533:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759664.633542:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759664.633568:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212003712:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759664.633575:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1782759664.633607:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212003712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759664.633741:0:154147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5a00/0xdd99f5c4777e03b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e03af expref: 18 pid: 5796 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759664.633753:0:154147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154147:1869355212003584:0@lo:104: 00010000:00010000:1.0:1782759664.633765:0:154147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.633774:0:154147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.633780:0:154147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759664.633787:0:154147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5e00/0xdd99f5c4777e03fc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759665.370258:0:154195:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffbbb8d3f0 20000000:00000080:3.0:1782759665.370275:0:154195:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082734400 uarg=0000000000000000 10000000:01000000:3.0:1782759665.370487:0:154195:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759665.370510:0:154195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370526:0:154195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370536:0:154195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370543:0:154195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370551:0:154195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370557:0:154195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370575:0:154195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcec00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759665.370579:0:154195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370587:0:154195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370604:0:154195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370611:0:154195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.370617:0:154195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bcec00/0xdd99f5c4777e0403 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759665.644528:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759666.028195:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759666.028203:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759666.028208:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759666.028250:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.028263:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.028274:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759666.028298:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212003840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759666.028377:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759666.028443:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759666.028604:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003840 00000100:00100000:2.0:1782759666.028611:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003840 00000100:00100000:2.0:1782759666.028663:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:2.0:1782759666.028673:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212003840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759666.028687:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759666.028700:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e040a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.028724:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.028742:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.028752:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90200, rc 0) 00000100:00100000:2.0:1782759666.030333:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212003840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1655us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759666.030344:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1782759666.030465:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212003840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759666.030496:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.030509:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759666.030532:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759666.030538:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.030546:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759666.604711:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212003968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.604797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759666.604871:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212004480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.604901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759666.604928:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782759666.604933:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212004096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.604956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759666.604973:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212004608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.604998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759666.605023:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212004224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759666.605065:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759666.605071:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212004352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759666.605121:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212003968 00000100:00100000:0.0:1782759666.605148:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212003968 00000100:00100000:0.0:1782759666.605193:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:0.0:1782759666.605202:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212003968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605255:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212003968:12345-0@lo:400:kworker.0 Request processed in 54us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759666.605262:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:0.0:1782759666.605297:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004480 00000100:00100000:0.0:1782759666.605301:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004480 00000100:00100000:0.0:1782759666.605333:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004096 00000100:00100000:0.0:1782759666.605337:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004096 00000100:00100000:0.0:1782759666.605353:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004224 00000100:00100000:0.0:1782759666.605356:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004224 00000100:00100000:0.0:1782759666.605374:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:0.0:1782759666.605386:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355212004480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605420:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869355212004480:12345-0@lo:400:kworker.0 Request processed in 34us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759666.605426:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:0.0:1782759666.605439:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:0.0:1782759666.605444:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355212004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605486:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869355212004096:12345-0@lo:400:kworker.0 Request processed in 42us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759666.605492:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:0.0:1782759666.605504:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1782759666.605510:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355212004224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605542:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869355212004224:12345-0@lo:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759666.605547:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1782759666.605567:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004608 00000100:00100000:0.0:1782759666.605570:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004608 00000100:00100000:0.0:1782759666.605594:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004352 00000100:00100000:0.0:1782759666.605597:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004352 00000100:00100000:0.0:1782759666.605617:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1782759666.605623:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212004608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605653:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212004608:12345-0@lo:400:kworker.0 Request processed in 30us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759666.605658:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1782759666.605669:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1782759666.605674:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212004352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605702:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212004352:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759666.605715:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00080000:0.0:1782759666.605735:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759666.605739:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759666.605741:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759666.605782:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212004352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605791:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212004224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605851:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212004096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605864:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212004608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605871:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212003968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759666.605880:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212004480:0@lo:400:kworker.0 00010000:00010000:2.0:1782759666.672920:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759667.117016:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212004736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759667.117088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759667.117211:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004736 00000100:00100000:3.0:1782759667.117218:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004736 00000100:00100000:3.0:1782759667.117277:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1782759667.117296:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212004736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759667.117331:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759667.117382:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212004736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759667.117390:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1782759667.117435:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212004736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759667.691928:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759668.145891:0:154343:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb3533120 20000000:00000080:3.0:1782759668.145908:0:154343:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082736c00 uarg=0000000000000000 10000000:01000000:0.0:1782759668.146577:0:154343:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759668.146596:0:154343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759668.146613:0:154343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759668.146622:0:154343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759668.146660:0:154343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759668.146685:0:154343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 18 pid: 5794 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759668.146701:0:154343:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154343:1869355212004864:0@lo:104: 00000100:00100000:0.0:1782759668.146789:0:154343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.146919:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004864 00000100:00100000:3.0:1782759668.146927:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004864 00000100:00100000:3.0:1782759668.146970:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1782759668.146979:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154343:x1869355212004864:12345-0@lo:104: 00010000:00010000:3.0:1782759668.146992:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759668.147015:0:154343:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90b40 going to sleep for 11 seconds 00010000:00010000:3.0:1782759668.147058:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759668.147058:0:154343:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154343:1869355212004864:0@lo:104: 00000100:00100000:3.0:1782759668.147064:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154343:x1869355212004864:12345-0@lo:104: Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.147070:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00010000:00010000:0.0:1782759668.147076:0:154343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.147127:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759668.147135:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.147142:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcec00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759668.147146:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.147155:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759668.147162:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759668.147178:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759668.147213:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.147219:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759668.147244:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.147251:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082bcec00/0xdd99f5c4777e040a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0411 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.147264:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759668.147266:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759668.147267:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759668.147407:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759668.147419:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212004992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759668.147450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759668.147631:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212004992 00000100:00100000:1.0:1782759668.147636:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212004992 00010000:00010000:1.0:1782759668.147658:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 19 pid: 5794 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759668.147718:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1782759668.148308:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212004992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759668.148384:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759668.148391:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 19 pid: 5794 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148402:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 19 pid: 5794 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148416:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e0411 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e040a expref: 19 pid: 5794 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148439:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148447:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148460:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148467:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148474:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148480:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148485:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759668.148489:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.148496:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759668.149030:0:154343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759668.149039:0:154343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.150297:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.150321:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0418 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.150353:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759668.150429:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212004992:12345-0@lo:103:ldlm_bl.0 Request processed in 2121us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759668.150438:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1782759668.155554:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212004992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759668.716038:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759668.918585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759668.918630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759668.918665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759668.918691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759668.918723:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324160 00000100:00100000:1.0:1782759668.918733:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324160 00000100:00100000:1.0:1782759668.918787:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324032 00000100:00100000:1.0:1782759668.918791:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324032 00000100:00100000:1.0:1782759668.918817:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2134 00000100:00100000:1.0:1782759668.918852:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171c0959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197324160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759668.918919:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171c0959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197324160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759668.918927:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2134 00000100:00100000:3.0:1782759668.918941:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2135 00000100:00100000:3.0:1782759668.918956:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197324032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759668.918990:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197324032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.918998:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2135 00000100:00080000:1.0:1782759668.919141:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759668.919145:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759668.919320:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323904 00000100:00100000:2.0:1782759668.919325:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323904 00000100:00100000:2.0:1782759668.919380:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2688 00000100:00100000:2.0:1782759668.919388:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197323904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759668.919423:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197323904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759668.919429:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2688 00000100:00100000:2.0:1782759668.919446:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197323776 00000100:00100000:2.0:1782759668.919449:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197323776 00000100:00100000:2.0:1782759668.919496:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2903 00000100:00100000:2.0:1782759668.919504:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197323776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759668.919533:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197323776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759668.919540:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2903 00000100:00080000:1.0:1782759668.919632:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782759668.940280:0:154391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7eaac360 20000000:00000080:1.0:1782759668.940298:0:154391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917185b59000 uarg=0000000000000000 10000000:01000000:1.0:1782759668.940558:0:154391:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759668.940580:0:154391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940596:0:154391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940615:0:154391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940623:0:154391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940631:0:154391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940638:0:154391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940645:0:154391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759668.940650:0:154391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940659:0:154391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940673:0:154391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940680:0:154391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.940686:0:154391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5800/0xdd99f5c4777e041f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759669.165753:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759669.165762:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759669.165767:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759669.165810:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.165839:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.165852:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759669.165877:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212005120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759669.165946:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759669.165992:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719059a600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759669.166201:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005120 00000100:00100000:3.0:1782759669.166209:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005120 00000100:00100000:3.0:1782759669.166253:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1782759669.166261:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212005120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759669.166274:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759669.166286:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0426 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759669.166310:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759669.166322:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759669.166341:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf800, rc 0) 00000100:00100000:3.0:1782759669.166386:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212005120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759669.166394:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:2.0:1782759669.166627:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212005120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759669.166648:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.166657:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759669.166674:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759669.166686:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.166694:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782759669.587509:0:154439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeae28f6e0 20000000:00000080:0.0:1782759669.587525:0:154439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084eed000 uarg=0000000000000000 10000000:01000000:0.0:1782759669.587718:0:154439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759669.587736:0:154439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.587755:0:154439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.587765:0:154439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.587800:0:154439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.587813:0:154439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 18 pid: 5796 timeout: 3837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759669.587861:0:154439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154439:1869355212005248:0@lo:104: 00000100:00100000:0.0:1782759669.587921:0:154439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759669.587972:0:154439:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759669.588059:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005248 00000100:00100000:1.0:1782759669.588066:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005248 00000100:00100000:1.0:1782759669.588132:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1782759669.588140:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154439:x1869355212005248:12345-0@lo:104: 00010000:00010000:1.0:1782759669.588152:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588210:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759669.588216:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154439:x1869355212005248:12345-0@lo:104: Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759669.588224:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00010000:00010000:1.0:1782759669.588251:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759669.588256:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588263:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759669.588266:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588274:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759669.588280:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759669.588285:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759669.588311:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588317:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759669.588337:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588353:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e0426 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e042d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588366:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759669.588368:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759669.588370:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759669.588388:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212005376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759669.588418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759669.588449:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005376 00000100:00100000:1.0:1782759669.588453:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005376 00010000:00010000:1.0:1782759669.588469:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 19 pid: 5796 timeout: 3837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759669.588490:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1782759669.588496:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212005376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759669.588505:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759669.588509:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 19 pid: 5796 timeout: 3837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588520:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 19 pid: 5796 timeout: 3837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588535:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588544:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588566:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588574:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588580:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588587:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588592:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759669.588596:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588603:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588611:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.588619:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759669.588644:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212005376:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759669.588650:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1782759669.588685:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212005376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759669.588958:0:154439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bcf800/0xdd99f5c4777e042d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0426 expref: 18 pid: 5796 timeout: 3837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759669.588969:0:154439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154439:1869355212005248:0@lo:104: 00010000:00010000:2.0:1782759669.588981:0:154439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.588991:0:154439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.588998:0:154439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.589004:0:154439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f99a00/0xdd99f5c4777e0434 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759669.678891:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759669.678915:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212005504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759669.678986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759669.679045:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005504 00000100:00100000:2.0:1782759669.679051:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005504 00000100:00100000:2.0:1782759669.679114:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1782759669.679122:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212005504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759669.679156:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759669.679204:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212005504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759669.679210:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00080000:2.0:1782759669.679229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759669.679263:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212005504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759669.745524:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759670.245139:0:154488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe152f2670 20000000:00000080:3.0:1782759670.245157:0:154488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917088d83400 uarg=0000000000000000 10000000:01000000:3.0:1782759670.245354:0:154488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759670.245375:0:154488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245392:0:154488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245401:0:154488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245408:0:154488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245414:0:154488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245420:0:154488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245427:0:154488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfe00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759670.245431:0:154488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245450:0:154488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245463:0:154488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245470:0:154488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759670.245477:0:154488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bcfe00/0xdd99f5c4777e043b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.767369:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759671.043579:0:154536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed861c310 20000000:00000080:0.0:1782759671.043595:0:154536:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084eee000 uarg=0000000000000000 00010000:00010000:0.0:1782759671.043800:0:154536:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759671.043848:0:154536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5300) 00010000:00010000:0.0:1782759671.043852:0:154536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759671.043862:0:154536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5c00/0xdd99f5c4777e03d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670b6 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043884:0:154536:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782759671.043897:0:154536:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759671.043912:0:154536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043924:0:154536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043933:0:154536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043939:0:154536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043946:0:154536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043953:0:154536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043965:0:154536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759671.043969:0:154536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043978:0:154536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043988:0:154536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.043996:0:154536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.044003:0:154536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98600/0xdd99f5c4777e0442 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759671.469265:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759671.469271:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759671.469276:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759671.469320:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759671.469332:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759671.469357:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759671.469385:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212005632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759671.469459:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759671.469511:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759671.469665:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005632 00000100:00100000:2.0:1782759671.469674:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005632 00000100:00100000:2.0:1782759671.469735:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1782759671.469746:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212005632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759671.469762:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759671.469779:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0449 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759671.469803:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759671.469815:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759671.469850:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782759671.469897:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212005632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759671.469904:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1782759671.469946:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212005632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759671.469960:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759671.469981:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759671.470001:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759671.470005:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759671.470012:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759671.729238:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212005760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759671.729357:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212006272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759671.729410:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759671.729416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212005888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759671.729454:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212006400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759671.729514:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212006016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759671.729567:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759671.729572:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212006144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759671.729627:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005760 00000100:00100000:0.0:1782759671.729634:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005760 00000100:00100000:0.0:1782759671.729673:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1782759671.729680:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212005760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729729:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212005760:12345-0@lo:400:kworker.0 Request processed in 49us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759671.729736:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1782759671.729765:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212006272 00000100:00100000:0.0:1782759671.729769:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212006272 00000100:00100000:0.0:1782759671.729800:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212005888 00000100:00100000:0.0:1782759671.729803:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212005888 00000100:00100000:0.0:1782759671.729838:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212006016 00000100:00100000:0.0:1782759671.729841:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212006016 00000100:00100000:0.0:1782759671.729862:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1782759671.729868:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355212006272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729899:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869355212006272:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759671.729905:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1782759671.729918:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1782759671.729925:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355212005888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.729948:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869355212005888:12345-0@lo:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759671.729952:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1782759671.729969:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1782759671.729974:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355212006016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730002:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869355212006016:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759671.730007:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1782759671.730041:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212006400 00000100:00100000:0.0:1782759671.730044:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212006400 00000100:00100000:0.0:1782759671.730070:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212006144 00000100:00100000:0.0:1782759671.730073:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212006144 00000100:00100000:0.0:1782759671.730093:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1782759671.730098:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212006400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730129:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212006400:12345-0@lo:400:kworker.0 Request processed in 31us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759671.730135:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1782759671.730145:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1782759671.730150:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212006144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730174:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212006144:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759671.730179:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00080000:0.0:1782759671.730195:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759671.730198:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759671.730200:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759671.730239:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212006144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730248:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212006016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730273:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212005888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730283:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212006400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730307:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212005760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759671.730320:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212006272:0@lo:400:kworker.0 00010000:00010000:1.0:1782759671.789400:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759672.237198:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212006528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759672.237277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759672.237533:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212006528 00000100:00100000:0.0:1782759672.237542:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212006528 00000100:00100000:0.0:1782759672.237594:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1782759672.237603:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212006528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759672.237642:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759672.237707:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212006528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759672.237714:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1782759672.237800:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212006528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759672.815449:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759673.843984:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759674.038537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759674.038580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759674.038611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759674.038703:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324288 00000100:00100000:3.0:1782759674.038714:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324288 00000100:00100000:0.0:1782759674.038743:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324544 00000100:00100000:0.0:1782759674.038749:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324544 00000100:00100000:1.0:1782759674.038788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759674.038818:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324672 00000100:00100000:0.0:1782759674.038847:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324672 00000100:00100000:3.0:1782759674.038853:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2907 00000100:00100000:1.0:1782759674.038854:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2138 00000100:00100000:3.0:1782759674.038866:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197324288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759674.038866:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197324544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759674.038878:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2139 00000100:00100000:0.0:1782759674.038888:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197324672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759674.039312:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197324672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 424us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759674.039320:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197324544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 446us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759674.039322:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197324288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 459us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.039325:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2139 00000100:00100000:1.0:1782759674.039334:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2138 00000100:00100000:3.0:1782759674.039337:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2907 00000100:00080000:1.0:1782759674.039356:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759674.039360:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759674.039719:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324416 00000100:00100000:2.0:1782759674.039724:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324416 00000100:00100000:3.0:1782759674.039969:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2692 00000100:00100000:3.0:1782759674.039978:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197324416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759674.040027:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197324416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759674.040033:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2692 00000100:00080000:1.0:1782759674.040439:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1782759674.708041:0:154732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda164fad0 20000000:00000080:0.0:1782759674.708063:0:154732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff917084eec800 uarg=0000000000000000 20000000:01000000:0.0:1782759674.708099:0:154732:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782759674.708101:0:154732:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782759674.708104:0:154732:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=u' 20000000:01000000:0.0:1782759674.708109:0:154732:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.ost=u' 20000000:01000000:0.0:1782759674.708125:0:154732:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.ost=u' 20000000:01000000:0.0:1782759674.708138:0:154732:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782759674.708141:0:154732:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782759674.708409:0:154732:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782759674.708412:0:154732:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 00000040:00080000:0.0:1782759674.713156:0:154733:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1782759674.714390:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10200 00000040:00080000:3.0:1782759674.714465:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 88 off10288 00000040:00080000:3.0:1782759674.714508:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10512 20000000:01000000:3.0:1782759674.714524:0:154732:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782759674.714526:0:154732:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 00000040:00080000:3.0:1782759674.717327:0:154734:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000040:00080000:0.0:1782759674.718185:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off17168 00000040:00080000:0.0:1782759674.718229:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 88 off17256 00000040:00080000:0.0:1782759674.718273:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17480 20000000:01000000:0.0:1782759674.718287:0:154732:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782759674.718289:0:154732:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 00000040:00080000:3.0:1782759674.721379:0:154735:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000040:00080000:1.0:1782759674.722141:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 224 off10728 00000040:00080000:1.0:1782759674.722211:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 88 off10816 00000040:00080000:1.0:1782759674.722249:0:154732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11040 10000000:01000000:1.0:1782759674.722269:0:154732:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782759674.722287:0:154732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722306:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722315:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722321:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722328:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722346:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722353:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722359:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722368:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722374:0:154732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722383:0:154732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722424:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722440:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 9 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.722455:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212006656:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759674.722602:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722611:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.722627:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212006784:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759674.722661:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722670:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 18 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.722680:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212006912:0@lo:104: 00000100:00100000:1.0:1782759674.722718:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759674.722766:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722774:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 18 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.722783:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007040:0@lo:104: 00000100:00100000:1.0:1782759674.722808:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759674.722865:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.722873:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 18 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759674.723002:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759674.723016:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212006912 00000100:00100000:2.0:1782759674.723023:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212006912 00000100:00100000:2.0:1782759674.723065:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007040 00000100:00100000:2.0:1782759674.723068:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007040 00000100:00100000:2.0:1782759674.723092:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1782759674.723102:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154732:x1869355212006912:12345-0@lo:104: 00010000:00010000:2.0:1782759674.723117:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723166:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759674.723172:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154732:x1869355212006912:12345-0@lo:104: Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759674.723179:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1782759674.723202:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1782759674.723208:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917185b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154732:x1869355212007040:12345-0@lo:104: 00010000:00010000:2.0:1782759674.723216:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723247:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759674.723252:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917185b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154732:x1869355212007040:12345-0@lo:104: Request processed in 45us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759674.723258:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00010000:00010000:2.0:1782759674.723294:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759674.723300:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723307:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759674.723310:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723319:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759674.723326:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759674.723332:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759674.723357:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723364:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759674.723381:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723398:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777df3a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3b0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723410:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759674.723413:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723419:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759674.723422:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723429:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759674.723435:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759674.723441:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759674.723452:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723458:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759674.723470:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723477:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777df39b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df3a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723485:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759674.723491:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759674.723493:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759674.723511:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212007296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759674.723540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759674.723582:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007296 00000100:00100000:1.0:1782759674.723582:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007168:0@lo:104: 00000100:00100000:2.0:1782759674.723587:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007296 00010000:00010000:2.0:1782759674.723608:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 19 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.723619:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759674.723639:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1782759674.723647:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212007296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759674.723657:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759674.723658:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.723664:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 19 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.723686:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 19 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.723704:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007552:0@lo:104: 00000100:00100000:1.0:1782759674.723729:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759674.723854:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007168 00000100:00100000:0.0:1782759674.723859:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007168 00000100:00100000:0.0:1782759674.723878:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007552 00000100:00100000:0.0:1782759674.723880:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007552 00000100:00100000:0.0:1782759674.723892:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1782759674.723898:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154732:x1869355212007168:12345-0@lo:104: 00010000:00010000:0.0:1782759674.723907:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.723947:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759674.723951:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154732:x1869355212007168:12345-0@lo:104: Request processed in 54us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.723958:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1782759674.723984:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1782759674.723990:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154732:x1869355212007552:12345-0@lo:104: 00010000:00010000:0.0:1782759674.723997:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724024:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782759674.724029:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154732:x1869355212007552:12345-0@lo:104: Request processed in 40us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.724041:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00010000:00010000:0.0:1782759674.724063:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782759674.724068:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724075:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759674.724079:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724086:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759674.724093:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759674.724098:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759674.724117:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724123:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759674.724130:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724136:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd000/0xdd99f5c4777df38d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724146:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759674.724149:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724164:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcce00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759674.724167:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724174:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759674.724180:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759674.724185:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759674.724195:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724201:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759674.724210:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724218:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777df37f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.724226:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759674.724227:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759674.724229:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759674.724238:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212007424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759674.724263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759674.724286:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759674.724292:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212007680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759674.724323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759674.724352:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007424 00000100:00100000:0.0:1782759674.724355:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007424 00010000:00010000:0.0:1782759674.724371:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 20 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.724388:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007680 00000100:00100000:0.0:1782759674.724391:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007680 00010000:00010000:0.0:1782759674.724399:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 21 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.724410:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1782759674.724415:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3307:x1869355212007424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.724422:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.724426:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 21 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.724715:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 21 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.724733:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759674.724762:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3306:x1869355212007296:12345-0@lo:103:ldlm_bl.0 Request processed in 1116us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759674.724769:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1782759674.724784:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1782759674.724789:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3307:x1869355212007680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759674.724797:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759674.724800:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 20 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.724808:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 20 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759674.724841:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759674.724877:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3307:x1869355212007680:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759674.724883:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1782759674.725856:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212007680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759674.726038:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.726053:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 19 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.726067:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007936:0@lo:104: 00000100:00100000:1.0:1782759674.726109:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759674.726155:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.726163:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 19 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.726172:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212008064:0@lo:104: 00000100:00100000:1.0:1782759674.726194:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759674.726215:0:154732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.726223:0:154732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 19 pid: 5794 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.726231:0:154732:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212008192:0@lo:104: 00000100:00100000:1.0:1782759674.726262:0:154732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759674.726277:0:154732:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc39c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782759674.726293:0:154732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64600/0xdd99f5c4777df3b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df3a9 expref: 19 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.726306:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212006912:0@lo:104: 00000100:00100000:1.0:1782759674.726315:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007040:0@lo:104: 00010000:00010000:1.0:1782759674.726324:0:154732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65a00/0xdd99f5c4777df394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df38d expref: 18 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759674.726332:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007168:0@lo:104: 00000100:00100000:1.0:1782759674.726341:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007552:0@lo:104: 00000100:00100000:3.0:1782759674.726445:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007936 00000100:00100000:3.0:1782759674.726452:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007936 00000100:00100000:3.0:1782759674.726500:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008064 00000100:00100000:3.0:1782759674.726503:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008064 00000100:00100000:3.0:1782759674.726516:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008192 00000100:00100000:3.0:1782759674.726518:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008192 00000100:00100000:3.0:1782759674.726531:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1782759674.726538:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:154732:x1869355212007936:12345-0@lo:104: 00010000:00010000:3.0:1782759674.726553:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759674.726603:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759674.726609:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:154732:x1869355212007936:12345-0@lo:104: Request processed in 72us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759674.726616:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1782759674.726631:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1782759674.726637:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154732:x1869355212008064:12345-0@lo:104: 00010000:00010000:3.0:1782759674.726644:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759674.726671:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759674.726676:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154732:x1869355212008064:12345-0@lo:104: Request processed in 40us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759674.726681:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1782759674.726694:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1782759674.726700:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154732:x1869355212008192:12345-0@lo:104: 00010000:00010000:3.0:1782759674.726707:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759674.726732:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782759674.726736:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154732:x1869355212008192:12345-0@lo:104: Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759674.726741:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1782759674.728059:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212006656:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759674.728071:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212006784:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759674.728081:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212007936:0@lo:104: 00000100:00100000:1.0:1782759674.728089:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212008064:0@lo:104: 00000100:00100000:1.0:1782759674.728096:0:154732:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154732:1869355212008192:0@lo:104: 00010000:00010000:1.0:1782759674.728138:0:154732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728517:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 17 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728537:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030800/0xdd99f5c4777df3a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df39b expref: 17 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728551:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759674.728642:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3307:x1869355212007424:12345-0@lo:103:ldlm_bl.0 Request processed in 4225us (4376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.728651:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00010000:00010000:0.0:1782759674.728680:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782759674.728686:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728708:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759674.728712:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728721:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759674.728728:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759674.728734:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759674.728774:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728782:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759674.728794:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728800:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777df371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df378 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728811:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782759674.728814:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728852:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759674.728856:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728873:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759674.728878:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759674.728883:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759674.728896:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728901:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759674.728915:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728922:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777df363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df36a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728931:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759674.728934:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728939:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759674.728942:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728947:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759674.728954:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759674.728965:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759674.728990:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.728997:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759674.729003:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729009:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180031a00/0xdd99f5c4777df355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777df35c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729023:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759674.729026:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212008576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.729026:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759674.729029:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759674.729048:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759674.729061:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212007808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759674.729096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759674.729123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759674.729133:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759674.729141:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212008320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759674.729159:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759674.729170:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212008448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759674.729172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759674.729205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759674.729206:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212007808 00000100:00100000:0.0:1782759674.729213:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212007808 00010000:00010000:0.0:1782759674.729240:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 16 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.729270:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008576 00000100:00100000:0.0:1782759674.729273:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008576 00010000:00010000:0.0:1782759674.729286:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 17 pid: 5794 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.729308:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008320 00000100:00100000:0.0:1782759674.729310:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008320 00010000:00010000:0.0:1782759674.729321:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 18 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.729330:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008448 00000100:00100000:0.0:1782759674.729332:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008448 00010000:00010000:0.0:1782759674.729342:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 19 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.729354:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1782759674.729362:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212007808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.729372:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.729377:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 19 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729387:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 19 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729399:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031000/0xdd99f5c4777df386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df37f expref: 19 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729408:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759674.729440:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759674.729446:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212007808:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.729453:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1782759674.729470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759674.729498:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324800 00000100:00100000:0.0:1782759674.729502:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324800 00010000:00010000:0.0:1782759674.729515:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 10 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.729534:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197324928 00000100:00100000:0.0:1782759674.729537:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197324928 00010000:00010000:0.0:1782759674.729549:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 11 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.729561:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1782759674.729566:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3308:x1869355212008576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.729572:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.729577:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 17 pid: 5794 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729584:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 17 pid: 5794 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729594:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777df35c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df355 expref: 17 pid: 5794 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729603:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759674.729640:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3308:x1869355212008576:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.729647:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1782759674.729658:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1782759674.729665:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3305:x1869355212008320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.729671:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.729675:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 15 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729692:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 15 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729703:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65000/0xdd99f5c4777df378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df371 expref: 15 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729711:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759674.729734:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3305:x1869355212008320:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.729740:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1782759674.729752:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1782759674.729757:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3308:x1869355212008448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.729765:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.729769:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 13 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729777:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 13 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729785:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030a00/0xdd99f5c4777df36a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777df363 expref: 13 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729793:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759674.729815:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:3308:x1869355212008448:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.729842:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1782759674.729856:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 686 00000100:00100000:0.0:1782759674.729863:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197324800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.729877:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.729881:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 11 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729890:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 11 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729900:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777df3be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66dbb expref: 11 pid: 5793 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.729908:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759674.729948:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197324800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.729954:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 686 00000100:00100000:0.0:1782759674.729968:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 687 00000100:00100000:0.0:1782759674.729987:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2361:x1869355197324928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782759674.730126:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212008448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759674.730136:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212008576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759674.730702:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212007424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759674.730808:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759674.730817:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759674.730911:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212007296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759674.730926:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759674.731090:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731103:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64400/0xdd99f5c4777df3b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66db4 expref: 9 pid: 5796 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731117:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731140:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731157:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731163:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731170:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731178:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731186:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759674.731191:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731199:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731222:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759674.731233:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759674.731369:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2361:x1869355197324928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1382us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.731379:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 687 00010000:00010000:1.0:1782759674.731391:0:154732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.731408:0:154732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759674.731414:0:154732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e0457 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759674.731433:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212008320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759674.731457:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212007808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759674.803551:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212008704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759674.803633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759674.803958:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008704 00000100:00100000:2.0:1782759674.803967:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008704 00000100:00100000:2.0:1782759674.804152:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1782759674.804163:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212008704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759674.804199:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759674.804245:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212008704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759674.804251:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00080000:0.0:1782759674.804309:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759674.804346:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212008704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759674.863004:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759675.884079:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759676.140273:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759676.140281:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 55 10000000:01000000:1.0:1782759676.140287:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759676.140332:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759676.140344:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759676.140355:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759676.140383:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212008832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759676.140449:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759676.140502:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.140763:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008832 00000100:00100000:2.0:1782759676.140772:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008832 00000100:00100000:2.0:1782759676.140873:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1782759676.140883:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355212008832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.140899:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.140916:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e045e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.140962:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.140996:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.141005:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91200, rc 0) 00000100:00100000:2.0:1782759676.141055:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212008832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.141063:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1782759676.141118:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212008832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.141135:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.141144:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.141199:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212008960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.141228:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.141245:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b77710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.141256:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212008960 00000100:00100000:2.0:1782759676.141260:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212008960 00000100:00100000:2.0:1782759676.141283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:2.0:1782759676.141289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212008960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.141541:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212008960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.141547:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:2.0:1782759676.141581:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212008960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.141619:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.141655:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.141669:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b77710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.141679:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009088 00000100:00100000:2.0:1782759676.141682:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009088 00000100:00100000:2.0:1782759676.141700:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1782759676.141706:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212009088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.142011:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212009088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.142018:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1782759676.142058:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759676.142794:0:154813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:2.0:1782759676.142860:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:2.0:1782759676.142874:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759676.142882:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.142892:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759676.142899:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782759676.142901:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1782759676.142903:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782759676.142927:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.142935:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.142973:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.142988:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.143021:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.143035:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.143048:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009216 00000100:00100000:2.0:1782759676.143052:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009216 00000100:00100000:2.0:1782759676.143074:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1782759676.143079:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212009216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.143088:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.143097:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e046c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.143114:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.143122:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.143130:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782759676.143154:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212009216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.143159:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1782759676.143188:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.143198:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.143212:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.143245:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.143265:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.143275:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.143284:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009344 00000100:00100000:2.0:1782759676.143287:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009344 00000100:00100000:2.0:1782759676.143302:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1782759676.143307:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212009344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.143461:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212009344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.143467:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1782759676.143492:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.143511:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.143540:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.143550:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.143559:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009472 00000100:00100000:2.0:1782759676.143561:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009472 00000100:00100000:2.0:1782759676.143577:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1782759676.143582:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212009472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.143693:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212009472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.143699:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1782759676.143732:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212009472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759676.151753:0:154814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154814:1869355212009600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759676.151896:0:154814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759676.152109:0:154814:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.152164:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009600 00000100:00100000:2.0:1782759676.152171:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009600 00000100:00100000:2.0:1782759676.152216:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1782759676.152224:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:154814:x1869355212009600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.152443:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:154814:x1869355212009600:12345-0@lo:502:llog_process_th.0 Request processed in 219us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.152450:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:0.0:1782759676.152594:0:154814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154814:1869355212009600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759676.152621:0:154814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759676.152629:0:154814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759676.152631:0:154814:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre quota.ost 00000020:00000080:0.0:1782759676.152639:0:154814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00010000:00010000:0.0:1782759676.154653:0:154815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.154668:0:154815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759676.154695:0:154815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:154815:1869355212009728:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759676.154750:0:154815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759676.154854:0:154815:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26300 going to sleep for 11 seconds 00010000:00010000:1.0:1782759676.155353:0:154816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759676.155364:0:154816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759676.155380:0:154816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:154816:1869355212009856:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:1.0:1782759676.155416:0:154816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759676.155728:0:154817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.155737:0:154817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.155752:0:154817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:154817:1869355212009984:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759676.155873:0:154814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154814:1869355212010112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759676.155921:0:154814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759676.156198:0:154814:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719feb1300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.156246:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010112 00000100:00100000:2.0:1782759676.156253:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010112 00000100:00100000:2.0:1782759676.156315:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1782759676.156324:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:154814:x1869355212010112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.156549:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:154814:x1869355212010112:12345-0@lo:502:llog_process_th.0 Request processed in 225us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.156558:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:0.0:1782759676.156709:0:154814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190265180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154814:1869355212010112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759676.156737:0:154814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759676.156744:0:154814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759676.156747:0:154814:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre quota.ost 00000040:00080000:0.0:1782759676.156754:0:154814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1782759676.157132:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-13 (rc=0) 10000000:01000000:2.0:1782759676.157155:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782759676.157166:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.157188:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759676.157197:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759676.157200:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 55 10000000:01000000:2.0:1782759676.157203:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759676.157226:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.157234:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.157241:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.157257:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.157307:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.157333:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.157637:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010240 00000100:00100000:0.0:1782759676.157644:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010240 00000100:00100000:0.0:1782759676.157686:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:0.0:1782759676.157695:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212010240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759676.157708:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759676.157719:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e048f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.157745:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.157755:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.157763:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98a00, rc 0) 00000100:00100000:0.0:1782759676.157813:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212010240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.157839:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:2.0:1782759676.158107:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.158122:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.158131:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.158187:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.158214:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.158248:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.158463:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010368 00000100:00100000:0.0:1782759676.158468:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010368 00000100:00100000:0.0:1782759676.158500:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:0.0:1782759676.158507:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212010368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759676.158768:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212010368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.158782:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:2.0:1782759676.158995:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.159032:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.159073:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.159095:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.159201:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010496 00000100:00100000:0.0:1782759676.159206:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010496 00000100:00100000:0.0:1782759676.159242:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1782759676.159249:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212010496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759676.159406:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212010496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.159413:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1782759676.159744:0:154817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.160066:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759676.160727:0:154818:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:2.0:1782759676.160786:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:2.0:1782759676.160805:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759676.160816:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.160844:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759676.160854:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759676.160857:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1782759676.160859:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759676.160890:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.160898:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.160905:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.160922:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.160994:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.161020:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.161036:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010624 00000100:00100000:2.0:1782759676.161041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010624 00000100:00100000:2.0:1782759676.161075:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1782759676.161083:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212010624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.161095:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.161107:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e049d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.161129:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.161140:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.161149:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759676.161180:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212010624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.161186:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1782759676.161219:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.161232:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.161241:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.161277:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.161309:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.161321:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.161332:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010752 00000100:00100000:2.0:1782759676.161336:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010752 00000100:00100000:2.0:1782759676.161356:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1782759676.161362:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212010752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.161588:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212010752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.161594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1782759676.161623:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.161645:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.161676:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.161687:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.161697:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212010880 00000100:00100000:2.0:1782759676.161700:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212010880 00000100:00100000:2.0:1782759676.161716:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:2.0:1782759676.161721:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212010880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.161876:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212010880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.161883:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:2.0:1782759676.161920:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212010880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759676.162702:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009728 00000100:00100000:3.0:1782759676.162710:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009728 00000100:00100000:3.0:1782759676.162753:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009856 00000100:00100000:3.0:1782759676.162757:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009856 00000100:00100000:3.0:1782759676.162780:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1782759676.162797:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:154815:x1869355212009728:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:3.0:1782759676.162809:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759676.162842:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf600/0xdd99f5c4777e04ab lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e047a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759676.164248:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782759676.166210:0:154817:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.167080:0:154816:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.169062:0:154819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154819:1869355212011008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.169101:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 3 min 2 max 80 00000100:00100000:2.0:1782759676.169111:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_003' 00000100:00100000:1.0:1782759676.169366:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+5:154816:x1869355212009856:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:1.0:1782759676.169387:0:121722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759676.169410:0:121722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e04b2 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0481 expref: -99 pid: 121722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759676.169918:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759676.170124:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212009984 00000100:00100000:2.0:1782759676.170133:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212009984 00000100:00080000:2.0:1782759676.170185:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759676.170380:0:154819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759676.170525:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1782759676.170536:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+5:154817:x1869355212009984:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:1.0:1782759676.170549:0:154820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759676.170562:0:154820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e04b9 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0488 expref: -99 pid: 154820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.171754:0:154819:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.172980:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011008 00000100:00100000:0.0:1782759676.172991:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011008 00000100:00100000:0.0:1782759676.173052:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:0.0:1782759676.173064:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:154819:x1869355212011008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759676.174081:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:154819:x1869355212011008:12345-0@lo:502:llog_process_th.0 Request processed in 1014us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.174092:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00080000:10000000:3.0:1782759676.174423:0:5804:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1001:0x0] (8/8/1) registered 00010000:00010000:3.0:1782759676.174461:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf600/0xdd99f5c4777e04ab lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e047a expref: 6 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.174476:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf600/0xdd99f5c4777e04ab lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e047a expref: 6 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.174489:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf600, rc 0) 00000100:00100000:3.0:1782759676.174543:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+6:154815:x1869355212009728:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 11756us (19793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759676.174551:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1782759676.174688:0:154819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154819:1869355212011008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759676.174727:0:154819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759676.174738:0:154819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759676.174740:0:154819:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre quota.ost 00000020:00000080:2.0:1782759676.174747:0:154819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759676.174802:0:154819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154819:1869355212011136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.174874:0:154819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.174904:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011136 00000100:00100000:2.0:1782759676.174911:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011136 00000100:00100000:0.0:1782759676.175298:0:154815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:154815:1869355212009728:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759676.175319:0:154815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.175330:0:154815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759676.175905:0:154815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:154815:1869355212011264:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759676.176052:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1782759676.176061:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:154819:x1869355212011136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.176269:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:154819:x1869355212011136:12345-0@lo:502:llog_process_th.0 Request processed in 209us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.176276:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00080000:10000000:2.0:1782759676.176650:0:154820:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1002:0x0] (8/8/1) registered 00010000:00010000:2.0:1782759676.176692:0:154820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e04b9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0488 expref: 6 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.176705:0:154820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5800/0xdd99f5c4777e04b9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0488 expref: 6 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.176716:0:154820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5800, rc 0) 00000100:00100000:2.0:1782759676.176754:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+6:154817:x1869355212009984:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 6220us (17010us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.176770:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1782759676.176805:0:154819:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083696540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.176844:0:154819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154819:1869355212011136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759676.176877:0:154819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759676.176885:0:154819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759676.176887:0:154819:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre quota.ost 00000040:00080000:2.0:1782759676.176891:0:154819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 17 count 17 00000020:01000000:2.0:1782759676.177188:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-16 (rc=0) 10000000:01000000:2.0:1782759676.177207:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782759676.177217:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177226:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759676.177236:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759676.177239:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 55 10000000:01000000:2.0:1782759676.177241:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759676.177268:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177276:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177284:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.177300:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.177335:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.177360:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.177378:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011392 00000100:00100000:2.0:1782759676.177383:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011392 00000100:00100000:2.0:1782759676.177413:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:2.0:1782759676.177420:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212011392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.177432:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.177444:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e04c0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177461:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177470:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177477:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90200, rc 0) 00000100:00100000:2.0:1782759676.177505:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212011392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.177511:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:2.0:1782759676.177543:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.177554:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.177562:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.177600:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.177623:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.177642:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.177654:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011520 00000100:00100000:2.0:1782759676.177657:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011520 00000100:00100000:2.0:1782759676.177675:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1782759676.177680:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212011520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759676.178169:0:154815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759676.178194:0:154815:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.178221:0:154817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3800 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:154817:1869355212009984:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759676.178236:0:154817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.178244:0:154817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.179197:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212011520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1513us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.179206:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1782759676.179248:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011264 00000100:00100000:2.0:1782759676.179253:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011264 00000100:00100000:2.0:1782759676.179299:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782759676.179307:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+6:154815:x1869355212011264:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759676.180178:0:154817:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:154817:1869355212011648:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759676.180233:0:154817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1782759676.180502:0:121722:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1003:0x0] (8/8/1) registered 00010000:00010000:1.0:1782759676.180554:0:121722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e04b2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0481 expref: 6 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759676.180569:0:121722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4a00/0xdd99f5c4777e04b2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0481 expref: 6 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759676.180580:0:121722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4a00, rc 0) 00000100:00100000:0.0:1782759676.180717:0:154817:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a9347840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759676.181096:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011648 00000100:00100000:3.0:1782759676.181103:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011648 00000100:00100000:3.0:1782759676.181138:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1782759676.181147:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+6:154817:x1869355212011648:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759676.181241:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759676.181909:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759676.182585:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:154816:x1869355212009856:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 18325us (27166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759676.182595:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1782759676.182651:0:154816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:154816:1869355212009856:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:1.0:1782759676.182678:0:154816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759676.182698:0:154816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.184583:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+6:154815:x1869355212011264:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 5267us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.184597:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782759676.184705:0:154815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:154815:1869355212011264:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759676.185391:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759676.185435:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191820240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759676.185455:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011776 00000100:00100000:0.0:1782759676.185462:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011776 00000100:00100000:0.0:1782759676.187950:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1782759676.187968:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212011776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759676.188258:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212011776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.188403:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1782759676.188481:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759676.188501:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+6:154817:x1869355212011648:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 7354us (8265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759676.188510:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782759676.188665:0:154817:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:154817:1869355212011648:0@lo:403:qsd_reint_0.lus.0 00000040:00080000:3.0:1782759676.189564:0:154821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:3.0:1782759676.189634:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:3.0:1782759676.189652:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759676.189663:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.189674:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759676.189684:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759676.189687:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:3.0:1782759676.189690:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759676.189722:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.189730:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.189740:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759676.189761:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759676.190803:0:154816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:154816:1869355212012032:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:1.0:1782759676.191319:0:154816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759676.191358:0:154816:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171918069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.191409:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012032 00000100:00100000:2.0:1782759676.191416:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012032 00000100:00100000:2.0:1782759676.191468:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1782759676.191479:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:154816:x1869355212012032:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759676.194549:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:154816:x1869355212012032:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 3065us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.194564:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1782759676.194682:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759676.194731:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb9166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759676.195129:0:154816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:154816:1869355212012032:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759676.196098:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212011904 00000100:00100000:2.0:1782759676.196107:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212011904 00000100:00100000:2.0:1782759676.196154:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:2.0:1782759676.196163:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212011904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.196185:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.196203:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e04ce expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.196230:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.196241:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.196250:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782759676.196305:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212011904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.196311:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:2.0:1782759676.196352:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212011904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.196366:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.196375:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.196439:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.196472:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.196498:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.196511:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012160 00000100:00100000:2.0:1782759676.196516:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012160 00000100:00100000:2.0:1782759676.196537:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:2.0:1782759676.196543:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212012160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.196712:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212012160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.196718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:2.0:1782759676.196744:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.196772:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.196810:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.196849:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759676.198121:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012288 00000100:00100000:3.0:1782759676.198129:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012288 00000100:00100000:3.0:1782759676.198273:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1782759676.198281:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212012288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759676.198475:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212012288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759676.198481:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:2.0:1782759676.199226:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759676.199526:0:154822:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154822:1869355212012416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759676.199583:0:154822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759676.199623:0:154822:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.199662:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012416 00000100:00100000:2.0:1782759676.199668:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012416 00000100:00100000:2.0:1782759676.199707:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1782759676.199714:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:154822:x1869355212012416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.201192:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:154822:x1869355212012416:12345-0@lo:502:llog_process_th.0 Request processed in 1473us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.201203:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1782759676.201366:0:154822:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154822:1869355212012416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759676.201397:0:154822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759676.201407:0:154822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759676.201409:0:154822:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre quota.ost 00000020:00000080:3.0:1782759676.201415:0:154822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759676.201446:0:154822:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154822:1869355212012544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759676.201486:0:154822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759676.201518:0:154822:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198924000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.201562:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012544 00000100:00100000:2.0:1782759676.201568:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012544 00000100:00100000:2.0:1782759676.201604:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:2.0:1782759676.201611:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:154822:x1869355212012544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759676.201746:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:154822:x1869355212012544:12345-0@lo:502:llog_process_th.0 Request processed in 135us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.201753:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:0.0:1782759676.201812:0:154822:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:154822:1869355212012544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759676.201902:0:154822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759676.201907:0:154822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759676.201908:0:154822:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre quota.ost 00000040:00080000:0.0:1782759676.201912:0:154822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1782759676.202037:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1782759676.202066:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782759676.202078:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.202091:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759676.202102:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782759676.202104:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759676.202107:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782759676.202133:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.202148:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759676.202160:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759676.202177:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759676.202206:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759676.202228:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198924900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.202618:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012672 00000100:00100000:2.0:1782759676.202623:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012672 00000100:00100000:2.0:1782759676.202657:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759676.202663:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212012672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.202672:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.202684:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e04dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.202703:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.202713:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.202720:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90600, rc 0) 00000100:00100000:2.0:1782759676.202754:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212012672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.202760:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759676.204065:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.204092:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.204103:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759676.204176:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.204222:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.204253:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759676.204271:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012800 00000100:00100000:2.0:1782759676.204276:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012800 00000100:00100000:2.0:1782759676.204316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:2.0:1782759676.204323:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212012800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.204510:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212012800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759676.204518:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:2.0:1782759676.204555:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212012800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782759676.204581:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782759676.204588:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.204595:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.268351:0:154816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.268366:0:154816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.289845:0:154817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.289860:0:154817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.297671:0:154815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.297685:0:154815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759676.472598:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759676.475279:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325056 00000100:00100000:2.0:1782759676.475294:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325056 00000100:00100000:2.0:1782759676.476913:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2934 00000100:00100000:2.0:1782759676.476950:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197325056:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759676.476968:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759676.476986:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670c4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.477021:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.477034:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759676.477044:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782759676.477115:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197325056:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 180us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.477123:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2934 00000100:00100000:0.0:1782759676.488243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759676.490459:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325184 00000100:00100000:2.0:1782759676.490473:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325184 00000100:00100000:2.0:1782759676.491437:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2935 00000100:00100000:2.0:1782759676.491453:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197325184:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759676.492424:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197325184:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 970us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.492436:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2935 00000100:00100000:2.0:1782759676.507269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759676.507332:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325312 00000100:00100000:1.0:1782759676.507343:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325312 00000100:00100000:1.0:1782759676.507408:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2936 00000100:00100000:1.0:1782759676.507420:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197325312:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759676.507651:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197325312:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 233us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759676.507659:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2936 00000100:00100000:3.0:1782759676.527260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759676.527355:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325440 00000100:00100000:0.0:1782759676.527365:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325440 00000100:00100000:0.0:1782759676.527424:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2937 00000100:00100000:0.0:1782759676.527435:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197325440:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759676.527456:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759676.527476:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.527513:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.527525:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759676.527535:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98000, rc 0) 00000100:00100000:0.0:1782759676.528082:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197325440:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 646us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.528101:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2937 00000100:00100000:2.0:1782759676.543543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759676.543611:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325568 00000100:00100000:3.0:1782759676.543620:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325568 00000100:00100000:3.0:1782759676.543674:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2938 00000100:00100000:3.0:1782759676.543683:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197325568:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759676.543993:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197325568:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 309us (458us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759676.544001:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2938 00000100:00100000:2.0:1782759676.846277:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212012928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.846446:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212013440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.846507:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759676.846514:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212013312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.846571:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212013056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.846610:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212013568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.846650:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759676.846656:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212013184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759676.846709:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212013312 00000100:00100000:2.0:1782759676.846716:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212013312 00000100:00100000:2.0:1782759676.846778:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212013568 00000100:00100000:2.0:1782759676.846781:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212013568 00000100:00100000:2.0:1782759676.846807:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1782759676.846816:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846900:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212013312:12345-0@lo:400:kworker.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.846908:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1782759676.846946:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1782759676.846953:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.846986:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212013568:12345-0@lo:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759676.846992:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00080000:2.0:1782759676.847020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759676.847025:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759676.847059:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212013568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759676.847091:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212013312:0@lo:400:kworker.0 00000100:00100000:1.0:1782759676.847241:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212012928 00000100:00100000:1.0:1782759676.847254:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212012928 00000100:00100000:1.0:1782759676.847292:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:1.0:1782759676.847299:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212012928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759676.847338:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212012928:12345-0@lo:400:kworker.0 Request processed in 40us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759676.847344:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1782759676.847469:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212012928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759676.849550:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212013440 00000100:00100000:0.0:1782759676.849567:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212013440 00000100:00100000:0.0:1782759676.849617:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212013056 00000100:00100000:0.0:1782759676.849620:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212013056 00000100:00100000:0.0:1782759676.849650:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212013184 00000100:00100000:0.0:1782759676.849653:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212013184 00000100:00100000:0.0:1782759676.849681:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1782759676.849691:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212013440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759676.849787:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212013440:12345-0@lo:400:kworker.0 Request processed in 98us (3309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.849795:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1782759676.849813:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1782759676.849820:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+6:3307:x1869355212013056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759676.849872:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+6:3307:x1869355212013056:12345-0@lo:400:kworker.0 Request processed in 53us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759676.849877:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1782759676.849891:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212013184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759676.850070:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212013184:12345-0@lo:400:kworker.0 Request processed in 182us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759676.850521:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1782759676.850573:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212013184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759676.850586:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212013056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759676.850620:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212013440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759676.850653:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00010000:00010000:2.0:1782759676.908574:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759677.357652:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759677.362418:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212013696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759677.362498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759677.363762:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212013696 00000100:00100000:3.0:1782759677.363774:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212013696 00000100:00100000:3.0:1782759677.363859:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1782759677.363869:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212013696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759677.363909:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759677.363991:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212013696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759677.363999:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1782759677.364093:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212013696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759677.933115:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759678.957016:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759679.166715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759679.166755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759679.166782:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759679.166810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759679.166860:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325824 00000100:00100000:2.0:1782759679.166869:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325824 00000100:00100000:2.0:1782759679.166941:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2696 00000100:00100000:2.0:1782759679.166951:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197325824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759679.167098:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197325824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 148us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.167106:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2696 00000100:00100000:2.0:1782759679.167138:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326080 00000100:00100000:2.0:1782759679.167142:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326080 00000100:00100000:2.0:1782759679.167164:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325952 00000100:00100000:2.0:1782759679.167166:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325952 00000100:00100000:2.0:1782759679.167182:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2142 00000100:00100000:2.0:1782759679.167188:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197326080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759679.167228:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197326080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.167235:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2142 00000100:00100000:2.0:1782759679.167247:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2143 00000100:00100000:2.0:1782759679.167253:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197325952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759679.167276:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197325952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.167282:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2143 00000100:00080000:2.0:1782759679.167300:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759679.167304:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759679.167306:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759679.168522:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197325696 00000100:00100000:1.0:1782759679.168537:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197325696 00000100:00100000:1.0:1782759679.168584:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2940 00000100:00100000:1.0:1782759679.168594:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197325696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759679.168647:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197325696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 54us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.168654:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2940 00000020:00000080:0.0:1782759679.244518:0:154989:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd58b90790 20000000:00000080:0.0:1782759679.244540:0:154989:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9171b7dbdc00 uarg=0000000000000000 20000000:01000000:0.0:1782759679.244580:0:154989:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782759679.244583:0:154989:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782759679.244592:0:154989:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.mdt=u' 20000000:01000000:0.0:1782759679.244598:0:154989:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.mdt=u' 20000000:01000000:0.0:1782759679.244603:0:154989:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.mdt=u' 20000000:01000000:0.0:1782759679.244616:0:154989:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782759679.244618:0:154989:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782759679.245132:0:154989:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782759679.245136:0:154989:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.mdt fl=4 00000040:00080000:3.0:1782759679.246624:0:154990:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000040:00080000:0.0:1782759679.247207:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 224 off10736 00000040:00080000:0.0:1782759679.247297:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 88 off10824 00000040:00080000:0.0:1782759679.247340:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11048 20000000:01000000:0.0:1782759679.247354:0:154989:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782759679.247357:0:154989:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.mdt fl=4 00000040:00080000:0.0:1782759679.249114:0:154991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1782759679.249979:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17704 00000040:00080000:2.0:1782759679.250036:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 88 off17792 00000040:00080000:2.0:1782759679.250096:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off18016 20000000:01000000:2.0:1782759679.250112:0:154989:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782759679.250115:0:154989:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.mdt fl=4 00000040:00080000:0.0:1782759679.255291:0:154992:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 17 count 17 00000040:00080000:3.0:1782759679.256096:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 224 off11264 00000040:00080000:3.0:1782759679.256176:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 88 off11352 00000040:00080000:3.0:1782759679.256218:0:154989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11576 10000000:01000000:3.0:1782759679.256242:0:154989:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782759679.256262:0:154989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256350:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256358:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256364:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256371:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256378:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256384:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256400:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256410:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256417:0:154989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256426:0:154989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256470:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256488:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 9 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.256503:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212013824:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759679.256945:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.256956:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.256966:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212013952:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759679.257001:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.257021:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 18 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.257032:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014080:0@lo:104: 00000100:00100000:3.0:1782759679.257072:0:154989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759679.257229:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.257237:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 18 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.257245:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014208:0@lo:104: 00000100:00100000:3.0:1782759679.257276:0:154989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759679.258023:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.258034:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 18 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.258044:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014336:0@lo:104: 00010000:00010000:3.0:1782759679.258074:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.258082:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 18 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.258090:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014464:0@lo:104: 00010000:00010000:3.0:1782759679.258115:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.258134:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 18 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.258142:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014592:0@lo:104: 00010000:00010000:3.0:1782759679.258169:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.258176:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 18 pid: 5796 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.258183:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014720:0@lo:104: 00010000:00010000:3.0:1782759679.258207:0:154989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.258338:0:154989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 18 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.258348:0:154989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014848:0@lo:104: 00000100:00100000:3.0:1782759679.258370:0:154989:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b28cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759679.258440:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759679.258461:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.258725:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759679.258919:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014080 00000100:00100000:2.0:1782759679.258927:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014080 00000100:00100000:1.0:1782759679.259226:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014208 00000100:00100000:1.0:1782759679.259232:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014208 00000100:00100000:1.0:1782759679.259261:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014336 00000100:00100000:1.0:1782759679.259275:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014336 00000100:00100000:1.0:1782759679.259294:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1782759679.259304:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:154989:x1869355212014080:12345-0@lo:104: 00010000:00010000:1.0:1782759679.259319:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.259381:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759679.259388:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:154989:x1869355212014080:12345-0@lo:104: Request processed in 85us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.259394:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1782759679.259428:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1782759679.259434:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154989:x1869355212014208:12345-0@lo:104: 00010000:00010000:1.0:1782759679.259442:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.259473:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782759679.259478:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154989:x1869355212014208:12345-0@lo:104: Request processed in 45us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.259484:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1782759679.259531:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1782759679.259537:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154989:x1869355212014336:12345-0@lo:104: 00010000:00010000:1.0:1782759679.259546:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.259583:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782759679.259588:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154989:x1869355212014336:12345-0@lo:104: Request processed in 52us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.259594:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00010000:00010000:1.0:1782759679.259616:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782759679.259622:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.259629:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759679.259633:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.259641:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759679.259648:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759679.259654:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782759679.259945:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014080:0@lo:104: 00000100:00100000:3.0:1782759679.259956:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014208:0@lo:104: 00000100:00100000:3.0:1782759679.259962:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014336:0@lo:104: 00010000:00010000:1.0:1782759679.260032:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260039:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.260071:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260089:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082bce000/0xdd99f5c4777e04dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260102:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782759679.260105:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260110:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcee00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759679.260113:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260120:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759679.260126:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759679.260131:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759679.260147:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260153:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.260159:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260165:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082bcee00/0xdd99f5c4777e04ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260174:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759679.260182:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260187:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759679.260191:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260197:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759679.260203:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759679.260208:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759679.260222:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260227:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.260241:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260247:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e04c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04c7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.260254:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.260256:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.260258:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759679.260345:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212014976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759679.260384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759679.260422:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759679.260429:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212015104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759679.260462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759679.260505:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.260512:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759679.260526:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212015232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759679.260552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759679.260630:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014976 00000100:00100000:3.0:1782759679.260636:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014976 00010000:00010000:3.0:1782759679.260663:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 19 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.260704:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015104 00000100:00100000:3.0:1782759679.260707:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015104 00010000:00010000:3.0:1782759679.260718:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 20 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.260733:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015232 00000100:00100000:3.0:1782759679.260736:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015232 00010000:00010000:3.0:1782759679.260745:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 21 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.260756:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1782759679.260773:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3305:x1869355212014976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759679.260784:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759679.260788:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 21 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.260798:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 21 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.260811:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e04e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e04dc expref: 21 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.260909:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759679.260941:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3305:x1869355212014976:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759679.260957:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1782759679.260971:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1782759679.260977:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212015104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759679.260985:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759679.260989:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 19 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.260998:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 19 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.261008:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e04d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e04ce expref: 19 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.261017:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759679.261039:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212015104:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759679.261046:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1782759679.261079:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1782759679.261085:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3307:x1869355212015232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759679.261092:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759679.261096:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 17 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.261104:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 17 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.261113:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90200/0xdd99f5c4777e04c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e04c0 expref: 17 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.261131:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759679.261156:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3307:x1869355212015232:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759679.261162:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1782759679.261424:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212015232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759679.261716:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.261733:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.261743:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.261752:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014464 00000100:00100000:0.0:1782759679.261757:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014464 00000100:00100000:0.0:1782759679.261913:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014592 00000100:00100000:0.0:1782759679.261917:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014592 00000100:00100000:0.0:1782759679.261928:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014720 00000100:00100000:0.0:1782759679.261931:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014720 00000100:00100000:0.0:1782759679.261939:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212014848 00000100:00100000:0.0:1782759679.261941:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212014848 00000100:00100000:0.0:1782759679.261952:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1782759679.261958:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+6:154989:x1869355212014464:12345-0@lo:104: 00010000:00010000:0.0:1782759679.261969:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.262034:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759679.262040:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+6:154989:x1869355212014464:12345-0@lo:104: Request processed in 82us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.262048:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1782759679.262063:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:0.0:1782759679.262067:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:154989:x1869355212014592:12345-0@lo:104: 00010000:00010000:0.0:1782759679.262076:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.262104:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782759679.262108:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:154989:x1869355212014592:12345-0@lo:104: Request processed in 41us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.262114:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:0.0:1782759679.262130:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1782759679.262135:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154989:x1869355212014720:12345-0@lo:104: 00010000:00010000:0.0:1782759679.262141:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.262168:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782759679.262172:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:154989:x1869355212014720:12345-0@lo:104: Request processed in 38us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.262176:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1782759679.262186:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1782759679.262190:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154989:x1869355212014848:12345-0@lo:104: 00010000:00010000:0.0:1782759679.262197:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.262351:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782759679.262357:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:154989:x1869355212014848:12345-0@lo:104: Request processed in 167us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.262363:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00010000:00010000:1.0:1782759679.262446:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782759679.262452:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262459:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759679.262464:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262472:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759679.262478:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759679.262484:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759679.262508:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262514:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.262541:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262548:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91600/0xdd99f5c4777e049d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e04a4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262563:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782759679.262565:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262571:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759679.262580:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262586:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759679.262592:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759679.262597:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759679.262611:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262617:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.262628:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262634:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e048f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0496 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262645:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782759679.262648:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262654:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759679.262657:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.262663:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759679.266249:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212015360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759679.266346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.266430:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015360 00000100:00100000:0.0:1782759679.266438:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015360 00010000:00010000:0.0:1782759679.266473:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 16 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759679.266515:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1782759679.266524:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3308:x1869355212015360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759679.266537:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759679.266542:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 16 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.266553:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 16 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.266571:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759679.266606:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3308:x1869355212015360:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.266613:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1782759679.266648:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212015360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759679.266891:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759679.266911:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.266920:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759679.266924:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.266934:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759679.266941:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759679.266947:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759679.266971:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.266978:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759679.266990:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.266997:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171a93c4800/0xdd99f5c4777e045e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0465 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.267009:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759679.267010:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759679.267012:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759679.267019:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1782759679.267189:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759679.267195:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1782759679.267222:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212015616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759679.267256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.267374:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759679.267381:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212015488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759679.267402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.267427:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015616 00000100:00100000:1.0:1782759679.267431:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015616 00010000:00010000:1.0:1782759679.267448:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 16 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.267468:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015488 00000100:00100000:1.0:1782759679.267470:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015488 00010000:00010000:1.0:1782759679.267482:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 17 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.267497:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1782759679.267504:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3306:x1869355212015616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759679.267513:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759679.267517:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 17 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.267525:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 17 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.267548:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759679.267579:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3306:x1869355212015616:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.267586:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1782759679.267602:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1782759679.267608:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3306:x1869355212015488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759679.267615:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759679.267619:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 16 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.267627:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 16 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.267636:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759679.267656:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3306:x1869355212015488:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.267662:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1782759679.267768:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212015488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759679.267776:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212015616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759679.267816:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.267846:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.267860:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.267866:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91a00/0xdd99f5c4777e046c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0473 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.267905:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212015744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759679.267931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.267957:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015744 00000100:00100000:1.0:1782759679.267961:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015744 00010000:00010000:1.0:1782759679.267974:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 16 pid: 5796 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.267992:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1782759679.267999:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3307:x1869355212015744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759679.268006:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759679.268010:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 16 pid: 5796 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.268018:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 16 pid: 5796 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.268027:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759679.268052:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3307:x1869355212015744:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.268058:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1782759679.268085:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212015744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759679.268097:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.268099:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.268101:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759679.268596:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212015104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759679.268609:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212014976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759679.268653:0:154989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e04a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e049d expref: 15 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.268665:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014464:0@lo:104: 00010000:00010000:3.0:1782759679.269065:0:154989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98a00/0xdd99f5c4777e0496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e048f expref: 14 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.269075:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014592:0@lo:104: 00010000:00010000:3.0:1782759679.269089:0:154989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e046c expref: 13 pid: 5796 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.269096:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014720:0@lo:104: 00010000:00010000:3.0:1782759679.269104:0:154989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91200/0xdd99f5c4777e0465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e045e expref: 12 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.269111:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212014848:0@lo:104: 00000100:00100000:3.0:1782759679.269123:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212013824:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759679.269130:0:154989:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154989:1869355212013952:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759679.269160:0:154989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.273779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759679.273817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759679.274097:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326208 00000100:00100000:0.0:1782759679.274108:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326208 00010000:00010000:0.0:1782759679.274147:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 10 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759679.274200:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326336 00000100:00100000:0.0:1782759679.274203:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326336 00010000:00010000:0.0:1782759679.274227:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 11 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759679.274247:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 695 00000100:00100000:0.0:1782759679.274255:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197326208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759679.274280:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759679.274286:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 11 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274298:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 11 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274316:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98000/0xdd99f5c4777e04f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670cb expref: 11 pid: 5793 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274332:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759679.274385:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197326208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.274392:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 695 00000100:00100000:0.0:1782759679.274407:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:0.0:1782759679.274414:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2362:x1869355197326336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759679.274421:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759679.274426:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274446:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274457:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e04ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670c4 expref: 9 pid: 5794 timeout: 3847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274468:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274477:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274492:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274499:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274505:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274511:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274517:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759679.274521:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274529:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274550:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.274560:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759679.274579:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2362:x1869355197326336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 166us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.274586:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 696 00010000:00010000:3.0:1782759679.275061:0:154989:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.275071:0:154989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.275077:0:154989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bce200/0xdd99f5c4777e04f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.928038:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759679.931553:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212015872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759679.931630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759679.934456:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212015872 00000100:00100000:2.0:1782759679.934473:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212015872 00000100:00100000:2.0:1782759679.934536:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1782759679.934546:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212015872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759679.934586:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759679.934670:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212015872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.934691:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00080000:0.0:1782759679.934965:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759679.937124:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212015872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759679.981559:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759680.823014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759680.830107:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326464 00000100:00100000:0.0:1782759680.830126:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326464 00000100:00100000:1.0:1782759680.830623:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2941 00000100:00100000:1.0:1782759680.830642:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197326464:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759680.830663:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759680.830687:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759680.830720:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759680.830733:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759680.830742:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4400, rc 0) 00000100:00100000:1.0:1782759680.830817:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197326464:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 178us (7812us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759680.830847:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2941 00000100:00100000:2.0:1782759680.834197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759680.834232:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326592 00000100:00100000:2.0:1782759680.834241:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326592 00000100:00100000:2.0:1782759680.834289:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2942 00000100:00100000:2.0:1782759680.834300:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197326592:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759680.834589:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197326592:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 289us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759680.834597:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2942 00000100:00100000:1.0:1782759680.843796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759680.844111:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326720 00000100:00100000:2.0:1782759680.844122:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326720 00000100:00100000:2.0:1782759680.844208:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2943 00000100:00100000:2.0:1782759680.844218:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197326720:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759680.847603:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197326720:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 3373us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759680.847868:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2943 00000100:00100000:2.0:1782759680.856134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759680.856175:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326848 00000100:00100000:2.0:1782759680.856185:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326848 00000100:00100000:2.0:1782759680.856237:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2944 00000100:00100000:2.0:1782759680.856247:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197326848:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759680.856263:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759680.856280:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670d9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759680.856307:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759680.856318:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759680.856339:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90800, rc 0) 00000100:00100000:2.0:1782759680.856398:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197326848:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 152us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759680.856407:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2944 00000100:00100000:1.0:1782759680.864114:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759680.864195:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197326976 00000100:00100000:2.0:1782759680.864205:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197326976 00000100:00100000:2.0:1782759680.864259:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2945 00000100:00100000:2.0:1782759680.864270:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197326976:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759680.864535:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197326976:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 266us (429us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759680.864544:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2945 00010000:00010000:3.0:1782759681.005107:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759681.131987:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759681.131995:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 55 10000000:01000000:2.0:1782759681.132001:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759681.132053:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.132072:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.132083:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.132110:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.132188:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.132233:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016000 00000100:00100000:0.0:1782759681.132242:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016000 00000100:00100000:2.0:1782759681.132253:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c0ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.132297:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:0.0:1782759681.132307:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355212016000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759681.132322:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759681.132336:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e050d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.132360:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.132371:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.133009:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98200, rc 0) 00000100:00100000:0.0:1782759681.133077:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212016000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 770us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.133084:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1782759681.133113:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759681.133132:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.133143:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.133199:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.133228:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759681.133259:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c0ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.133345:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016128 00000100:00100000:0.0:1782759681.133351:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016128 00000100:00100000:0.0:1782759681.133435:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:0.0:1782759681.133443:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212016128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.133697:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212016128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.133703:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1782759681.133934:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.133966:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.134081:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.135796:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016256 00000100:00100000:0.0:1782759681.135808:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016256 00000100:00100000:0.0:1782759681.135946:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1782759681.135957:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212016256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.136224:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c0ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.136498:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212016256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 543us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.136506:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1782759681.138565:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759681.142568:0:155100:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:0.0:1782759681.143110:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:0.0:1782759681.143132:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759681.143144:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.143157:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759681.143186:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782759681.143189:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 14 10000000:01000000:0.0:1782759681.143192:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782759681.143229:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.143236:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.143246:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.143270:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.143342:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.143423:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.143464:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016384 00000100:00100000:3.0:1782759681.143470:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016384 00000100:00100000:3.0:1782759681.143544:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:3.0:1782759681.143552:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212016384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759681.143564:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759681.143576:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e051b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.143599:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.143609:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.143628:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce200, rc 0) 00000100:00100000:3.0:1782759681.143673:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212016384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.143679:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:0.0:1782759681.143744:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759681.143757:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.143766:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.143809:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.143869:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.144097:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.144158:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016512 00000100:00100000:1.0:1782759681.144162:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016512 00000100:00100000:1.0:1782759681.144182:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1782759681.144189:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212016512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759681.144415:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212016512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.144422:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:0.0:1782759681.144503:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.144529:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.144570:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.144591:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.144624:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016640 00000100:00100000:3.0:1782759681.144628:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016640 00000100:00100000:3.0:1782759681.144646:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:3.0:1782759681.144651:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212016640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.144803:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212016640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.144810:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:0.0:1782759681.144921:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212016640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759681.147356:0:155101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155101:1869355212016768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759681.147441:0:155101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759681.147484:0:155101:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.147552:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016768 00000100:00100000:3.0:1782759681.147558:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016768 00000100:00100000:3.0:1782759681.147598:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:3.0:1782759681.147607:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:155101:x1869355212016768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759681.147818:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:155101:x1869355212016768:12345-0@lo:502:llog_process_th.0 Request processed in 211us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.147950:0:155101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155101:1869355212016768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759681.148001:0:155101:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759681.148010:0:155101:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759681.148013:0:155101:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre quota.mdt 00000020:00000080:1.0:1782759681.148018:0:155101:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759681.148155:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00010000:00010000:2.0:1782759681.148553:0:155102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.148565:0:155102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.148585:0:155102:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:155102:1869355212016896:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759681.148621:0:155102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759681.148649:0:155102:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.148704:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212016896 00000100:00100000:3.0:1782759681.148710:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212016896 00000100:00100000:3.0:1782759681.148748:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1782759681.148756:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+6:155102:x1869355212016896:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:3.0:1782759681.148768:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759681.148782:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcea00/0xdd99f5c4777e0530 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0529 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759681.149462:0:155101:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155101:1869355212017024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759681.149511:0:155101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759681.149545:0:155101:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.149613:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017024 00000100:00100000:0.0:1782759681.149619:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017024 00000100:00100000:0.0:1782759681.149657:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:0.0:1782759681.149665:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:155101:x1869355212017024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759681.150145:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:155101:x1869355212017024:12345-0@lo:502:llog_process_th.0 Request processed in 479us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.150153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:1.0:1782759681.150245:0:155101:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155101:1869355212017024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759681.150269:0:155101:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759681.150276:0:155101:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759681.150278:0:155101:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre quota.mdt 00000040:00080000:1.0:1782759681.150281:0:155101:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 17 count 17 00000020:01000000:0.0:1782759681.150446:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 14-16 (rc=0) 10000000:01000000:0.0:1782759681.150462:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782759681.150470:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.150480:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759681.150489:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782759681.150492:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 55 10000000:01000000:0.0:1782759681.150494:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782759681.150516:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.150523:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.150531:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.150552:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.150578:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.150608:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.150720:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017152 00000100:00100000:1.0:1782759681.150725:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017152 00000100:00100000:1.0:1782759681.150757:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:1.0:1782759681.150764:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212017152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759681.150773:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759681.150784:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0537 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.150802:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.150813:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1782759681.151798:0:5804:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1004:0x0] (8/8/1) registered 00010000:00010000:3.0:1782759681.151871:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcea00/0xdd99f5c4777e0530 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0529 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.151882:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcea00/0xdd99f5c4777e0530 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0529 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.151891:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcea00, rc 0) 00000100:00100000:3.0:1782759681.151943:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:155102:x1869355212016896:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 3187us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.151950:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00010000:1.0:1782759681.152116:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4000, rc 0) 00000100:00100000:1.0:1782759681.152151:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212017152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1387us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.152164:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000100:00100000:0.0:1782759681.152354:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759681.152370:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.152379:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.152433:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.152460:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.152504:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.152763:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017280 00000100:00100000:3.0:1782759681.152769:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017280 00000100:00100000:3.0:1782759681.152816:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:3.0:1782759681.152840:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212017280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.153188:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212017280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.153195:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:0.0:1782759681.153391:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.153421:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.153457:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.153478:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.153576:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017408 00000100:00100000:3.0:1782759681.153581:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017408 00000100:00100000:3.0:1782759681.153609:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:3.0:1782759681.153616:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212017408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.153742:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212017408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.153749:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:0.0:1782759681.153879:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759681.154582:0:155103:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:0.0:1782759681.154651:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:0.0:1782759681.154667:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1782759681.154671:0:155102:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:155102:1869355212016896:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759681.154678:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.154707:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.154708:0:155102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759681.154728:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 00010000:00010000:2.0:1782759681.154730:0:155102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759681.154732:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 17 10000000:01000000:0.0:1782759681.154739:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782759681.154767:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.154776:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.154784:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.154800:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.154869:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.154898:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759681.155321:0:155102:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:155102:1869355212017664:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759681.155343:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017536 00000100:00100000:3.0:1782759681.155350:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017536 00000100:00100000:2.0:1782759681.155368:0:155102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.155387:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:3.0:1782759681.155397:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212017536:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.155405:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017664 00010000:00010000:3.0:1782759681.155409:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782759681.155411:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017664 00010000:00010000:3.0:1782759681.155425:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0545 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.155443:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00010000:00010000:3.0:1782759681.155449:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.155454:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:155102:x1869355212017664:12345-0@lo:403:qsd_reint_0.lus.0 00010000:00010000:3.0:1782759681.155462:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.155475:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf000, rc 0) 00000100:00100000:3.0:1782759681.155651:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212017536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.155658:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:3.0:1782759681.155696:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759681.155710:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.155717:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759681.155765:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.156222:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.156258:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.156282:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017792 00000100:00100000:3.0:1782759681.156287:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017792 00000100:00100000:3.0:1782759681.156318:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:3.0:1782759681.156328:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212017792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.157183:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212017792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 855us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.157192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:3.0:1782759681.157242:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.157284:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.157328:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.157395:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759681.157564:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:155102:x1869355212017664:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 2113us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759681.157575:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1782759681.157593:0:155102:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.157615:0:155102:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:155102:1869355212017664:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759681.160082:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212017920 00000100:00100000:0.0:1782759681.160094:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212017920 00000100:00100000:0.0:1782759681.160147:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:0.0:1782759681.160156:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212017920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.160409:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212017920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (3080us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.160417:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1782759681.160616:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212017920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.161331:0:155104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155104:1869355212018048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759681.161384:0:155104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.161454:0:155104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.161561:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018048 00000100:00100000:0.0:1782759681.161568:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018048 00000100:00100000:0.0:1782759681.161634:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:0.0:1782759681.161651:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:155104:x1869355212018048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759681.161869:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:155104:x1869355212018048:12345-0@lo:502:llog_process_th.0 Request processed in 217us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.161877:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:3.0:1782759681.161959:0:155104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155104:1869355212018048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759681.161988:0:155104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759681.161999:0:155104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759681.162002:0:155104:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre quota.mdt 00000020:00000080:3.0:1782759681.162009:0:155104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759681.162036:0:155104:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155104:1869355212018176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759681.162077:0:155104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.162240:0:155104:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.162274:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018176 00000100:00100000:1.0:1782759681.162279:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018176 00000100:00100000:1.0:1782759681.162302:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1782759681.162309:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:155104:x1869355212018176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759681.162466:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:155104:x1869355212018176:12345-0@lo:502:llog_process_th.0 Request processed in 158us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.162472:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:3.0:1782759681.164215:0:155104:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155104:1869355212018176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759681.164264:0:155104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759681.164272:0:155104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759681.164275:0:155104:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre quota.mdt 00000040:00080000:3.0:1782759681.164279:0:155104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 20 00000020:01000000:2.0:1782759681.164595:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 17-19 (rc=0) 10000000:01000000:2.0:1782759681.164621:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782759681.164632:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.164643:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759681.164653:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759681.164656:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 55 10000000:01000000:2.0:1782759681.164659:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759681.164691:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.164710:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.164720:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.164739:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.164790:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759681.164873:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171853d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759681.164891:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018304 00000100:00100000:2.0:1782759681.164897:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018304 00000100:00100000:2.0:1782759681.164935:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759681.164943:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212018304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759681.164955:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759681.164968:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0553 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.164989:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.164999:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.165007:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91600, rc 0) 00000100:00100000:2.0:1782759681.165043:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212018304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759681.165049:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759681.165099:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759681.165112:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.165119:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.165159:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.165182:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759681.165197:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171853d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.165594:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018432 00000100:00100000:1.0:1782759681.165600:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018432 00000100:00100000:1.0:1782759681.165624:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:1.0:1782759681.165630:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212018432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759681.165879:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212018432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.165886:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:2.0:1782759681.166037:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.166069:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.166105:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759681.166135:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171853d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.166506:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018560 00000100:00100000:1.0:1782759681.166512:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018560 00000100:00100000:1.0:1782759681.166540:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:1.0:1782759681.166547:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212018560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759681.166706:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212018560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.166713:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:1.0:1782759681.166758:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759681.167914:0:155105:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:0.0:1782759681.168127:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:0.0:1782759681.168148:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759681.168159:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.168169:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759681.168179:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782759681.168181:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:0.0:1782759681.168184:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782759681.168212:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.168220:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.168230:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.168249:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.168293:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.168327:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.168376:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018688 00000100:00100000:1.0:1782759681.168382:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018688 00000100:00100000:1.0:1782759681.168572:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1782759681.168582:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212018688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759681.168594:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759681.168606:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0561 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.168628:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.168638:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.168646:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5c00, rc 0) 00000100:00100000:1.0:1782759681.168683:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212018688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.168690:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:0.0:1782759681.168974:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759681.168995:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.169003:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.169052:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.169080:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.170153:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759681.170348:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018816 00000100:00100000:1.0:1782759681.170356:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018816 00000100:00100000:0.0:1782759681.171031:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:0.0:1782759681.171040:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212018816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.171276:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212018816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.171284:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:0.0:1782759681.171328:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.171370:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.171408:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.171423:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.171434:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212018944 00000100:00100000:0.0:1782759681.171438:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212018944 00000100:00100000:0.0:1782759681.171453:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:0.0:1782759681.171458:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212018944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.171612:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212018944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.171619:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:0.0:1782759681.171658:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212018944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.171902:0:155106:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155106:1869355212019072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759681.171934:0:155106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.171954:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019072 00000100:00100000:0.0:1782759681.171958:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019072 00000100:00100000:0.0:1782759681.171976:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:0.0:1782759681.171981:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:155106:x1869355212019072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759681.172171:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:155106:x1869355212019072:12345-0@lo:502:llog_process_th.0 Request processed in 188us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759681.172179:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:0.0:1782759681.172216:0:155106:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759681.172229:0:155106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155106:1869355212019072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759681.172253:0:155106:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759681.172264:0:155106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759681.172266:0:155106:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre quota.mdt 00000020:00000080:0.0:1782759681.172272:0:155106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782759681.172296:0:155106:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155106:1869355212019200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759681.172334:0:155106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.172354:0:155106:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.172765:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019200 00000100:00100000:3.0:1782759681.172770:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019200 00000100:00100000:3.0:1782759681.172800:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1782759681.172806:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:155106:x1869355212019200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759681.172996:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:155106:x1869355212019200:12345-0@lo:502:llog_process_th.0 Request processed in 189us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.173003:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:0.0:1782759681.174054:0:155106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:155106:1869355212019200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759681.174102:0:155106:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759681.174109:0:155106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759681.174112:0:155106:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre quota.mdt 00000040:00080000:0.0:1782759681.174117:0:155106:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:0.0:1782759681.174169:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:0.0:1782759681.174186:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782759681.174202:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.174212:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759681.174221:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782759681.174224:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759681.174227:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782759681.174257:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.174265:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759681.174274:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759681.174293:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212019328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759681.175901:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759681.175950:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759681.176103:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019328 00000100:00100000:3.0:1782759681.176111:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019328 00000100:00100000:3.0:1782759681.176167:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:3.0:1782759681.176176:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212019328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759681.176192:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759681.176210:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e056f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.176236:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.176248:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759681.176256:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcee00, rc 0) 00000100:00100000:3.0:1782759681.176309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212019328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759681.176327:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:2.0:1782759681.176638:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212019328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759681.176656:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759681.176679:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759681.176751:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212019456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759681.177128:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.177163:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171918fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759681.177221:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019456 00000100:00100000:2.0:1782759681.177226:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019456 00000100:00100000:2.0:1782759681.177301:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:2.0:1782759681.177311:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212019456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759681.178345:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212019456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1033us (1213us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759681.178355:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:1.0:1782759681.178627:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212019456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782759681.178667:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782759681.178676:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.178687:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.204817:0:155102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759681.204875:0:155102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759681.964239:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212019584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759681.964314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.964384:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212020096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759681.964413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.964442:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759681.964449:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212019712:0@lo:400:kworker.0 00000100:00100000:3.0:1782759681.964473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.964490:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212020224:0@lo:400:kworker.0 00000100:00100000:3.0:1782759681.965047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759681.965092:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020096 00000100:00100000:3.0:1782759681.965100:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020096 00000100:00100000:1.0:1782759681.965476:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212019968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.965522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759681.965547:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759681.965554:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212019840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.965575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759681.965601:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020224 00000100:00100000:1.0:1782759681.965604:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020224 00000100:00100000:1.0:1782759681.965635:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019968 00000100:00100000:1.0:1782759681.965654:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019968 00000100:00100000:1.0:1782759681.965679:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:1.0:1782759681.965687:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.965741:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212020224:12345-0@lo:400:kworker.0 Request processed in 54us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.965748:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:1.0:1782759681.965767:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1782759681.965774:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212019968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.966036:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212019968:12345-0@lo:400:kworker.0 Request processed in 262us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.966043:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1782759681.966064:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019712 00000100:00100000:1.0:1782759681.966080:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019712 00000100:00100000:1.0:1782759681.966104:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019840 00000100:00100000:1.0:1782759681.966107:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019840 00000100:00100000:1.0:1782759681.966129:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1782759681.966136:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.966171:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212020096:12345-0@lo:400:kworker.0 Request processed in 35us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.966177:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1782759681.966191:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1782759681.966197:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212019712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.966222:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212019712:12345-0@lo:400:kworker.0 Request processed in 25us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.966227:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1782759681.966239:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1782759681.966244:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212019840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.966273:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212019840:12345-0@lo:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759681.966277:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1782759681.966323:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212019840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759681.966332:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212019968:0@lo:400:kworker.0 00000100:00080000:3.0:1782759681.966484:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759681.966489:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759681.966491:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759681.966583:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212019584 00000100:00100000:2.0:1782759681.966588:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212019584 00000100:00100000:2.0:1782759681.966618:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:2.0:1782759681.966626:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212019584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759681.966660:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212019584:12345-0@lo:400:kworker.0 Request processed in 35us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759681.966666:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00100000:2.0:1782759681.966733:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212019712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759681.966743:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917190267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212020224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759681.966750:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fe5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212019584:0@lo:400:kworker.0 00000100:00100000:2.0:1782759681.966759:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212020096:0@lo:400:kworker.0 00010000:00010000:1.0:1782759682.029873:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759682.475968:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759682.475989:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212020352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759682.476062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759682.476128:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020352 00000100:00100000:1.0:1782759682.476135:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020352 00000100:00100000:1.0:1782759682.476207:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1782759682.476215:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212020352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759682.476251:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759682.476300:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212020352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759682.476307:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1782759682.476361:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212020352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759683.053492:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759683.900073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759683.900220:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327104 00000100:00100000:3.0:1782759683.900230:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327104 00000100:00100000:3.0:1782759683.900295:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2202 00000100:00100000:3.0:1782759683.900307:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:106423:x1869355197327104:12345-192.168.204.31@tcp:48:lfs.0 00000100:00080000:1.0:1782759683.901216:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759683.939115:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020480:0@lo:106: 00000100:00100000:3.0:1782759683.939186:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.939246:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759683.939414:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020480 00000100:00100000:2.0:1782759683.939423:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020480 00000100:00100000:2.0:1782759683.939491:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1782759683.939500:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212020480:12345-0@lo:106: 00010000:00010000:2.0:1782759683.939513:0:5784:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759683.939525:0:5784:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759683.939578:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212020480:12345-0@lo:106: Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759683.939599:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1782759683.940617:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020480:0@lo:106: 00000100:00100000:3.0:1782759683.962298:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020608:0@lo:106: 00000100:00100000:3.0:1782759683.962389:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.962441:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718bf4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759683.962501:0:139369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759683.962515:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020608 00000100:00100000:0.0:1782759683.962522:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020608 00000100:00100000:0.0:1782759683.962575:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1782759683.962586:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212020608:12345-0@lo:106: 00010000:00010000:0.0:1782759683.962600:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759683.962621:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759683.962686:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212020608:12345-0@lo:106: Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759683.962693:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1782759683.963391:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020608:0@lo:106: 00000100:00100000:3.0:1782759683.983361:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020736:0@lo:106: 00000100:00100000:3.0:1782759683.983424:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.983472:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020864:0@lo:106: 00000100:00100000:3.0:1782759683.983490:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.983513:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020992:0@lo:106: 00000100:00100000:3.0:1782759683.983529:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.983543:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759683.983563:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020736 00000100:00100000:3.0:1782759683.983569:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020736 00000100:00100000:3.0:1782759683.983605:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020864 00000100:00100000:3.0:1782759683.983607:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020864 00000100:00100000:3.0:1782759683.983617:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212020992 00000100:00100000:3.0:1782759683.983619:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212020992 00000100:00100000:3.0:1782759683.983632:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1782759683.983639:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:5801:x1869355212020736:12345-0@lo:106: 00010000:00010000:3.0:1782759683.983651:0:73865:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759683.983662:0:73865:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759683.983710:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:5801:x1869355212020736:12345-0@lo:106: Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.983717:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1782759683.983734:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1782759683.983751:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:5801:x1869355212020864:12345-0@lo:106: 00010000:00010000:3.0:1782759683.983758:0:73865:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759683.983766:0:73865:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759683.983813:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:5801:x1869355212020864:12345-0@lo:106: Request processed in 63us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.983819:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1782759683.983858:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1782759683.983865:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212020992:12345-0@lo:106: 00010000:00010000:3.0:1782759683.983872:0:73865:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759683.983879:0:73865:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759683.983911:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212020992:12345-0@lo:106: Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.983917:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1782759683.983956:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020736:0@lo:106: 00000100:00100000:3.0:1782759683.983965:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2323800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020864:0@lo:106: 00000100:00100000:3.0:1782759683.983972:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212020992:0@lo:106: 00000100:00100000:3.0:1782759684.009637:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212021120:0@lo:106: 00000100:00100000:3.0:1782759684.009702:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759684.009775:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212021248:0@lo:106: 00000100:00100000:3.0:1782759684.009809:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759684.009858:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212021376:0@lo:106: 00000100:00100000:3.0:1782759684.009879:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759684.009895:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084dbb240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759684.009918:0:139369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759684.009929:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021120 00000100:00100000:3.0:1782759684.009934:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021120 00000100:00100000:3.0:1782759684.009973:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021248 00000100:00100000:3.0:1782759684.009975:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021248 00000100:00100000:3.0:1782759684.009985:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021376 00000100:00100000:3.0:1782759684.009987:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021376 00000100:00100000:3.0:1782759684.010001:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1782759684.010010:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0000+8:5801:x1869355212021120:12345-0@lo:106: 00010000:00010000:3.0:1782759684.010024:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.010035:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759684.010089:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0000+8:5801:x1869355212021120:12345-0@lo:106: Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.010096:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1782759684.010231:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1782759684.010239:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:5801:x1869355212021248:12345-0@lo:106: 00010000:00010000:3.0:1782759684.010246:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.010254:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759684.010300:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:5801:x1869355212021248:12345-0@lo:106: Request processed in 62us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.010306:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1782759684.010318:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1782759684.010324:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212021376:12345-0@lo:106: 00010000:00010000:3.0:1782759684.010332:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.010339:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759684.010372:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5801:x1869355212021376:12345-0@lo:106: Request processed in 49us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.010378:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1782759684.011030:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212021504:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759684.011068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759684.011322:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212021120:0@lo:106: 00000100:00100000:3.0:1782759684.011334:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212021248:0@lo:106: 00000100:00100000:3.0:1782759684.011341:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5801:1869355212021376:0@lo:106: 00000100:00100000:3.0:1782759684.011475:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:106423:x1869355197327104:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 111169us (111410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.011484:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2202 00000100:00100000:2.0:1782759684.011692:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021504 00000100:00100000:2.0:1782759684.011698:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021504 00000100:00100000:2.0:1782759684.011737:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1782759684.011746:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212021504:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759684.012652:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212021504:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 904us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.012661:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1782759684.012734:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212021504:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759684.037229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.037415:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327232 00000100:00100000:1.0:1782759684.037425:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327232 00000100:00100000:1.0:1782759684.037483:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2203 00000100:00100000:1.0:1782759684.037493:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:106424:x1869355197327232:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.037514:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.037539:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e057d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.037572:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.037586:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.037598:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.037691:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e057d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670e0 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.037724:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670e0 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.037733:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759684.037736:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759684.037739:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5200, rc 0) 00000100:00100000:1.0:1782759684.037813:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:106424:x1869355197327232:12345-192.168.204.31@tcp:101:ls.0 Request processed in 321us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.037877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2203 00000100:00100000:3.0:1782759684.052638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.052760:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327360 00000100:00100000:2.0:1782759684.052770:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327360 00000100:00100000:2.0:1782759684.052880:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 298 00000100:00100000:2.0:1782759684.052891:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:106424:x1869355197327360:12345-192.168.204.31@tcp:37:ls.0 00000100:00100000:2.0:1782759684.056955:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:106424:x1869355197327360:12345-192.168.204.31@tcp:37:ls.0 Request processed in 4055us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.056970:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 298 00000100:00100000:0.0:1782759684.062265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.062351:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327488 00000100:00100000:3.0:1782759684.062374:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327488 00000100:00100000:3.0:1782759684.062434:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2204 00000100:00100000:3.0:1782759684.062447:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:106424:x1869355197327488:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.062468:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.062487:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e058b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670e7 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.062585:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0592 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.062598:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0592 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.062609:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0592 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759684.062982:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782759684.062987:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759684.063080:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0592 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.063178:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e058b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670e7 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.063198:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0592 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670e7 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.063206:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171908a1000) 00010000:00010000:3.0:1782759684.063209:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759684.063212:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf800, rc 0) 00000100:00100000:3.0:1782759684.063280:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106424:x1869355197327488:12345-192.168.204.31@tcp:101:ls.0 Request processed in 835us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.063287:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2204 00000100:00100000:3.0:1782759684.066496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.066679:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327616 00000100:00100000:1.0:1782759684.066690:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327616 00000100:00100000:1.0:1782759684.066749:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2205 00000100:00100000:1.0:1782759684.066759:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106424:x1869355197327616:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.066780:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.067017:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e0599 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670ee expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.067053:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777e05a0 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.067066:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777e05a0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.067076:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777e05a0 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.067184:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e0599 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670ee expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.067208:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777e05a0 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670ee expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.067216:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171908a1000) 00010000:00010000:1.0:1782759684.067219:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759684.067222:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4600, rc 0) 00000100:00100000:1.0:1782759684.067271:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106424:x1869355197327616:12345-192.168.204.31@tcp:101:ls.0 Request processed in 513us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.067278:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2205 00000100:00100000:0.0:1782759684.071025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.071124:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327744 00000100:00100000:1.0:1782759684.071135:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327744 00000100:00100000:1.0:1782759684.071188:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2206 00000100:00100000:1.0:1782759684.071199:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106424:x1869355197327744:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.071217:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.071236:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e05a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670f5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.071295:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.071308:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.071318:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.071371:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.071393:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.071401:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072366:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 3/1,0 mode: --/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072377:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 3/1,0 mode: PR/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072385:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 3/1,0 mode: PR/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759684.072418:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000040c:0x2:0x0]: returning size 524288 00000004:00200000:1.0:1782759684.072423:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759684.072441:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 3/1,0 mode: PR/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072452:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 3/1,0 mode: PR/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072461:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072467:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072474:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072489:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.072492:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072500:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072511:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759684.072514:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.072519:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072525:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e05ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072537:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072542:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072548:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072553:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.072556:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072561:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072577:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c087947 (ffff9171889c5e00) 00010000:00010000:1.0:1782759684.072580:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.072582:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072588:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e05b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072618:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e05a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670f5 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072631:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 3/0,0 mode: PR/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670f5 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.072637:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000040c:0x2:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759684.072640:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759684.072641:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5a00, rc 0) 00000100:00100000:1.0:1782759684.072801:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:106424:x1869355197327744:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1604us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.072810:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2206 00000100:00100000:0.0:1782759684.075916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.076096:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197327872 00000100:00100000:2.0:1782759684.076118:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197327872 00000100:00100000:2.0:1782759684.076191:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1033 00000100:00100000:2.0:1782759684.076200:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2364:x1869355197327872:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.076218:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.076238:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d0ada0/0xdd99f5c4777e05c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf670fc expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759684.076263:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 524288, mtime: 0x6a42bf3d, atime: 0x0, ctime: 0x6a42bf3d, blocks: 0x403 00010000:00010000:2.0:1782759684.076292:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=3752s v=(0 0) 00010000:00010000:2.0:1782759684.076297:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759684.076306:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d0ada0/0xdd99f5c4777e05c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670fc expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.076323:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023d0ada0/0xdd99f5c4777e05c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670fc expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.076335:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782759684.076380:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197327872:12345-192.168.204.31@tcp:101:ls.0 Request processed in 181us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.076387:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1033 00010000:00010000:2.0:1782759684.076453:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782759684.076540:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759684.079941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.080373:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328000 00000100:00100000:3.0:1782759684.080384:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328000 00000100:00100000:3.0:1782759684.080483:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2207 00000100:00100000:3.0:1782759684.080495:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:106424:x1869355197328000:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.080517:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.080540:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e05ca lrc: 2/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67103 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.080576:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e05d1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.080589:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e05d1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.080600:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e05d1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.080694:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e05ca lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67103 expref: 11 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.080712:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e05d1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67103 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.080721:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759684.080724:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759684.080733:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcec00, rc 0) 00000100:00100000:3.0:1782759684.080802:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:106424:x1869355197328000:12345-192.168.204.31@tcp:101:ls.0 Request processed in 309us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.080810:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2207 00000100:00100000:0.0:1782759684.084047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.084237:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328128 00000100:00100000:3.0:1782759684.084246:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328128 00000100:00100000:3.0:1782759684.084357:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2208 00000100:00100000:3.0:1782759684.084368:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:106424:x1869355197328128:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.084389:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.084409:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e05d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6710a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.084466:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.084480:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.084492:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.084505:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.084511:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.084518:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.085016:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e05ed lrc: 3/1,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.085032:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e05ed lrc: 3/1,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.085040:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e05ed lrc: 3/1,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759684.085567:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000416:0x1:0x0]: returning size 7168 00000004:00200000:2.0:1782759684.085572:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759684.085654:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e05ed lrc: 3/1,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085667:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085673:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085681:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085686:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.085696:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085703:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085716:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:2.0:1782759684.085719:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.085724:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085731:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e05df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085744:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085750:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085755:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085761:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfa00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.085764:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085769:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085777:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3c02e81 (ffff9171908a1400) 00010000:00010000:2.0:1782759684.085780:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.085798:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085805:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e05e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085969:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e05d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6710a expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085985:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e05ed lrc: 3/0,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6710a expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.085992:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000416:0x1:0x0].0x0 (ffff9171908a1200) 00010000:00010000:2.0:1782759684.085994:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759684.085996:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf400, rc 0) 00000100:00100000:2.0:1782759684.086123:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:106424:x1869355197328128:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1754us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.086131:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2208 00000100:00100000:0.0:1782759684.089478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.089565:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328256 00000100:00100000:3.0:1782759684.089575:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328256 00000100:00100000:3.0:1782759684.089634:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2209 00000100:00100000:3.0:1782759684.089644:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:106424:x1869355197328256:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.089667:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.089688:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e05f4 lrc: 2/0,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67111 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.089724:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e05fb lrc: 3/1,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.089737:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e05fb lrc: 3/1,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.089748:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e05fb lrc: 3/1,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.089888:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e05f4 lrc: 0/0,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67111 expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.089909:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e05fb lrc: 3/0,0 mode: PR/PR res: [0x200000416:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67111 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.089931:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000416:0x1:0x0].0x0 (ffff9171908a1200) 00010000:00010000:3.0:1782759684.089934:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759684.089938:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce600, rc 0) 00000100:00100000:3.0:1782759684.089988:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:106424:x1869355197328256:12345-192.168.204.31@tcp:101:ls.0 Request processed in 345us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.089995:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2209 00000100:00100000:1.0:1782759684.093428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.093524:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328384 00000100:00100000:2.0:1782759684.093535:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328384 00000100:00100000:2.0:1782759684.093603:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2210 00000100:00100000:2.0:1782759684.093614:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:106424:x1869355197328384:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.093636:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.093658:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67118 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.093719:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.093750:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.093761:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.093779:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.093785:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.093804:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094285:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0617 lrc: 3/1,0 mode: --/PR res: [0x200000410:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094294:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0617 lrc: 3/1,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094302:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0617 lrc: 3/1,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759684.094458:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000410:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759684.094462:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759684.094538:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0617 lrc: 3/1,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094552:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094569:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094577:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094582:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.094587:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094595:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094608:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:2.0:1782759684.094611:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.094616:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094622:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094634:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094641:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094647:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094653:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.094661:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094668:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094676:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x256cbcf9 (ffff9171c08f6200) 00010000:00010000:2.0:1782759684.094678:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.094681:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094687:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e0610 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094726:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67118 expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094739:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0617 lrc: 3/0,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67118 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.094747:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000410:0x1:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:2.0:1782759684.094749:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759684.094752:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759684.094815:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:106424:x1869355197328384:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1203us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.094856:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2210 00000100:00100000:0.0:1782759684.099082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.099286:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328512 00000100:00100000:1.0:1782759684.099295:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328512 00000100:00100000:1.0:1782759684.099358:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2211 00000100:00100000:1.0:1782759684.099368:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:106424:x1869355197328512:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.099387:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.099419:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e061e lrc: 2/0,0 mode: --/PR res: [0x200000410:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6711f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.099452:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0625 lrc: 3/1,0 mode: --/PR res: [0x200000410:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.099466:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0625 lrc: 3/1,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.099476:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0625 lrc: 3/1,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.099564:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e061e lrc: 0/0,0 mode: --/PR res: [0x200000410:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6711f expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.099583:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0625 lrc: 3/0,0 mode: PR/PR res: [0x200000410:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6711f expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.099591:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000410:0x1:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:1.0:1782759684.099594:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759684.099597:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c5400, rc 0) 00000100:00100000:1.0:1782759684.099661:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:106424:x1869355197328512:12345-192.168.204.31@tcp:101:ls.0 Request processed in 294us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.099669:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2211 00000100:00100000:0.0:1782759684.103209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.103338:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328640 00000100:00100000:3.0:1782759684.103348:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328640 00000100:00100000:3.0:1782759684.103429:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2212 00000100:00100000:3.0:1782759684.103438:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+14:106424:x1869355197328640:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.103455:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.103473:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e062c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67126 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.103533:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.103547:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.103558:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.103572:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.103580:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.103611:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104123:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e0641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104134:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e0641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104143:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e0641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759684.104308:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:3.0:1782759684.104313:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759684.104402:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e0641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104417:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104423:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104430:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104436:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759684.104440:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104448:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104469:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:3.0:1782759684.104472:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759684.104477:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104483:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e0633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104495:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104501:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104507:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104512:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759684.104515:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104522:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104529:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9171908a1600) 00010000:00010000:3.0:1782759684.104531:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759684.104534:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104539:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e063a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104582:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e062c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67126 expref: 16 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104595:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e0641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67126 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.104602:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759684.104604:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759684.104607:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce800, rc 0) 00000100:00100000:3.0:1782759684.104731:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:106424:x1869355197328640:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1292us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.104739:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2212 00000100:00100000:3.0:1782759684.109113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.109208:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328768 00000100:00100000:2.0:1782759684.109219:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328768 00000100:00100000:2.0:1782759684.109308:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2213 00000100:00100000:2.0:1782759684.109319:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:106424:x1869355197328768:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.109352:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.109373:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0648 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6712d expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.109407:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e064f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.109419:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e064f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.109429:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e064f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.109524:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e0648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6712d expref: 17 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.109544:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e064f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6712d expref: 16 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.109552:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782759684.109555:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759684.109559:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91c00, rc 0) 00000100:00100000:2.0:1782759684.109623:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:106424:x1869355197328768:12345-192.168.204.31@tcp:101:ls.0 Request processed in 306us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.109632:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2213 00000100:00100000:2.0:1782759684.112163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.114485:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197328896 00000100:00100000:1.0:1782759684.114499:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197328896 00000100:00100000:1.0:1782759684.114571:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2214 00000100:00100000:1.0:1782759684.114582:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+16:106424:x1869355197328896:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.114606:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.114643:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e0656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67134 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.114731:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.114744:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.114755:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.114769:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.114776:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.114783:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115190:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e066b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115200:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e066b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115207:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e066b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759684.115382:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x6:0x0]: returning size 7680 00000004:00200000:1.0:1782759684.115387:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759684.115463:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e066b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115481:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115489:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115496:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115502:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.115506:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115513:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115525:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759684.115528:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.115532:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115538:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e065d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115550:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115556:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115562:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115572:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.115574:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115580:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115588:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f98a5d6 (ffff9171889c5e00) 00010000:00010000:1.0:1782759684.115590:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.115593:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115598:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e0664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115628:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e0656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67134 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115641:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e066b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67134 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.115648:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x6:0x0].0x0 (ffff9171889c5500) 00010000:00010000:1.0:1782759684.115650:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759684.115653:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171a93c4200, rc 0) 00000100:00100000:1.0:1782759684.115726:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:106424:x1869355197328896:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1145us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.115734:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2214 00000100:00100000:0.0:1782759684.120637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.120729:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329024 00000100:00100000:1.0:1782759684.120754:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329024 00000100:00100000:3.0:1782759684.121323:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2215 00000100:00100000:3.0:1782759684.121338:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+17:106424:x1869355197329024:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.121359:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.121381:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0672 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6713b expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.121417:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0679 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.121429:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0679 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.121440:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0679 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.121542:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e0672 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6713b expref: 19 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.121561:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0679 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6713b expref: 18 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.121570:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x6:0x0].0x0 (ffff9171889c5500) 00010000:00010000:3.0:1782759684.121573:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759684.121577:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcfc00, rc 0) 00000100:00100000:3.0:1782759684.121700:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:106424:x1869355197329024:12345-192.168.204.31@tcp:101:ls.0 Request processed in 367us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.121709:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2215 00000100:00100000:3.0:1782759684.125993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759684.126460:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329152 00000100:00100000:0.0:1782759684.126472:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329152 00000100:00100000:0.0:1782759684.126538:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2216 00000100:00100000:0.0:1782759684.126549:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+18:106424:x1869355197329152:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.126572:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.126593:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67142 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.126657:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777e0687 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.126671:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777e0687 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.126697:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777e0687 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759684.127322:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x7:0x0]: returning size 7680 00000004:00200000:0.0:1782759684.127328:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759684.127418:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777e0687 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.127445:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67142 expref: 20 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.127461:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777e0687 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67142 expref: 19 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.127469:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759684.127471:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759684.127474:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f99800, rc 0) 00000100:00100000:0.0:1782759684.127537:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:106424:x1869355197329152:12345-192.168.204.31@tcp:101:ls.0 Request processed in 990us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.127544:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2216 00000100:00100000:2.0:1782759684.130073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.130156:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329280 00000100:00100000:3.0:1782759684.130165:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329280 00000100:00100000:3.0:1782759684.130231:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2217 00000100:00100000:3.0:1782759684.130311:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+19:106424:x1869355197329280:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.130330:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.130349:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e068e lrc: 2/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67149 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.130378:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0695 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.130390:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0695 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.130414:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0695 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.130490:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e068e lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67149 expref: 21 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.130505:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0695 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67149 expref: 20 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.130513:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70100) 00010000:00010000:3.0:1782759684.130516:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759684.130518:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce400, rc 0) 00000100:00100000:3.0:1782759684.130568:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:106424:x1869355197329280:12345-192.168.204.31@tcp:101:ls.0 Request processed in 328us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.130574:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2217 00000100:00100000:2.0:1782759684.134151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.134348:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329408 00000100:00100000:3.0:1782759684.134358:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329408 00000100:00100000:3.0:1782759684.134414:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2218 00000100:00100000:3.0:1782759684.134425:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+20:106424:x1869355197329408:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.134446:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.134466:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e069c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67150 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.134532:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e06a3 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.134545:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e06a3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.134569:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e06a3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759684.134867:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0xc:0x0]: returning size 7680 00000004:00200000:3.0:1782759684.134871:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759684.134956:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e06a3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.134983:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e069c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67150 expref: 22 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.135005:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e06a3 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67150 expref: 21 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.135013:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759684.135016:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759684.135019:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf200, rc 0) 00000100:00100000:2.0:1782759684.135775:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:106424:x1869355197329408:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1349us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.135802:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2218 00000100:00100000:2.0:1782759684.138586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759684.138662:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329536 00000100:00100000:0.0:1782759684.138672:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329536 00000100:00100000:0.0:1782759684.138721:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2219 00000100:00100000:0.0:1782759684.138730:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+21:106424:x1869355197329536:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.138751:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.138770:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06aa lrc: 2/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67157 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.138862:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777e06b1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.138875:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777e06b1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.138886:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777e06b1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.138988:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06aa lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67157 expref: 23 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.139006:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777e06b1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67157 expref: 22 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.139014:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1600) 00010000:00010000:0.0:1782759684.139017:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759684.139021:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98e00, rc 0) 00000100:00100000:0.0:1782759684.139091:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:106424:x1869355197329536:12345-192.168.204.31@tcp:101:ls.0 Request processed in 361us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.139098:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2219 00000100:00100000:0.0:1782759684.143519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.143812:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329664 00000100:00100000:1.0:1782759684.143949:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329664 00000100:00100000:1.0:1782759684.144001:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2220 00000100:00100000:1.0:1782759684.144011:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+22:106424:x1869355197329664:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.144034:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.144055:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e06b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6715e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.144647:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.144665:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.144677:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.144692:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.144699:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.144705:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145223:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e06cd lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145233:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e06cd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145252:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e06cd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759684.145347:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 7680 00000004:00200000:1.0:1782759684.145351:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759684.145430:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e06cd lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145443:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145449:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145456:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145461:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c4800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.145465:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145474:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145487:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759684.145490:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.145495:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145502:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4800/0xdd99f5c4777e06bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145524:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145531:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145536:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145541:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171a93c5e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.145571:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145578:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145585:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff9171889c5e00) 00010000:00010000:1.0:1782759684.145588:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.145591:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145597:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5e00/0xdd99f5c4777e06c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145629:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5600/0xdd99f5c4777e06b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6715e expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145642:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e06cd lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6715e expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.145660:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5900) 00010000:00010000:1.0:1782759684.145662:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759684.145665:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759684.145738:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+23:106424:x1869355197329664:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1726us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.145746:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2220 00000100:00100000:2.0:1782759684.149907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.150159:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329792 00000100:00100000:3.0:1782759684.150176:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329792 00000100:00100000:3.0:1782759684.150239:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2221 00000100:00100000:3.0:1782759684.150335:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+23:106424:x1869355197329792:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.150356:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.150377:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e06d4 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67165 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.150412:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e06db lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.150439:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e06db lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.150450:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e06db lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.150536:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e06d4 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67165 expref: 25 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.150553:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e06db lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67165 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.150561:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5900) 00010000:00010000:3.0:1782759684.150564:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759684.150567:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcfa00, rc 0) 00000100:00100000:3.0:1782759684.150623:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+24:106424:x1869355197329792:12345-192.168.204.31@tcp:101:ls.0 Request processed in 292us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759684.158465:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2221 00000100:00100000:2.0:1782759684.161017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.164316:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197329920 00000100:00100000:1.0:1782759684.164330:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197329920 00000100:00100000:0.0:1782759684.164459:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2222 00000100:00100000:0.0:1782759684.164471:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+24:106424:x1869355197329920:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.164494:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.164513:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e06e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6716c expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.164592:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.164607:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.164619:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.164634:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.164641:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.164648:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165196:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777e06f7 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165206:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777e06f7 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165214:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777e06f7 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759684.165384:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000417:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759684.165389:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759684.165472:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777e06f7 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165496:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165502:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165509:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165514:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759684.165517:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165524:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165536:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:0.0:1782759684.165539:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759684.165544:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165550:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e06e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165562:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165568:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165573:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165584:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f98a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759684.165587:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165593:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165601:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff917183a70f00) 00010000:00010000:0.0:1782759684.165604:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759684.165607:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165612:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e06f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165645:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e06e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6716c expref: 26 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165658:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777e06f7 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6716c expref: 25 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.165666:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759684.165669:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759684.165671:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98400, rc 0) 00000100:00100000:0.0:1782759684.165755:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+25:106424:x1869355197329920:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1285us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.165762:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2222 00000100:00100000:0.0:1782759684.172227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.172308:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330048 00000100:00100000:3.0:1782759684.172321:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330048 00000100:00100000:3.0:1782759684.172387:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2223 00000100:00100000:3.0:1782759684.172397:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+25:106424:x1869355197330048:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:3.0:1782759684.172418:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759684.172439:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e06fe lrc: 2/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67173 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.172477:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0705 lrc: 3/1,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.172498:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0705 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.172509:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0705 lrc: 3/1,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.173412:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce000/0xdd99f5c4777e06fe lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67173 expref: 27 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.173434:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0705 lrc: 3/0,0 mode: PR/PR res: [0x200000417:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67173 expref: 26 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759684.173443:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:3.0:1782759684.173446:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759684.173450:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:2.0:1782759684.173743:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+26:106424:x1869355197330048:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1346us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.173753:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2223 00000100:00100000:3.0:1782759684.177454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.177734:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330176 00000100:00100000:1.0:1782759684.177744:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330176 00000100:00100000:1.0:1782759684.177909:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2224 00000100:00100000:1.0:1782759684.177921:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+26:106424:x1869355197330176:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.177942:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.177962:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e070c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6717a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.178024:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.178039:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.178051:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.178067:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.178096:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.178348:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.179775:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e0721 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.179807:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e0721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.179817:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e0721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759684.180295:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782759684.180300:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759684.180388:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e0721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180403:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180410:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180417:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180423:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759684.180427:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180435:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180449:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:0.0:1782759684.180453:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759684.180457:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180472:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180487:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180494:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180499:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180504:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759684.180507:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180512:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180520:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6cb9a5d (ffff9171889c5e00) 00010000:00010000:0.0:1782759684.180522:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759684.180525:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180531:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e071a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180567:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e070c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6717a expref: 28 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180654:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e0721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6717a expref: 27 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.180668:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759684.180670:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759684.180673:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98600, rc 0) 00000100:00100000:0.0:1782759684.180818:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+27:106424:x1869355197330176:12345-192.168.204.31@tcp:101:ls.0 Request processed in 2898us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.180853:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2224 00000100:00100000:1.0:1782759684.184492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759684.184651:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330304 00000100:00100000:0.0:1782759684.184661:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330304 00000100:00100000:0.0:1782759684.184716:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2225 00000100:00100000:0.0:1782759684.184727:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+27:106424:x1869355197330304:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.184749:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.184769:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0728 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67181 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.184816:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e072f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.185000:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e072f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.185013:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e072f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.185130:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0728 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67181 expref: 29 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.185150:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e072f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67181 expref: 28 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.185166:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759684.185169:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759684.185173:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98800, rc 0) 00000100:00100000:0.0:1782759684.185234:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+28:106424:x1869355197330304:12345-192.168.204.31@tcp:101:ls.0 Request processed in 508us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.185241:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2225 00000100:00100000:2.0:1782759684.189433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.189683:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330432 00000100:00100000:1.0:1782759684.189693:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330432 00000100:00100000:1.0:1782759684.189753:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2226 00000100:00100000:1.0:1782759684.189763:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+28:106424:x1869355197330432:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.189781:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.189812:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67188 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.189907:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.189922:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.189933:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.189948:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.189954:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.189976:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.190808:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e074b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.190818:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e074b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.191301:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e074b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759684.191482:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782759684.191487:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759684.191569:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e074b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192028:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192037:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192044:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192049:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.192053:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192060:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192082:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759684.192084:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.192089:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192095:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e073d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192388:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192396:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192402:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192407:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759684.192410:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192416:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192424:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x61f65a1e (ffff9171889c5c00) 00010000:00010000:1.0:1782759684.192426:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759684.192429:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192435:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e0744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192483:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67188 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192496:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e074b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67188 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.192503:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:1.0:1782759684.192505:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759684.192507:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031800, rc 0) 00000100:00100000:1.0:1782759684.192690:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+29:106424:x1869355197330432:12345-192.168.204.31@tcp:101:ls.0 Request processed in 2928us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.192699:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2226 00000100:00100000:2.0:1782759684.196466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759684.196650:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330560 00000100:00100000:0.0:1782759684.196660:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330560 00000100:00100000:0.0:1782759684.196755:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2227 00000100:00100000:0.0:1782759684.196765:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+29:106424:x1869355197330560:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.196797:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.196819:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0752 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6718f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.196892:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0759 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.196905:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0759 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.196916:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0759 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.197007:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98a00/0xdd99f5c4777e0752 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6718f expref: 31 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.197026:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0759 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6718f expref: 30 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.197041:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:0.0:1782759684.197044:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759684.197048:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082f98000, rc 0) 00000100:00100000:0.0:1782759684.197311:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+30:106424:x1869355197330560:12345-192.168.204.31@tcp:101:ls.0 Request processed in 339us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.197319:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2227 00000100:00100000:2.0:1782759684.200889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759684.200981:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330688 00000100:00100000:0.0:1782759684.200992:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330688 00000100:00100000:0.0:1782759684.201063:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2228 00000100:00100000:0.0:1782759684.201073:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+30:106424:x1869355197330688:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.201095:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.201152:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e0760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67196 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.201252:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0767 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.201265:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0767 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.201276:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0767 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759684.201543:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x15:0x0]: returning size 7680 00000004:00200000:0.0:1782759684.201548:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759684.201634:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0767 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.201671:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e0760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67196 expref: 32 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.201689:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0767 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67196 expref: 31 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.201698:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759684.201701:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759684.201705:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75200, rc 0) 00000100:00100000:0.0:1782759684.201794:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+31:106424:x1869355197330688:12345-192.168.204.31@tcp:101:ls.0 Request processed in 713us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.201802:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2228 00000100:00100000:3.0:1782759684.206354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.206456:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330816 00000100:00100000:2.0:1782759684.206466:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330816 00000100:00100000:2.0:1782759684.206527:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2229 00000100:00100000:2.0:1782759684.206537:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+31:106424:x1869355197330816:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.206558:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.206578:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e076e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6719d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.206642:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.206656:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.206667:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.208470:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.208501:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.208512:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.209528:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0783 lrc: 3/1,0 mode: --/PR res: [0x200000412:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.209539:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0783 lrc: 3/1,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.209548:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0783 lrc: 3/1,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759684.210255:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000412:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759684.210261:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759684.210344:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0783 lrc: 3/1,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210359:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210366:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210373:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210379:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.210384:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210399:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210413:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:2.0:1782759684.210417:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.210421:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210428:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e0775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210440:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210446:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210452:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210457:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.210460:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210465:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210472:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a524b64 (ffff9171c08f6200) 00010000:00010000:2.0:1782759684.210474:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.210476:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210492:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e077c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210535:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e076e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6719d expref: 33 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210549:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0783 lrc: 3/0,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6719d expref: 32 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.210555:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000412:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:2.0:1782759684.210558:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759684.210560:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759684.210682:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+32:106424:x1869355197330816:12345-192.168.204.31@tcp:101:ls.0 Request processed in 4145us (4337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.210690:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2229 00000100:00100000:3.0:1782759684.214238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.214318:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197330944 00000100:00100000:2.0:1782759684.214329:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197330944 00000100:00100000:2.0:1782759684.214389:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2230 00000100:00100000:2.0:1782759684.214398:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+32:106424:x1869355197330944:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.214420:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.214440:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e078a lrc: 2/0,0 mode: --/PR res: [0x200000412:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671a4 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.214477:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0791 lrc: 3/1,0 mode: --/PR res: [0x200000412:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.214491:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0791 lrc: 3/1,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.214515:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0791 lrc: 3/1,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.214604:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e078a lrc: 0/0,0 mode: --/PR res: [0x200000412:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671a4 expref: 34 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.214623:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0791 lrc: 3/0,0 mode: PR/PR res: [0x200000412:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671a4 expref: 33 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.214632:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000412:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:2.0:1782759684.214635:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759684.214638:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759684.214700:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+33:106424:x1869355197330944:12345-192.168.204.31@tcp:101:ls.0 Request processed in 302us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.214707:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2230 00000100:00100000:1.0:1782759684.219036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759684.219264:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331072 00000100:00100000:0.0:1782759684.219276:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331072 00000100:00100000:0.0:1782759684.219336:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2231 00000100:00100000:0.0:1782759684.219346:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+33:106424:x1869355197331072:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:0.0:1782759684.219368:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759684.219388:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e0798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671ab expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.219454:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.219469:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.219479:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.219506:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.219513:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.219520:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220169:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e07ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220179:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e07ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220188:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e07ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759684.220348:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:0.0:1782759684.220352:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759684.220434:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e07ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220447:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220454:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220460:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220478:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759684.220482:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220489:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220502:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:0.0:1782759684.220505:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759684.220510:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220516:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e079f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220529:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220534:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220539:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220544:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759684.220547:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220552:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220570:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff917183a70c00) 00010000:00010000:0.0:1782759684.220572:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759684.220575:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220581:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e07a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220613:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e0798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ab expref: 35 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220626:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e07ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ab expref: 34 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759684.220633:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759684.220635:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759684.220637:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74c00, rc 0) 00000100:00100000:0.0:1782759684.220774:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+34:106424:x1869355197331072:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1419us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759684.220783:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2231 00000100:00100000:3.0:1782759684.225935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.226688:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331200 00000100:00100000:1.0:1782759684.226700:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331200 00000100:00100000:1.0:1782759684.226777:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2232 00000100:00100000:1.0:1782759684.226796:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+34:106424:x1869355197331200:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759684.226818:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759684.226880:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e07b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671b2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.226918:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e07bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.226931:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e07bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.226962:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e07bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.227056:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e07b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671b2 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.227075:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e07bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671b2 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759684.227084:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff917183a70400) 00010000:00010000:1.0:1782759684.227087:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759684.227090:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031400, rc 0) 00000100:00100000:1.0:1782759684.227150:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+35:106424:x1869355197331200:12345-192.168.204.31@tcp:101:ls.0 Request processed in 364us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.227158:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2232 00000100:00100000:0.0:1782759684.234757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.234929:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331328 00000100:00100000:2.0:1782759684.234940:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331328 00000100:00100000:2.0:1782759684.235001:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2233 00000100:00100000:2.0:1782759684.235012:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+35:106424:x1869355197331328:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.235035:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.235056:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e07c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671b9 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235119:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235134:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235158:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235174:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235181:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235187:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235560:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e07d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235569:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e07d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.235576:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e07d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759684.235742:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:2.0:1782759684.235747:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759684.236091:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e07d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236105:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236112:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236129:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236135:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.236139:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236146:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236160:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:2.0:1782759684.236163:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.236167:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236173:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e07c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236185:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236190:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236195:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236200:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759684.236203:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236218:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236227:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9171c08f6200) 00010000:00010000:2.0:1782759684.236229:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759684.236232:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236237:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236282:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e07c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671b9 expref: 37 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236297:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e07d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671b9 expref: 36 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.236305:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759684.236307:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759684.236310:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782759684.236391:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+36:106424:x1869355197331328:12345-192.168.204.31@tcp:101:ls.0 Request processed in 1380us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.236399:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2233 00000100:00100000:3.0:1782759684.245309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759684.245617:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331456 00000100:00100000:2.0:1782759684.245628:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331456 00000100:00100000:2.0:1782759684.245742:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2234 00000100:00100000:2.0:1782759684.245753:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+36:106424:x1869355197331456:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:2.0:1782759684.245800:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759684.245859:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e07de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671c0 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.245898:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.245912:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.245923:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.246015:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e07de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671c0 expref: 38 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.246033:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671c0 expref: 37 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.246041:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:2.0:1782759684.246044:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759684.246048:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91200, rc 0) 00000100:00100000:2.0:1782759684.246140:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+37:106424:x1869355197331456:12345-192.168.204.31@tcp:101:ls.0 Request processed in 389us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.246147:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2234 00000100:00100000:3.0:1782759684.281648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759684.281698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759684.281810:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331712 00000100:00100000:1.0:1782759684.281820:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331712 00000100:00100000:1.0:1782759684.281933:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2146 00000100:00100000:1.0:1782759684.281943:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197331712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759684.282021:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197331712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759684.282028:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2146 00000100:00080000:3.0:1782759684.282181:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759684.282671:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331584 00000100:00100000:2.0:1782759684.282677:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331584 00000100:00100000:2.0:1782759684.282718:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2973 00000100:00100000:2.0:1782759684.282727:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197331584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759684.282798:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197331584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.282806:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2973 00000100:00100000:3.0:1782759685.035963:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759685.035987:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212021632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759685.036053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759685.036116:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021632 00000100:00100000:3.0:1782759685.036123:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021632 00000100:00100000:3.0:1782759685.036191:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1782759685.036200:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212021632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759685.036234:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759685.036284:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212021632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759685.036292:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00080000:3.0:1782759685.036313:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759685.036345:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212021632:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759685.080074:0:155241:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf201c850 20000000:00000080:0.0:1782759685.080090:0:155241:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbfc00 uarg=0000000000000000 00010000:00010000:0.0:1782759685.081755:0:155241:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 32. 00010000:00010000:0.0:1782759685.082682:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000412:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:0.0:1782759685.082687:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.082698:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0791 lrc: 0/0,0 mode: --/PR res: [0x200000412:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671a4 expref: 36 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082737:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000040c:0x2:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:0.0:1782759685.082740:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759685.082745:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5a00/0xdd99f5c4777e05bc lrc: 0/0,0 mode: --/PR res: [0x20000040c:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670f5 expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082766:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x6:0x0].0x0 (ffff9171889c5500) 00010000:00010000:0.0:1782759685.082778:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.082783:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4200/0xdd99f5c4777e066b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67134 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082796:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000410:0x1:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:0.0:1782759685.082798:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.082802:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0617 lrc: 0/0,0 mode: --/PR res: [0x200000410:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67118 expref: 33 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082815:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1600) 00010000:00010000:0.0:1782759685.082817:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.082877:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98e00/0xdd99f5c4777e06b1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67157 expref: 32 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082897:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x15:0x0].0x0 (ffff917183a70d00) 00010000:00010000:0.0:1782759685.082900:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.082906:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0767 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x15:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67196 expref: 31 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082921:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171908a1000) 00010000:00010000:0.0:1782759685.082929:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.082934:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf800/0xdd99f5c4777e0592 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670e7 expref: 30 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082949:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:0.0:1782759685.082952:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.082955:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce800/0xdd99f5c4777e0641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67126 expref: 29 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082967:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5900) 00010000:00010000:0.0:1782759685.082969:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.082974:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfa00/0xdd99f5c4777e06db lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67165 expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.082989:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759685.082991:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.082995:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0705 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67173 expref: 27 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083007:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759685.083009:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083013:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e07bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671b2 expref: 26 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083025:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1e:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:0.0:1782759685.083027:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083031:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcec00/0xdd99f5c4777e05d1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67103 expref: 25 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083057:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759685.083060:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083064:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f99800/0xdd99f5c4777e0687 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67142 expref: 24 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083076:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759685.083078:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083082:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98800/0xdd99f5c4777e072f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67181 expref: 23 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083094:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:0.0:1782759685.083096:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083099:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91200/0xdd99f5c4777e07e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671c0 expref: 22 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083111:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000416:0x1:0x0].0x0 (ffff9171908a1200) 00010000:00010000:0.0:1782759685.083113:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083116:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e05fb lrc: 0/0,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67111 expref: 21 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083126:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0xc:0x0].0x0 (ffff9171908a1600) 00010000:00010000:0.0:1782759685.083128:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083132:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e06a3 lrc: 0/0,0 mode: --/PR res: [0x200000418:0xc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67150 expref: 20 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083145:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:0.0:1782759685.083153:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083159:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98000/0xdd99f5c4777e0759 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6718f expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083173:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:0.0:1782759685.083175:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083179:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5200/0xdd99f5c4777e0584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670e0 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083192:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000410:0x1:0x0].0x0 (ffff9171c08f6100) 00010000:00010000:0.0:1782759685.083194:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083198:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c5400/0xdd99f5c4777e0625 lrc: 0/0,0 mode: --/PR res: [0x200000410:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6711f expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083221:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5900) 00010000:00010000:0.0:1782759685.083224:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083227:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e06cd lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6715e expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083242:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000412:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:0.0:1782759685.083245:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083248:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0783 lrc: 0/0,0 mode: --/PR res: [0x200000412:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6719d expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083261:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x1:0x0].0x0 (ffff9171908a1000) 00010000:00010000:0.0:1782759685.083263:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083267:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171a93c4600/0xdd99f5c4777e05a0 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670ee expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083293:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:0.0:1782759685.083296:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083300:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e064f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6712d expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083314:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000417:0x1:0x0].0x0 (ffff917183a70600) 00010000:00010000:0.0:1782759685.083317:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083320:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98400/0xdd99f5c4777e06f7 lrc: 0/0,0 mode: --/PR res: [0x200000417:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6716c expref: 12 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083334:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9171c08f6800) 00010000:00010000:0.0:1782759685.083336:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083340:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e07d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671b9 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083356:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000416:0x1:0x0].0x0 (ffff9171908a1200) 00010000:00010000:0.0:1782759685.083358:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083362:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e05ed lrc: 0/0,0 mode: --/PR res: [0x200000416:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6710a expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083374:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x7:0x0].0x0 (ffff917183a70100) 00010000:00010000:0.0:1782759685.083376:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083379:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e0695 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67149 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083392:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff9171889c5400) 00010000:00010000:0.0:1782759685.083400:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083406:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e074b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67188 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083421:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff917183a70400) 00010000:00010000:0.0:1782759685.083423:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083427:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e07ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ab expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083440:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x6:0x0].0x0 (ffff9171889c5500) 00010000:00010000:0.0:1782759685.083443:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759685.083446:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e0679 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6713b expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083461:0:155241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759685.083464:0:155241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759685.083467:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082f98600/0xdd99f5c4777e0721 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6717a expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.083479:0:155241:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 32 locks, left on hash table 0. 10000000:01000000:0.0:1782759685.084629:0:155241:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759685.084653:0:155241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.084671:0:155241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.084679:0:155241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.084734:0:155241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.084750:0:155241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 18 pid: 5793 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759685.084765:0:155241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155241:1869355212021760:0@lo:104: 00000100:00100000:0.0:1782759685.084933:0:155241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759685.085047:0:155241:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759685.087690:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021760 00000100:00100000:3.0:1782759685.087706:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021760 00000100:00100000:3.0:1782759685.087841:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1782759685.087852:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:155241:x1869355212021760:12345-0@lo:104: 00010000:00010000:3.0:1782759685.087870:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759685.087979:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759685.087985:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:155241:x1869355212021760:12345-0@lo:104: Request processed in 135us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759685.087993:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1782759685.088092:0:155241:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155241:1869355212021760:0@lo:104: 00010000:00010000:1.0:1782759685.088116:0:155241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.088277:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759685.088285:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.088295:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfe00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759685.088300:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.088314:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759685.088325:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759685.088331:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759685.089011:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089021:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759685.089045:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089053:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082bcfe00/0xdd99f5c4777e0449 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0450 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089073:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759685.089081:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759685.089084:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759685.089093:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759685.089107:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212021888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759685.089151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759685.089191:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212021888 00000100:00100000:2.0:1782759685.089196:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212021888 00010000:00010000:2.0:1782759685.089216:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 19 pid: 5793 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759685.089239:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1782759685.089246:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212021888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759685.089256:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759685.089260:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 19 pid: 5793 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089269:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 19 pid: 5793 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089284:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e0450 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0449 expref: 19 pid: 5793 timeout: 3853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089297:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089304:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089319:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089336:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089342:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089348:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089354:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759685.089358:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089365:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089379:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.089388:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759685.089416:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212021888:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759685.089423:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1782759685.089454:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212021888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759685.091039:0:155241:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759685.091054:0:155241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759685.091061:0:155241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e07ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759685.100049:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759686.123969:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759686.253005:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759686.253013:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759686.253018:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759686.253065:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759686.253077:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759686.253087:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759686.253127:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212022016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759686.253209:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759686.253277:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2a9cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759686.253354:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022016 00000100:00100000:0.0:1782759686.253362:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022016 00000100:00100000:0.0:1782759686.253405:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:0.0:1782759686.253415:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212022016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759686.253429:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759686.253442:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e07f3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759686.253465:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759686.253475:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759686.253484:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74a00, rc 0) 00000100:00100000:0.0:1782759686.253539:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212022016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759686.253547:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1782759686.253643:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212022016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759686.253670:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759686.253680:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759686.253698:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759686.253704:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759686.253712:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759687.084372:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212022144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759687.084519:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212022656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759687.084581:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782759687.084587:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212022272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759687.084624:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212022784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759687.084677:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212022400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759687.084716:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759687.084721:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212022528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759687.084782:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022656 00000100:00100000:2.0:1782759687.084789:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022656 00000100:00100000:2.0:1782759687.084854:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022272 00000100:00100000:2.0:1782759687.084857:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022272 00000100:00100000:2.0:1782759687.084876:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022400 00000100:00100000:2.0:1782759687.084878:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022400 00000100:00100000:2.0:1782759687.084898:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1782759687.084906:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.084961:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212022656:12345-0@lo:400:kworker.0 Request processed in 55us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759687.084967:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1782759687.084984:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1782759687.084989:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212022272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085017:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212022272:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759687.085022:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1782759687.085041:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1782759687.085047:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212022400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085093:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212022400:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759687.085099:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1782759687.085118:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022784 00000100:00100000:2.0:1782759687.085122:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022784 00000100:00100000:2.0:1782759687.085145:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022528 00000100:00100000:2.0:1782759687.085148:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022528 00000100:00100000:2.0:1782759687.085167:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1782759687.085173:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212022784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085201:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212022784:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759687.085207:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1782759687.085217:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1782759687.085222:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212022528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085246:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212022528:12345-0@lo:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759687.085251:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00080000:2.0:1782759687.085269:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759687.085272:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759687.085274:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759687.085312:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212022528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085321:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212022400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085346:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212022272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085353:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212022784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759687.085369:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212022656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759687.086330:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022144 00000100:00100000:3.0:1782759687.086336:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022144 00000100:00100000:3.0:1782759687.086376:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1782759687.086383:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212022144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759687.086437:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212022144:12345-0@lo:400:kworker.0 Request processed in 55us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759687.086445:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:2.0:1782759687.086556:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212022144:0@lo:400:kworker.0 00010000:00010000:1.0:1782759687.148130:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759687.596334:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212022912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759687.596415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759687.596569:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212022912 00000100:00100000:1.0:1782759687.596578:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212022912 00000100:00100000:1.0:1782759687.596632:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1782759687.596641:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212022912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759687.596675:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759687.596729:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212022912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759687.596736:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1782759687.596961:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212022912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759688.173891:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759688.675528:0:155440:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb6722080 20000000:00000080:0.0:1782759688.675545:0:155440:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbc400 uarg=0000000000000000 00010000:00010000:0.0:1782759688.676170:0:155440:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759688.676186:0:155440:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759688.676201:0:155440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759688.676218:0:155440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.676235:0:155440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.676244:0:155440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.676279:0:155440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.676292:0:155440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 18 pid: 5794 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759688.676306:0:155440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155440:1869355212023040:0@lo:104: 00000100:00100000:0.0:1782759688.676369:0:155440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759688.676466:0:155440:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759688.676513:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023040 00000100:00100000:3.0:1782759688.676520:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023040 00000100:00100000:3.0:1782759688.676581:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1782759688.676590:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:155440:x1869355212023040:12345-0@lo:104: 00010000:00010000:3.0:1782759688.676604:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.676776:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759688.676783:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:155440:x1869355212023040:12345-0@lo:104: Request processed in 195us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759688.676791:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00010000:00010000:1.0:1782759688.676948:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759688.676955:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.676962:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759688.676966:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.676976:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759688.676988:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759688.676993:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759688.677020:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677026:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759688.677046:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677052:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e07f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e07fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677066:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759688.677068:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759688.677069:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759688.677080:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212023168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759688.677109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759688.677138:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023168 00000100:00100000:1.0:1782759688.677142:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023168 00010000:00010000:1.0:1782759688.677158:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 19 pid: 5794 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759688.677177:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1782759688.677183:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212023168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759688.677192:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759688.677197:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 19 pid: 5794 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677212:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 19 pid: 5794 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677226:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677234:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677245:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677252:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677259:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677266:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677272:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759688.677276:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677284:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677291:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.677309:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759688.677337:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212023168:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759688.677343:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1782759688.677380:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212023168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759688.677620:0:155440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e07fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e07f3 expref: 18 pid: 5794 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759688.677630:0:155440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155440:1869355212023040:0@lo:104: 00010000:00010000:0.0:1782759688.677642:0:155440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.677651:0:155440:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.677664:0:155440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.677671:0:155440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0801 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759689.197116:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759689.398491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759689.398543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759689.398695:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331968 00000100:00100000:1.0:1782759689.398706:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331968 00000100:00100000:1.0:1782759689.398789:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2703 00000100:00100000:1.0:1782759689.398801:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197331968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759689.398904:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197331968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 105us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759689.398912:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2703 00000100:00100000:2.0:1782759689.399331:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197331840 00000100:00100000:2.0:1782759689.399337:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197331840 00000100:00100000:2.0:1782759689.399383:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2976 00000100:00100000:2.0:1782759689.399391:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197331840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759689.399429:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197331840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (948us total) trans 0 rc 0/0 00000100:00080000:3.0:1782759689.399433:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759689.399435:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2976 00000100:00100000:2.0:1782759689.402393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759689.402476:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759689.410461:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332224 00000100:00100000:1.0:1782759689.410478:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332224 00000100:00080000:0.0:1782759689.410649:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759689.410700:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332096 00000100:00100000:1.0:1782759689.410705:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332096 00000100:00080000:0.0:1782759689.410904:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759689.411648:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2149 00000100:00100000:3.0:1782759689.411869:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197332224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759689.411889:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2150 00000100:00100000:1.0:1782759689.411902:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197332096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759689.412100:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197332096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 200us (9622us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759689.412108:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2150 00000100:00100000:3.0:1782759689.412155:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197332224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 495us (9770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759689.412164:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2149 00000100:00100000:2.0:1782759690.156071:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212023296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759690.156141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759690.156283:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023296 00000100:00100000:3.0:1782759690.156292:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023296 00000100:00080000:0.0:1782759690.156417:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759690.156579:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1782759690.156589:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212023296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759690.156623:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759690.156726:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212023296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759690.156733:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1782759690.156851:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212023296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759690.220199:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759690.674701:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759690.674708:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759690.674723:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759690.674860:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759690.674873:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759690.674885:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759690.674913:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212023424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759690.675052:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759690.675102:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759690.675760:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023424 00000100:00100000:0.0:1782759690.675770:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023424 00000100:00100000:0.0:1782759690.675849:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:0.0:1782759690.675859:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212023424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759690.675874:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759690.675890:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0808 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759690.675915:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759690.675928:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759690.675938:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75c00, rc 0) 00000100:00100000:0.0:1782759690.676005:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212023424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.676012:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:3.0:1782759690.677211:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2322d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212023424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759690.677232:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759690.677242:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759690.677263:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759690.677268:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759690.677275:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.244124:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759691.534706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759691.534756:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332480 00000100:00100000:3.0:1782759691.534773:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332480 00000100:00100000:3.0:1782759691.534848:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2235 00000100:00100000:3.0:1782759691.534859:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:106571:x1869355197332480:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759691.534879:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759691.534882:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782759691.534887:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e06cd) 00010000:00010000:3.0:1782759691.534889:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759691.534912:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0816 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671c7 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.535338:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.535354:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.535366:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.535378:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.535385:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.535392:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759691.537289:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36:0x0], index 0: 0 00010000:00010000:3.0:1782759691.537554:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e082b lrc: 3/1,0 mode: --/PR res: [0x200000418:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537579:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e082b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537591:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e082b lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537632:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537639:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537658:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537664:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759691.537668:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537675:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537687:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1b00) 00010000:00010000:3.0:1782759691.537690:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759691.537694:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537700:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e081d lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759691.537712:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fac7e187 reply state 00000000da90c379 transno 4294968141 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759691.537737:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759691.537778:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0816 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671c7 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537797:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e082b lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671c7 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.537804:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x21:0x0].0x0 (ffff9171908a1900) 00010000:00010000:3.0:1782759691.537805:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759691.537808:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759691.537904:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106571:x1869355197332480:12345-192.168.204.31@tcp:101:dd.0 Request processed in 3047us (3207us total) trans 4294968141 rc 0/0 00000100:00100000:3.0:1782759691.537913:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2235 00000100:00080000:3.0:1782759691.537946:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759691.554226:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.554244:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.554252:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.554258:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759691.554264:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.554271:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.554306:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1100) 00010000:00010000:3.0:1782759691.554310:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759691.554315:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.554320:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0824 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.571735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759691.572169:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332608 00000100:00100000:2.0:1782759691.572180:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332608 00000100:00100000:2.0:1782759691.572311:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:2.0:1782759691.572322:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197332608:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759691.572372:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782759691.572381:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.572406:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3759s v=(0 0) 00010000:00010000:2.0:1782759691.572410:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759691.572416:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.572431:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759691.576602:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759691.587468:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.588186:0:6605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.588220:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212023552:0@lo:101:ll_ost_io00_002.0 00000100:00100000:1.0:1782759691.588285:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759691.588340:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759691.588395:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023552 00000100:00100000:3.0:1782759691.588403:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023552 00000100:00100000:3.0:1782759691.588469:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00080000:1.0:1782759691.588622:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759691.588666:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+6:6605:x1869355212023552:12345-0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759691.588683:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759691.588700:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0840 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.590297:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.590312:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.590326:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc800, rc 0) 00000100:00100000:3.0:1782759691.590400:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212023552:12345-0@lo:101:ll_ost_io00_002.0 Request processed in 1738us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759691.590409:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1782759691.594837:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212023552:0@lo:101:ll_ost_io00_002.0 00010000:00010000:0.0:1782759691.594872:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.594887:0:6605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.594916:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.594927:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782759691.595535:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1782759691.595579:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212023680:0@lo:601:ll_ost_io00_002.0 00000100:00100000:0.0:1782759691.595637:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759691.595705:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759691.595774:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023680 00000100:00100000:2.0:1782759691.595781:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023680 00000100:00100000:2.0:1782759691.595845:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782759691.595856:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212023680:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:2.0:1782759691.595884:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759691.598307:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212023680:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 2445us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759691.598319:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1782759691.603333:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212023680:0@lo:601:ll_ost_io00_002.0 00010000:00010000:1.0:1782759691.603375:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782759691.603390:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000001:00080000:2.0:1782759691.672915:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967419 is committed 00002000:00010000:1.0:1782759691.672963:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1782759691.672969:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb mtime from disk: 0 -> 1782759690 00002000:00010000:1.0:1782759691.672972:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb ctime from disk: 0 -> 1782759690 00002000:00010000:1.0:1782759691.672974:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1782759691.672991:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.673004:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.673124:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.673150:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759691.673155:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.673164:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.673187:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.673194:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0839 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.673295:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197332608:12345-192.168.204.31@tcp:4:dd.0 Request processed in 100971us (101566us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1782759691.673306:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:2.0:1782759691.721015:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759691.724671:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332736 00000100:00100000:1.0:1782759691.724685:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332736 00000100:00100000:1.0:1782759691.724866:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:1.0:1782759691.724877:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197332736:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759691.724926:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 1048576, mtime: 0x6a42c10a, atime: 0x0, ctime: 0x6a42c10a, blocks: 0x803 00010000:00010000:1.0:1782759691.724934:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.724950:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:1.0:1782759691.724978:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759691.724984:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.724998:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.741353:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000100:00100000:1.0:1782759691.741408:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212023808:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759691.742182:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759691.742316:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc26480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759691.742542:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023808 00000100:00100000:3.0:1782759691.742550:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023808 00000100:00100000:3.0:1782759691.742773:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782759691.742783:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212023808:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759691.742842:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759691.743483:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212023808:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 691us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759691.743493:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1782759691.743584:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212023808:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759691.743633:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00010000:00010000:1.0:1782759691.743654:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00002000:00010000:1.0:1782759691.775843:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1782759691.775853:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1782759691.775869:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.775883:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.775913:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.775920:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759691.775925:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.775935:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.775955:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.775973:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e084e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.776072:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197332736:12345-192.168.204.31@tcp:4:dd.0 Request processed in 51193us (55062us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1782759691.776082:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 49 00000001:00080000:2.0:1782759691.776683:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967420 is committed 00000100:00100000:2.0:1782759691.817388:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759691.820108:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332864 00000100:00100000:1.0:1782759691.820121:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332864 00000100:00100000:3.0:1782759691.822594:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:3.0:1782759691.822616:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197332864:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759691.822689:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 2097152, mtime: 0x6a42c10a, atime: 0x0, ctime: 0x6a42c10a, blocks: 0x1007 00010000:00010000:3.0:1782759691.822699:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.822716:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:3.0:1782759691.822721:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759691.822728:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.822743:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.834766:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:0.0:1782759691.834920:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:6603:1869355212023936:0@lo:601:ll_ost_io00_000.0 00000100:00100000:0.0:1782759691.835058:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759691.835200:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759691.841752:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212023936 00000100:00100000:2.0:1782759691.841766:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212023936 00000100:00100000:2.0:1782759691.841872:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782759691.841883:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6603:x1869355212023936:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:2.0:1782759691.841932:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759691.842385:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6603:x1869355212023936:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 503us (7326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759691.842393:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1782759691.842558:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:6603:1869355212023936:0@lo:601:ll_ost_io00_000.0 00010000:00010000:3.0:1782759691.842600:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:3.0:1782759691.842623:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:3.0:1782759691.902504:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967421 is committed 00002000:00010000:1.0:1782759691.902786:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1782759691.902792:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1782759691.902806:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.902871:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.902881:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.902887:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcce00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759691.902891:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.902900:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.902919:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.902925:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abb43800/0xdd99f5c4777e0855 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.903219:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197332864:12345-192.168.204.31@tcp:4:dd.0 Request processed in 80610us (85836us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1782759691.903229:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:3.0:1782759691.924544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759691.925076:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197332992 00000100:00100000:2.0:1782759691.925088:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197332992 00000100:00100000:2.0:1782759691.925219:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:2.0:1782759691.925229:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197332992:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759691.925277:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 3145728, mtime: 0x6a42c10a, atime: 0x0, ctime: 0x6a42c10a, blocks: 0x1807 00010000:00010000:2.0:1782759691.925286:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.925302:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:2.0:1782759691.925305:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759691.925310:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.925324:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.932255:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:0.0:1782759691.932321:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212024064:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759691.932371:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759691.932431:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759691.932776:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024064 00000100:00100000:1.0:1782759691.932783:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024064 00000100:00100000:1.0:1782759691.932838:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782759691.932847:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212024064:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:1.0:1782759691.932883:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.933256:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212024064:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 410us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759691.933264:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1782759691.933457:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212024064:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759691.933492:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1782759691.933502:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00002000:00010000:1.0:1782759691.966372:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1782759691.966382:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb mtime from disk: 1782759690 -> 1782759691 00002000:00010000:1.0:1782759691.966385:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb ctime from disk: 1782759690 -> 1782759691 00002000:00010000:1.0:1782759691.966387:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1782759691.966403:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.966416:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.966424:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.966431:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759691.966436:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.966444:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.966464:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.966485:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e085c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759691.966585:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197332992:12345-192.168.204.31@tcp:4:dd.0 Request processed in 41353us (42047us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1782759691.966596:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000001:00080000:3.0:1782759691.966683:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967422 is committed 00000100:00100000:2.0:1782759691.986133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759691.986231:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333120 00000100:00100000:1.0:1782759691.986241:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333120 00000100:00100000:1.0:1782759691.986313:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:1.0:1782759691.986322:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197333120:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759691.986367:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 4194304, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x2007 00010000:00010000:1.0:1782759691.986375:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.986391:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:1.0:1782759691.986395:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759691.986400:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.986414:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759691.996268:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:1.0:1782759691.996329:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212024192:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759691.996383:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759691.996430:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759691.996885:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024192 00000100:00100000:3.0:1782759691.996894:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024192 00000100:00100000:3.0:1782759691.996963:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1782759691.996975:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212024192:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:3.0:1782759691.997006:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759691.997359:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212024192:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 385us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759691.997368:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1782759691.997430:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212024192:0@lo:601:ll_ost_io00_002.0 00010000:00010000:3.0:1782759691.997455:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1782759691.997466:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:3.0:1782759692.026192:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967423 is committed 00002000:00010000:1.0:1782759692.026522:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1782759692.026528:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1782759692.026544:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.026557:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.026566:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.026573:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.026578:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.026587:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.026607:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.026615:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0863 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.027512:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197333120:12345-192.168.204.31@tcp:4:dd.0 Request processed in 41183us (41380us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1782759692.027524:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:0.0:1782759692.046341:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759692.046444:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333248 00000100:00100000:1.0:1782759692.046453:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333248 00000100:00100000:1.0:1782759692.046528:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:1.0:1782759692.046538:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333248:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759692.046588:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 5242880, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x2807 00010000:00010000:1.0:1782759692.046596:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.046614:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:1.0:1782759692.046618:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759692.046624:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.046650:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.055620:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:1.0:1782759692.055689:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212024320:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759692.055750:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759692.055846:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759692.056153:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024320 00000100:00100000:0.0:1782759692.056161:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024320 00000100:00100000:0.0:1782759692.056215:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1782759692.056225:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212024320:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:0.0:1782759692.056256:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759692.056646:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212024320:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 421us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.056654:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782759692.057011:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212024320:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759692.057049:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1782759692.057059:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000001:00080000:2.0:1782759692.088810:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967424 is committed 00002000:00010000:1.0:1782759692.088976:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1782759692.088981:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1782759692.088999:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.089014:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.089024:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.089032:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.089037:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.089046:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.089067:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.089091:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e086a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.089182:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333248:12345-192.168.204.31@tcp:4:dd.0 Request processed in 42642us (42845us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1782759692.089192:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:2.0:1782759692.108427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759692.108768:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333376 00000100:00100000:3.0:1782759692.108779:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333376 00000100:00100000:1.0:1782759692.109184:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:1.0:1782759692.109198:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333376:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759692.109248:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 6291456, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x3007 00010000:00010000:1.0:1782759692.109257:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.109274:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:1.0:1782759692.109278:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759692.109284:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.109298:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.118386:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:1.0:1782759692.118433:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212024448:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759692.118505:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759692.118568:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759692.118815:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024448 00000100:00100000:3.0:1782759692.118894:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024448 00000100:00100000:3.0:1782759692.119044:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1782759692.119056:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212024448:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:3.0:1782759692.119087:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759692.119501:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212024448:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 446us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759692.119508:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1782759692.120782:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212024448:0@lo:601:ll_ost_io00_002.0 00010000:00010000:0.0:1782759692.120918:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1782759692.120960:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:2.0:1782759692.148893:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967425 is committed 00002000:00010000:1.0:1782759692.149260:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1782759692.149265:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1782759692.149276:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.149288:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.149297:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.149304:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.149309:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.149317:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.149336:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.149343:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e0871 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.149467:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333376:12345-192.168.204.31@tcp:4:dd.0 Request processed in 40268us (41045us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1782759692.149489:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:2.0:1782759692.171204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759692.171459:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333504 00000100:00100000:0.0:1782759692.171469:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333504 00000100:00100000:0.0:1782759692.171587:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:0.0:1782759692.171597:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333504:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759692.171665:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 7340032, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x3807 00010000:00010000:0.0:1782759692.171675:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.171691:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:0.0:1782759692.171695:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759692.171702:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.171715:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.180529:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:1.0:1782759692.180578:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212024576:0@lo:601:ll_ost_io00_001.0 00000100:00100000:1.0:1782759692.180627:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759692.180696:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759692.181281:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024576 00000100:00100000:3.0:1782759692.181289:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024576 00000100:00100000:3.0:1782759692.181341:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1782759692.181350:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212024576:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:3.0:1782759692.181380:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759692.181777:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212024576:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 427us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759692.181785:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1782759692.182790:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212024576:0@lo:601:ll_ost_io00_001.0 00010000:00010000:1.0:1782759692.182852:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1782759692.182865:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759692.187512:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:2.0:1782759692.187613:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759692.188661:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212024704:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759692.188739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759692.188813:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024704 00000100:00100000:2.0:1782759692.188837:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024704 00000100:00100000:2.0:1782759692.188888:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1782759692.188899:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212024704:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:2.0:1782759692.188941:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759692.189325:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212024704:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 427us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759692.189333:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:2.0:1782759692.189399:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1782759692.189410:0:3307:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:2.0:1782759692.189424:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212024704:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.204555:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212024960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.204643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.204721:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759692.204728:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212024832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.204762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.204786:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212025344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.204854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.204883:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212025088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.204908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.204926:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759692.204932:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212025216:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.204972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.205005:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024960 00000100:00100000:0.0:1782759692.205012:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024960 00000100:00100000:0.0:1782759692.205063:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025216 00000100:00100000:0.0:1782759692.205066:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025216 00000100:00100000:0.0:1782759692.205100:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1782759692.205108:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212024960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205163:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212024960:12345-0@lo:400:kworker.0 Request processed in 55us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.205170:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1782759692.205187:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1782759692.205192:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212025216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205220:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212025216:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.205225:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1782759692.205240:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212024832 00000100:00100000:0.0:1782759692.205243:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212024832 00000100:00100000:0.0:1782759692.205263:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:0.0:1782759692.205267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212024832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205290:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212024832:12345-0@lo:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.205303:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:0.0:1782759692.205328:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025344 00000100:00100000:0.0:1782759692.205331:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025344 00000100:00100000:0.0:1782759692.205351:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025088 00000100:00100000:0.0:1782759692.205354:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025088 00000100:00100000:0.0:1782759692.205368:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1782759692.205373:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212025344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205398:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212025344:12345-0@lo:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.205403:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1782759692.205412:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1782759692.205416:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212025088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205435:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212025088:12345-0@lo:400:kworker.0 Request processed in 19us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.205440:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00080000:0.0:1782759692.205462:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759692.205466:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759692.205469:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759692.205507:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212025216:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205519:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212025088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205547:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212024832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205556:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212025344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759692.205565:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212024960:0@lo:400:kworker.0 00000001:00080000:2.0:1782759692.225626:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967426 is committed 00002000:00010000:2.0:1782759692.225709:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:2.0:1782759692.225714:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1782759692.225728:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.225741:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.225768:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.225776:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759692.225781:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.225789:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.225806:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.225813:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fa81276/0xdd99f5c4777e0878 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759692.225915:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333504:12345-192.168.204.31@tcp:4:dd.0 Request processed in 54314us (54964us total) trans 4294967426 rc 0/0 00000100:00100000:2.0:1782759692.225925:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:2.0:1782759692.245571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759692.245681:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333632 00000100:00100000:1.0:1782759692.245692:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333632 00000100:00100000:1.0:1782759692.245775:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:1.0:1782759692.245785:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333632:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759692.245877:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 8388608, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x4007 00010000:00010000:1.0:1782759692.245886:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.245905:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:1.0:1782759692.245909:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759692.245916:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.245964:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.268398:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759692.291002:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967427 is committed 00010000:00010000:2.0:1782759692.291472:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:1.0:1782759692.291562:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00010000:2.0:1782759692.293078:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1782759692.293085:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1782759692.293296:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.293309:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.293318:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.293325:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759692.293330:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.293339:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.293359:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.293367:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6b6b91/0xdd99f5c4777e087f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759692.293481:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197333632:12345-192.168.204.31@tcp:4:dd.0 Request processed in 47692us (47914us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1782759692.293492:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:1.0:1782759692.293600:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212025472:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759692.293678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.299948:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025472 00000100:00100000:0.0:1782759692.299975:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025472 00000100:00100000:0.0:1782759692.300035:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1782759692.300044:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3305:x1869355212025472:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:0.0:1782759692.300080:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759692.300547:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212025600:0@lo:106: 00000100:00100000:0.0:1782759692.300566:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3305:x1869355212025472:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 521us (6887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.300576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1782759692.300590:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.300622:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025600 00000100:00100000:0.0:1782759692.300637:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025600 00000100:00100000:2.0:1782759692.300650:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759692.300671:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1782759692.300678:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212025600:12345-0@lo:106: 00010000:00010000:0.0:1782759692.300689:0:5783:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1782759692.300698:0:5783:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:0.0:1782759692.300749:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212025600:12345-0@lo:106: Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.300755:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1782759692.300810:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1f80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212025600:0@lo:106: 00010000:00010000:3.0:1782759692.301003:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1782759692.301016:0:3305:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:3.0:1782759692.301041:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212025472:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759692.351722:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759692.351812:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333760 00000100:00100000:1.0:1782759692.351836:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333760 00000100:00100000:1.0:1782759692.351907:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:1.0:1782759692.351917:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197333760:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759692.351978:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 9437184, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x4807 00010000:00010000:1.0:1782759692.351988:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.352005:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:1.0:1782759692.352009:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759692.352015:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.352028:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759692.454582:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967428 is committed 00000100:00100000:0.0:1782759692.454936:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759692.454966:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212025728:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.455036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759692.455254:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025728 00000100:00100000:2.0:1782759692.455262:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025728 00000100:00100000:2.0:1782759692.455313:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1782759692.455322:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3308:x1869355212025728:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759692.455716:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3308:x1869355212025728:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 393us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759692.455725:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1782759692.455777:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212025728:0@lo:601:lquota_wb_lustr.0 00002000:00010000:1.0:1782759692.456603:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:1.0:1782759692.456608:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 18439 -> 20487 00010000:00010000:1.0:1782759692.456622:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.456657:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.456666:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.456673:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.456677:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.456687:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.456709:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.457176:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e0886 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.457269:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197333760:12345-192.168.204.31@tcp:4:dd.0 Request processed in 105351us (105553us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1782759692.457279:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:3.0:1782759692.490781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759692.490936:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197333888 00000100:00100000:2.0:1782759692.490962:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197333888 00000100:00100000:2.0:1782759692.491044:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1782759692.491054:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197333888:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759692.491105:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 10485760, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x5007 00010000:00010000:2.0:1782759692.491114:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.491136:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:2.0:1782759692.491141:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759692.491147:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.491160:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759692.549323:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967429 is committed 00000100:00100000:0.0:1782759692.549690:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212025856:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.549767:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1782759692.550079:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:3.0:1782759692.550084:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 20487 -> 22537 00010000:00010000:3.0:1782759692.550098:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.550110:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.550119:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.550126:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759692.550131:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.550140:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.550160:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.550168:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000633079/0xdd99f5c4777e088d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759692.550261:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197333888:12345-192.168.204.31@tcp:4:dd.0 Request processed in 59207us (59488us total) trans 4294967429 rc 0/0 00000100:00100000:3.0:1782759692.550271:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:1.0:1782759692.551477:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025856 00000100:00100000:1.0:1782759692.551487:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025856 00000100:00100000:1.0:1782759692.551532:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1782759692.551539:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3308:x1869355212025856:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759692.552018:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3308:x1869355212025856:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 478us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759692.552026:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1782759692.552319:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212025856:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.572176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759692.572286:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334016 00000100:00100000:2.0:1782759692.572297:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334016 00000100:00100000:2.0:1782759692.572380:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:2.0:1782759692.572392:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197334016:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759692.572449:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 11534336, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x5809 00010000:00010000:2.0:1782759692.572459:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.572476:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3760s v=(0 0) 00010000:00010000:2.0:1782759692.572480:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759692.572486:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.572501:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759692.636382:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967430 is committed 00002000:00010000:1.0:1782759692.636679:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:1.0:1782759692.636685:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 22537 -> 24585 00010000:00010000:1.0:1782759692.636700:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.636715:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.636724:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.636731:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.636736:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.636802:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759692.637193:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759692.637212:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212025984:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.637276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759692.637382:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212025984 00000100:00100000:2.0:1782759692.637390:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212025984 00000100:00100000:2.0:1782759692.637436:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1782759692.637445:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212025984:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759692.637881:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212025984:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 436us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759692.637889:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782759692.638041:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212025984:0@lo:601:lquota_wb_lustr.0 00010000:00010000:1.0:1782759692.639121:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.639136:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.639285:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197334016:12345-192.168.204.31@tcp:4:dd.0 Request processed in 66893us (67117us total) trans 4294967430 rc 0/0 00000100:00100000:1.0:1782759692.639295:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1782759692.701454:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759692.701660:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334144 00000100:00100000:1.0:1782759692.701671:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334144 00000100:00100000:1.0:1782759692.701749:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1782759692.701760:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197334144:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759692.701860:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 12582912, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x6009 00010000:00010000:1.0:1782759692.701871:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.701887:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3761s v=(0 0) 00010000:00010000:1.0:1782759692.701891:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759692.701898:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.701912:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759692.729313:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759692.729336:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212026112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759692.729487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759692.729559:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212026112 00000100:00100000:2.0:1782759692.729576:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212026112 00000100:00100000:2.0:1782759692.729651:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1782759692.729661:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212026112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759692.729698:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759692.729748:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212026112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759692.729756:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1782759692.729812:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212026112:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1782759692.784238:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967431 is committed 00000100:00100000:0.0:1782759692.784468:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212026240:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.784535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.784607:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212026240 00000100:00100000:0.0:1782759692.784614:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212026240 00000100:00100000:0.0:1782759692.784665:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1782759692.784674:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212026240:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.785387:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212026240:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 712us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759692.785397:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00002000:00010000:1.0:1782759692.785513:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:1.0:1782759692.785517:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 24585 -> 26633 00010000:00010000:1.0:1782759692.785530:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.785542:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.785559:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.785566:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.785570:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.785579:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.785599:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.785607:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e089b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.785690:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197334144:12345-192.168.204.31@tcp:4:dd.0 Request processed in 83930us (84243us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1782759692.785699:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1782759692.786771:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212026240:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759692.836367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759692.836525:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334272 00000100:00100000:1.0:1782759692.836536:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334272 00000100:00100000:1.0:1782759692.836626:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:1.0:1782759692.836637:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197334272:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759692.836705:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 13631488, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x6809 00010000:00010000:1.0:1782759692.836715:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.836731:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3761s v=(0 0) 00010000:00010000:1.0:1782759692.836736:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759692.836742:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.836756:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759692.941475:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967432 is committed 00000100:00100000:3.0:1782759692.941763:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759692.941781:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212026368:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759692.941859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1782759692.942140:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:1.0:1782759692.942145:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 26633 -> 28681 00010000:00010000:1.0:1782759692.942158:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.942171:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.942181:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.942187:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759692.942192:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.942218:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.942237:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.942244:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006173e04a/0xdd99f5c4777e08a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.942324:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197334272:12345-192.168.204.31@tcp:4:dd.0 Request processed in 105686us (105966us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1782759692.942334:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:3.0:1782759692.949750:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212026368 00000100:00100000:3.0:1782759692.949766:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212026368 00000100:00100000:3.0:1782759692.949849:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1782759692.949860:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212026368:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759692.950554:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212026368:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 694us (8692us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759692.950563:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1782759692.950704:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212026368:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759692.964599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759692.964700:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334400 00000100:00100000:3.0:1782759692.964710:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334400 00000100:00100000:3.0:1782759692.964783:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:3.0:1782759692.964794:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197334400:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759692.964885:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 14680064, mtime: 0x6a42c10b, atime: 0x0, ctime: 0x6a42c10b, blocks: 0x7009 00010000:00010000:3.0:1782759692.964895:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.964926:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3761s v=(0 0) 00010000:00010000:3.0:1782759692.964944:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759692.964950:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.964965:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759693.029679:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:3.0:1782759693.029687:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb mtime from disk: 1782759691 -> 1782759692 00002000:00010000:3.0:1782759693.029691:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb ctime from disk: 1782759691 -> 1782759692 00002000:00010000:3.0:1782759693.029693:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x36:0x0] updating lvb blocks from disk: 28681 -> 30729 00010000:00010000:3.0:1782759693.029707:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.029719:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.029729:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.029736:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759693.029740:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.029764:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.029783:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.029790:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759693.029917:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197334400:12345-192.168.204.31@tcp:4:dd.0 Request processed in 65121us (65323us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1782759693.029941:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00000001:00080000:0.0:1782759693.033100:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967433 is committed 00000100:00100000:1.0:1782759693.034305:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759693.034322:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212026496:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759693.034386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759693.034529:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212026496 00000100:00100000:3.0:1782759693.034536:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212026496 00000100:00100000:3.0:1782759693.034589:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1782759693.034597:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212026496:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759693.035037:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212026496:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 439us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759693.035045:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1782759693.035098:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212026496:0@lo:601:lquota_wb_lustr.0 00000100:00080000:1.0:1782759693.035624:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759693.035891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759693.036120:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334656 00000100:00100000:0.0:1782759693.036128:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334656 00000100:00100000:0.0:1782759693.036224:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 316 00000100:00100000:0.0:1782759693.036233:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106571:x1869355197334656:12345-192.168.204.31@tcp:35:dd.0 00000001:00080000:0.0:1782759693.036480:0:154820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968142 00000100:00100000:0.0:1782759693.036582:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:106571:x1869355197334656:12345-192.168.204.31@tcp:35:dd.0 Request processed in 349us (692us total) trans 4294968143 rc 0/0 00000100:00100000:0.0:1782759693.036589:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 316 00000020:00080000:0.0:1782759693.036603:0:154820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1782759693.042399:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759693.046588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759693.046703:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334784 00000100:00100000:2.0:1782759693.046713:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334784 00000100:00100000:2.0:1782759693.046775:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2236 00000100:00100000:2.0:1782759693.046784:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:106572:x1869355197334784:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759693.046807:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759693.046867:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e08b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671ce expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.046924:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047115:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047129:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047144:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047168:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047175:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047533:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e08c5 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047542:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e08c5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047550:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e08c5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759693.047575:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 7680 00000004:00200000:2.0:1782759693.047578:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759693.047600:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e08c5 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047611:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047632:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047639:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047644:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759693.047648:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047677:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047689:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171c08f6d00) 00010000:00010000:2.0:1782759693.047692:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759693.047696:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047702:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e08b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047714:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047719:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047724:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047728:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759693.047731:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047736:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047743:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff9171c08f6600) 00010000:00010000:2.0:1782759693.047745:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759693.047748:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047763:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e08be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047801:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e08b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ce expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047815:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e08c5 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ce expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.047823:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:2.0:1782759693.047826:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759693.047828:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759693.048080:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:106572:x1869355197334784:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1296us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759693.048089:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2236 00000100:00100000:0.0:1782759693.051767:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759693.052073:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197334912 00000100:00100000:3.0:1782759693.052082:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197334912 00000100:00100000:3.0:1782759693.052146:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1034 00000100:00100000:3.0:1782759693.052156:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197334912:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782759693.052186:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759693.052205:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671d5 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759693.052231:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 15728640, mtime: 0x6a42c10c, atime: 0x0, ctime: 0x6a42c10c, blocks: 0x7809 00010000:00010000:3.0:1782759693.052248:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=3761s v=(0 0) 00010000:00010000:3.0:1782759693.052252:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759693.052261:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.052276:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759693.052289:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd000, rc 0) 00000100:00100000:3.0:1782759693.052334:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197334912:12345-192.168.204.31@tcp:101:rm.0 Request processed in 180us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759693.052340:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1034 00000100:00080000:1.0:1782759693.053070:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759693.056298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759693.056412:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335168 00000100:00100000:0.0:1782759693.056422:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335168 00000100:00100000:0.0:1782759693.056518:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2237 00000100:00100000:0.0:1782759693.056529:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:106572:x1869355197335168:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782759693.056577:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759693.056602:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e082b lrc: 0/0,0 mode: --/PR res: [0x200000418:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671c7 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.056630:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x21:0x0].0x0 (ffff9171908a1900) 00010000:00010000:0.0:1782759693.056641:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759693.056660:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.056673:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.056682:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.056695:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.056701:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.056707:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.057227:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.057248:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.057255:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759693.058455:0:146757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].56, 64 off11920 00000004:00080000:0.0:1782759693.058467:0:146757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3761461643649ns, next at 3762461641361ns, rc = 0 00010000:00010000:0.0:1782759693.058533:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058545:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058554:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058562:0:146757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058569:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058575:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058626:0:146757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759693.058641:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759693.058648:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058651:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058657:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759693.058669:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759693.058669:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058674:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759693.058677:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058677:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759693.058686:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058686:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759693.058700:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x21:0x0].0x0 (ffff917183a70f00) 00010000:00010000:1.0:1782759693.058703:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782759693.058706:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 1/0,0 mode: --/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759693.058712:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e08e8 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759693.058781:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759693.058783:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759693.058785:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759693.058809:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x21:0x0].0x0 (ffff917183a70f00) 00010000:00010000:0.0:1782759693.058813:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759693.058817:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058840:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e08e1 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058860:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058866:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058881:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058886:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759693.058897:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058911:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058917:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:0.0:1782759693.058919:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759693.058921:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759693.058924:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e08d3 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759693.058934:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001417e5ae reply state 000000000a21fb7c transno 4294968144 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759693.058942:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759693.059159:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:106572:x1869355197335168:12345-192.168.204.31@tcp:36:rm.0 Request processed in 2629us (2866us total) trans 4294968144 rc 0/0 00000100:00100000:0.0:1782759693.059168:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2237 00010000:00010000:2.0:1782759693.060994:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.061008:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.061015:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.061021:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759693.061026:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.061049:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.061069:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff917183a70400) 00010000:00010000:2.0:1782759693.061072:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759693.061076:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759693.061082:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e08da lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759693.293113:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782759694.300114:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968144 is committed 00000004:00080000:1.0:1782759694.300127:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 126 committed 00000100:00100000:0.0:1782759694.300338:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759694.300358:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212026624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782759694.300427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759694.300501:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212026624 00000100:00100000:0.0:1782759694.300508:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212026624 00000100:00100000:0.0:1782759694.300557:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1782759694.300565:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212026624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782759694.300607:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:54 count 1 00010000:00010000:0.0:1782759694.300631:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.300671:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.300680:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782759694.300685:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759694.300690:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.300717:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.300732:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 6 pid: 9120 timeout: 3862 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759694.300745:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355212026752:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759694.300801:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b286c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782759694.300889:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759694.304054:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1869355212026752:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759694.304081:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759694.304712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759694.304790:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335296 00000100:00100000:2.0:1782759694.304798:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335296 00010000:00010000:2.0:1782759694.305263:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 7 pid: 9120 timeout: 3862 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759694.305683:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 699 00000100:00100000:3.0:1782759694.305696:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197335296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759694.305712:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759694.305719:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 7 pid: 9120 timeout: 3862 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759694.305734:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 7 pid: 9120 timeout: 3862 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759694.305775:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e6d163b/0xdd99f5c4777e08cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671d5 expref: 7 pid: 9120 timeout: 3862 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759694.305792:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759694.305796:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759694.305802:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759694.305813:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759694.305898:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759694.305960:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197335296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 267us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.305968:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 699 00010000:00010000:2.0:1782759694.306040:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759694.306050:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759694.306286:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759694.306297:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759694.306332:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759694.306507:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759694.306517:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.306526:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759694.306530:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.306539:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.306564:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.306570:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4c1d52/0xdd99f5c4777e08ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.306603:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759694.306604:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759694.306607:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759694.307041:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355212026624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6475us (6612us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1782759694.307050:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000004:00080000:1.0:1782759694.307374:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b3123800/2, rc 0, transno 4294967434 00000100:00100000:1.0:1782759694.307382:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212026624:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782759694.316564:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759694.519819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759694.519897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759694.519939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759694.520005:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335680 00000100:00100000:2.0:1782759694.520015:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335680 00000100:00100000:2.0:1782759694.520070:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2153 00000100:00100000:2.0:1782759694.520080:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197335680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759694.520155:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197335680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759694.520163:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2153 00000100:00100000:1.0:1782759694.520475:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335552 00000100:00100000:1.0:1782759694.520480:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335552 00000100:00100000:1.0:1782759694.520520:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2706 00000100:00100000:1.0:1782759694.520528:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197335552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759694.520564:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197335552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759694.520570:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2706 00000100:00080000:1.0:1782759694.520609:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759694.520759:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335424 00000100:00100000:3.0:1782759694.520763:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335424 00000100:00100000:3.0:1782759694.520792:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2979 00000100:00100000:3.0:1782759694.520799:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197335424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759694.520843:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197335424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.520849:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2979 00000004:00080000:1.0:1782759695.125604:0:155685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3763528778633ns, next at 3762461641361ns, rc = 0 00000004:00080000:1.0:1782759695.126929:0:155685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3763530104794ns, next at 3715072491633ns, rc = 0 00000004:00080000:2.0:1782759695.131795:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 127 committed 00000004:00080000:2.0:1782759695.137266:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 124 committed 00000100:00100000:1.0:1782759695.277906:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212026880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759695.277977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759695.279046:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212026880 00000100:00100000:3.0:1782759695.279055:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212026880 00000100:00100000:3.0:1782759695.279112:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1782759695.279128:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212026880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759695.279164:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3844079616 avail 3841982464 00000100:00100000:3.0:1782759695.279226:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212026880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759695.279233:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1782759695.279328:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212026880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759695.339973:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759696.366223:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759697.324181:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212027264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759697.324191:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212027392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759697.324259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.324261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.324296:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212027136:0@lo:400:kworker.0 00000100:00100000:2.0:1782759697.324390:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212027008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759697.324418:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027392 00000100:00100000:1.0:1782759697.324425:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027392 00000100:00100000:2.0:1782759697.324426:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.324451:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212027520:0@lo:400:kworker.0 00000100:00100000:2.0:1782759697.324472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.324475:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1782759697.324483:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212027392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759697.324498:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027008 00000100:00100000:2.0:1782759697.324501:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027008 00000100:00100000:2.0:1782759697.324525:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:2.0:1782759697.324541:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212027008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759697.324581:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212027392:12345-0@lo:400:kworker.0 Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.324584:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212027008:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.324588:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:2.0:1782759697.324589:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00080000:1.0:1782759697.324610:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759697.324616:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027264 00000100:00100000:2.0:1782759697.324619:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027264 00000100:00100000:1.0:1782759697.324642:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212027392:0@lo:400:kworker.0 00000100:00100000:2.0:1782759697.324647:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027520 00000100:00100000:2.0:1782759697.324650:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027520 00000100:00100000:2.0:1782759697.324666:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:2.0:1782759697.324672:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212027264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759697.324678:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:1.0:1782759697.324683:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212027520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759697.324701:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212027264:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.324708:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:1.0:1782759697.324709:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212027520:12345-0@lo:400:kworker.0 Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.324714:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00080000:2.0:1782759697.324724:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759697.324737:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212027008:0@lo:400:kworker.0 00000100:00100000:2.0:1782759697.324746:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212027520:0@lo:400:kworker.0 00000100:00100000:3.0:1782759697.328169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.328310:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212027264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759697.328939:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027136 00000100:00100000:1.0:1782759697.328947:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027136 00000100:00100000:1.0:1782759697.329003:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:1.0:1782759697.329012:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212027136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759697.329083:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212027136:12345-0@lo:400:kworker.0 Request processed in 72us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.329090:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:3.0:1782759697.329264:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212027136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759697.329275:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212027648:0@lo:400:kworker.0 00000100:00100000:3.0:1782759697.329312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.329728:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027648 00000100:00100000:2.0:1782759697.329733:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027648 00000100:00100000:2.0:1782759697.329788:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1782759697.329797:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212027648:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759697.330201:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759697.330359:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212027648:12345-0@lo:400:kworker.0 Request processed in 562us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.330367:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:3.0:1782759697.330762:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212027648:0@lo:400:kworker.0 00010000:00010000:1.0:1782759697.389041:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759697.840762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759697.840787:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212027776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759697.840952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.841066:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027776 00000100:00100000:3.0:1782759697.841075:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027776 00000100:00100000:3.0:1782759697.841126:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1782759697.841136:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212027776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759697.841387:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759697.841445:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212027776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 309us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.841453:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1782759697.841500:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212027776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759698.412705:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759698.431327:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967434 is committed 00000100:00100000:0.0:1782759698.432118:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212027904:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759698.432198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759698.432314:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212027904 00000100:00100000:3.0:1782759698.432323:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212027904 00000100:00100000:3.0:1782759698.432371:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1782759698.432381:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719892f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212027904:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759698.433347:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212028032:0@lo:106: 00000100:00100000:3.0:1782759698.433358:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719892f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3307:x1869355212027904:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 976us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759698.433366:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1782759698.433379:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759698.433405:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fc266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759698.433420:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028032 00000100:00100000:2.0:1782759698.433424:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028032 00000100:00100000:3.0:1782759698.433450:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212027904:0@lo:601:lquota_wb_lustr.0 00010000:00010000:3.0:1782759698.433578:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759698.433590:0:6621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759698.433596:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759698.433602:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759698.433619:0:6621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782759698.434042:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1782759698.434050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212028032:12345-0@lo:106: 00010000:00010000:2.0:1782759698.434061:0:5784:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759698.434070:0:5784:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:2.0:1782759698.434214:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212028032:12345-0@lo:106: Request processed in 163us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759698.434220:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1782759698.434285:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212028032:0@lo:106: 00010000:00010000:1.0:1782759698.434375:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759698.434382:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759698.434391:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc1e39e50) 00040000:00010000:1.0:1782759698.434394:0:7496:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759698.434402:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00040000:00010000:1.0:1782759698.434409:0:7496:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759698.434439:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759698.434446:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759698.434491:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212028160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759698.434531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759698.434615:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028160 00000100:00100000:2.0:1782759698.434619:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028160 00000100:00100000:2.0:1782759698.434649:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782759698.434656:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-lwp-OST0000_UUID+7:3308:x1869355212028160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759698.434679:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759698.434691:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc800/0xdd99f5c4777e0847 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd99f5c4777e0840 expref: 7 pid: 5804 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759698.434717:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759698.434762:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759698.434771:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031000/0xdd99f5c4777e0840 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e0847 expref: -99 pid: 6605 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759698.434788:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759698.434790:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759698.434792:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759698.436311:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212028160:12345-0@lo:103:ldlm_bl.0 Request processed in 1650us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759698.436322:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782759698.436549:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212028160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759699.437630:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759699.642559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759699.642638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759699.642688:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759699.642715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759699.642748:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336064 00000100:00100000:1.0:1782759699.642758:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336064 00000100:00100000:1.0:1782759699.642814:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336192 00000100:00100000:1.0:1782759699.642818:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336192 00000100:00100000:2.0:1782759699.642869:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335936 00000100:00100000:2.0:1782759699.642876:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335936 00000100:00100000:1.0:1782759699.642893:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2156 00000100:00100000:1.0:1782759699.642907:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197336064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759699.642925:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2710 00000100:00100000:1.0:1782759699.642986:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197336064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759699.642994:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2156 00000100:00100000:1.0:1782759699.643015:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2157 00000100:00100000:1.0:1782759699.643022:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197336192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759699.643047:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197336192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759699.643054:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2157 00000100:00080000:1.0:1782759699.643071:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759699.643075:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759699.643077:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759699.643161:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197335936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759699.643201:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197335936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 267us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759699.643208:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2710 00000100:00100000:0.0:1782759699.644584:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197335808 00000100:00100000:0.0:1782759699.644596:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197335808 00000100:00100000:0.0:1782759699.644660:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2981 00000100:00100000:0.0:1782759699.644669:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197335808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759699.644736:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197335808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.644743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2981 00000100:00100000:2.0:1782759700.396971:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759700.396997:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212028288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759700.397086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759700.397165:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028288 00000100:00100000:2.0:1782759700.397173:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028288 00000100:00100000:2.0:1782759700.397232:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1782759700.397243:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212028288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759700.397283:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759700.397341:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212028288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759700.397349:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00080000:2.0:1782759700.397392:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759700.397426:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967434 gen 2 00000004:00080000:2.0:1782759700.397431:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b3123800, transno 4294967434 00000100:00100000:2.0:1782759700.397453:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212028288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759700.462218:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759701.485441:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759702.445042:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212028416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759702.445125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759702.445303:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028416 00000100:00100000:1.0:1782759702.445312:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028416 00000100:00100000:1.0:1782759702.445421:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:1.0:1782759702.445443:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212028416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759702.445454:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759702.445468:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212028544:0@lo:400:kworker.0 00000100:00100000:0.0:1782759702.445507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759702.445558:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212028672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759702.445581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.447215:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212028800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759702.447277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.447333:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028800 00000100:00100000:3.0:1782759702.447339:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028800 00000100:00100000:3.0:1782759702.447530:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1782759702.447538:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212028800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759702.447589:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212028800:12345-0@lo:400:kworker.0 Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.447596:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1782759702.447639:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212028800:0@lo:400:kworker.0 00000100:00080000:3.0:1782759702.447682:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759702.447703:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028544 00000100:00100000:3.0:1782759702.447707:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028544 00000100:00100000:3.0:1782759702.447730:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028672 00000100:00100000:3.0:1782759702.447733:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028672 00000100:00100000:3.0:1782759702.447764:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1782759702.447770:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212028544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759702.447945:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212028544:12345-0@lo:400:kworker.0 Request processed in 174us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.447953:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1782759702.447964:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1782759702.447970:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212028672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759702.447999:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212028672:12345-0@lo:400:kworker.0 Request processed in 30us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.448004:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00080000:3.0:1782759702.448017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759702.448047:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212028672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759702.448058:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212028544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759702.448186:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212028416:12345-0@lo:400:kworker.0 Request processed in 2753us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.448194:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00000100:00100000:0.0:1782759702.449320:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759702.449335:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212029056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759702.449386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.449936:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759702.449948:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212028928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759702.449982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759702.450027:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029056 00000100:00100000:1.0:1782759702.450035:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029056 00000100:00100000:0.0:1782759702.450157:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212028928 00000100:00100000:0.0:1782759702.450162:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212028928 00000100:00100000:0.0:1782759702.450212:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:0.0:1782759702.450220:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212028928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759702.450272:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212028928:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.450278:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:0.0:1782759702.450315:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212028928:0@lo:400:kworker.0 00000100:00080000:3.0:1782759702.450384:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759702.450389:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759702.450403:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212028416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759702.450776:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1782759702.450788:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212029056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759702.450873:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212029056:12345-0@lo:400:kworker.0 Request processed in 87us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.450880:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:3.0:1782759702.450966:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212029056:0@lo:400:kworker.0 00010000:00010000:1.0:1782759702.508484:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759702.956081:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759702.956152:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.956322:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029184 00000100:00100000:2.0:1782759702.956331:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029184 00000100:00100000:2.0:1782759702.956385:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:2.0:1782759702.956393:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212029184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759702.956439:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759702.957310:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212029184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 915us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.957319:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1782759702.960054:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212029184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759703.536163:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759704.556561:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759704.759998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759704.761939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759704.761981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759704.762014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759704.762083:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336576 00000100:00100000:1.0:1782759704.762093:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336576 00000100:00100000:1.0:1782759704.762168:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336704 00000100:00100000:1.0:1782759704.762171:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336704 00000100:00100000:1.0:1782759704.762194:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2160 00000100:00100000:1.0:1782759704.762203:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197336576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759704.762263:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336448 00000100:00100000:3.0:1782759704.762270:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336448 00000100:00100000:1.0:1782759704.762285:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197336576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.762296:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2160 00000100:00100000:1.0:1782759704.762320:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2161 00000100:00100000:3.0:1782759704.762330:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2714 00000100:00100000:1.0:1782759704.762331:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197336704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759704.762345:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197336448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759704.762363:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197336704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.762371:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2161 00000100:00100000:3.0:1782759704.762440:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197336448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 98us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759704.762447:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2714 00000100:00080000:3.0:1782759704.762482:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759704.762487:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759704.762489:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759704.762606:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336320 00000100:00100000:2.0:1782759704.762611:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336320 00000100:00100000:2.0:1782759704.762645:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2983 00000100:00100000:2.0:1782759704.762652:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197336320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759704.762687:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197336320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759704.762694:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2983 00000100:00100000:2.0:1782759705.516010:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759705.516033:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212029312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759705.516101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759705.516239:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029312 00000100:00100000:1.0:1782759705.516258:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029312 00000100:00100000:1.0:1782759705.516362:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1782759705.516384:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212029312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759705.516422:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759705.516474:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212029312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759705.516481:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00080000:3.0:1782759705.516538:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759705.516586:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212029312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759705.582542:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759706.603955:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759707.564201:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212029440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759707.564201:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212029568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759707.564264:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212029824:0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.564354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759707.564410:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212029952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.564436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759707.564488:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029952 00000100:00100000:3.0:1782759707.564495:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029952 00000100:00100000:3.0:1782759707.564547:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:3.0:1782759707.564556:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212029952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.564610:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212029952:12345-0@lo:400:kworker.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759707.564617:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00080000:3.0:1782759707.564641:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759707.564668:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212029952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759707.564955:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029440 00000100:00100000:1.0:1782759707.564960:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029440 00000100:00100000:1.0:1782759707.564995:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1782759707.565003:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212029440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759707.565044:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212029440:12345-0@lo:400:kworker.0 Request processed in 42us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.565050:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1782759707.565084:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212029440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759707.565115:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212029696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759707.565139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759707.565173:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029696 00000100:00100000:1.0:1782759707.565177:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029696 00000100:00100000:1.0:1782759707.565202:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1782759707.565208:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212029696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759707.565243:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212029696:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.565250:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1782759707.565290:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212029696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759707.566790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759707.566852:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212030080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759707.566886:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759707.566943:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030080 00000100:00100000:2.0:1782759707.566948:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030080 00000100:00100000:2.0:1782759707.566998:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1782759707.567005:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212030080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759707.567051:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212030080:12345-0@lo:400:kworker.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.567058:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1782759707.567088:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212030080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.567450:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029568 00000100:00100000:3.0:1782759707.567465:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029568 00000100:00100000:3.0:1782759707.567503:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:3.0:1782759707.567517:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.567561:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212029568:12345-0@lo:400:kworker.0 Request processed in 45us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759707.567567:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00080000:3.0:1782759707.567587:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759707.567591:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759707.567783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759707.568927:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212029568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.569441:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212029824 00000100:00100000:3.0:1782759707.569448:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212029824 00000100:00100000:3.0:1782759707.569596:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:3.0:1782759707.569607:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212029824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759707.569692:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212029824:12345-0@lo:400:kworker.0 Request processed in 88us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759707.569699:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1782759707.569998:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212029824:0@lo:400:kworker.0 00000100:00080000:0.0:1782759707.570123:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759707.628811:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759708.076390:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212030208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759708.076461:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759708.076662:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030208 00000100:00100000:3.0:1782759708.076670:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030208 00000100:00100000:3.0:1782759708.076718:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1782759708.076727:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212030208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759708.076762:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759708.076815:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212030208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759708.076845:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1782759708.077023:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212030208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759708.652370:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759709.676090:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759709.880118:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759709.880167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759709.880202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759709.880251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759709.880774:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337088 00000100:00100000:2.0:1782759709.880785:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337088 00000100:00100000:2.0:1782759709.881037:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337216 00000100:00100000:2.0:1782759709.881041:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337216 00000100:00100000:2.0:1782759709.881070:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2164 00000100:00100000:2.0:1782759709.881081:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197337088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759709.881158:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197337088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 79us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.881166:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2164 00000100:00100000:2.0:1782759709.881183:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2165 00000100:00100000:2.0:1782759709.881190:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197337216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759709.881215:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197337216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.881233:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2165 00000100:00080000:2.0:1782759709.881251:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759709.881255:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759709.881365:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336832 00000100:00100000:1.0:1782759709.881370:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336832 00000100:00100000:1.0:1782759709.881405:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2985 00000100:00100000:1.0:1782759709.881412:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197336832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759709.881440:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197336832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759709.881446:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2985 00000100:00100000:3.0:1782759709.882295:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197336960 00000100:00100000:3.0:1782759709.882303:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197336960 00000100:00100000:3.0:1782759709.882359:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2718 00000100:00100000:3.0:1782759709.882368:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197336960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759709.882419:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197336960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.882439:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2718 00000100:00080000:1.0:1782759709.883106:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759710.636414:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212030336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759710.636490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759710.637012:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030336 00000100:00100000:2.0:1782759710.637020:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030336 00000100:00100000:2.0:1782759710.637087:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1782759710.637096:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212030336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759710.637132:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759710.637194:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212030336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759710.637201:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00080000:1.0:1782759710.637331:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759710.637367:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212030336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759710.700244:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759711.726510:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759712.699177:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212030464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.699257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759712.699301:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212030976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.699330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759712.699358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759712.699364:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212030848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.699405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759712.699438:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212030592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.699462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759712.699477:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212031104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.699500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759712.699518:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759712.699524:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212030720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.699545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759712.699682:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030848 00000100:00100000:2.0:1782759712.699690:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030848 00000100:00100000:2.0:1782759712.699747:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031104 00000100:00100000:2.0:1782759712.699750:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031104 00000100:00100000:2.0:1782759712.699774:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:2.0:1782759712.699782:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759712.699861:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212030848:12345-0@lo:400:kworker.0 Request processed in 80us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759712.699870:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:2.0:1782759712.699887:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:2.0:1782759712.699894:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212031104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759712.700070:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030464 00000100:00100000:3.0:1782759712.700075:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030464 00000100:00100000:3.0:1782759712.700104:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:3.0:1782759712.700111:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212030464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759712.700148:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212030464:12345-0@lo:400:kworker.0 Request processed in 38us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759712.700155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00080000:1.0:1782759712.703750:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759712.703760:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759712.703802:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212030848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.703819:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212030464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759712.704042:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212031104:12345-0@lo:400:kworker.0 Request processed in 4145us (4537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759712.704053:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1782759712.705693:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030976 00000100:00100000:3.0:1782759712.705706:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030976 00000100:00100000:3.0:1782759712.705773:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030592 00000100:00100000:3.0:1782759712.705776:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030592 00000100:00100000:3.0:1782759712.705795:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212030720 00000100:00100000:3.0:1782759712.705798:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212030720 00000100:00100000:3.0:1782759712.705836:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:3.0:1782759712.705847:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759712.705942:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212030976:12345-0@lo:400:kworker.0 Request processed in 97us (6611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759712.705950:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:3.0:1782759712.705977:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1782759712.705984:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212030592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759712.706017:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212030592:12345-0@lo:400:kworker.0 Request processed in 34us (6554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759712.706024:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1782759712.706034:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:3.0:1782759712.706040:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212030720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759712.706077:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212030720:12345-0@lo:400:kworker.0 Request processed in 37us (6531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759712.706084:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1782759712.709784:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212030720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.709804:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212030592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759712.709818:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212031104:0@lo:400:kworker.0 00000100:00080000:1.0:1782759712.710268:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759712.710294:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212030976:0@lo:400:kworker.0 00010000:00010000:0.0:1782759712.749093:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759713.203484:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759713.203511:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212031232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759713.203600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759713.203676:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031232 00000100:00100000:0.0:1782759713.203684:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031232 00000100:00100000:0.0:1782759713.203749:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1782759713.203760:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212031232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759713.203800:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759713.204271:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212031232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 510us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759713.204279:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1782759713.204338:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212031232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759713.779128:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759714.796713:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759714.997685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759714.997731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759714.997757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759714.997782:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759714.997806:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337728 00000100:00100000:2.0:1782759714.997816:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337728 00000100:00100000:2.0:1782759714.997885:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337600 00000100:00100000:2.0:1782759714.997889:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337600 00000100:00100000:2.0:1782759714.997914:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2168 00000100:00100000:2.0:1782759714.997923:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197337728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759714.998482:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337472 00000100:00100000:0.0:1782759714.998489:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337472 00000100:00100000:0.0:1782759714.998577:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2722 00000100:00100000:0.0:1782759714.998587:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197337472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759714.998659:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197337728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 734us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759714.998668:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2168 00000100:00100000:2.0:1782759714.998687:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2169 00000100:00100000:2.0:1782759714.998695:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197337600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759715.000175:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759715.000197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759715.000201:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759715.000224:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337344 00000100:00100000:3.0:1782759715.000233:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337344 00000100:00100000:3.0:1782759715.000287:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2987 00000100:00100000:3.0:1782759715.000296:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197337344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759715.002981:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197337472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4384us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759715.002997:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2722 00000100:00100000:2.0:1782759715.003035:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197337600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4337us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759715.003047:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2169 00000100:00100000:3.0:1782759715.003259:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197337344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2962us (5498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759715.003270:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2987 00000020:00000080:3.0:1782759715.661956:0:156064:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe46b4f4c0 20000000:00000080:3.0:1782759715.661977:0:156064:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b1800 uarg=0000000000000000 00010000:00010000:3.0:1782759715.662633:0:156064:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759715.662676:0:156064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171c08f6000) 00010000:00010000:3.0:1782759715.662681:0:156064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759715.662694:0:156064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e08c5 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ce expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.662730:0:156064:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782759715.662748:0:156064:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759715.662764:0:156064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.662779:0:156064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.662799:0:156064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.662882:0:156064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.662899:0:156064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 18 pid: 5794 timeout: 3884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759715.662915:0:156064:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156064:1869355212031360:0@lo:104: 00000100:00100000:3.0:1782759715.662982:0:156064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759715.663039:0:156064:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759715.663773:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031360 00000100:00100000:0.0:1782759715.663782:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031360 00000100:00100000:0.0:1782759715.663881:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1782759715.663892:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:156064:x1869355212031360:12345-0@lo:104: 00010000:00010000:0.0:1782759715.663908:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.663978:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759715.663984:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:156064:x1869355212031360:12345-0@lo:104: Request processed in 94us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759715.663991:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00010000:00010000:0.0:1782759715.664015:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759715.664021:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.664029:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759715.664033:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.664042:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759715.664061:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759715.664067:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759715.664103:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.664110:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759715.664135:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.664142:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0808 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e080f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.664665:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759715.664667:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759715.664669:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759715.664691:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212031488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759715.664731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759715.665027:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031488 00000100:00100000:2.0:1782759715.665034:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031488 00010000:00010000:2.0:1782759715.665059:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 19 pid: 5794 timeout: 3884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759715.665090:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1782759715.665098:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212031488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759715.665110:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759715.665115:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 19 pid: 5794 timeout: 3884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665133:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 19 pid: 5794 timeout: 3884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665152:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665265:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665280:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665288:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665295:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665301:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665307:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759715.665310:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665317:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665326:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.665343:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759715.665385:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212031488:12345-0@lo:103:ldlm_bl.0 Request processed in 287us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759715.665392:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1782759715.665455:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212031488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759715.666101:0:156064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e080f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0808 expref: 18 pid: 5794 timeout: 3884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.666114:0:156064:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156064:1869355212031360:0@lo:104: 00010000:00010000:0.0:1782759715.666130:0:156064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.666138:0:156064:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.666168:0:156064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.666182:0:156064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e08f6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759715.771631:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212031616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759715.771705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759715.771937:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031616 00000100:00100000:3.0:1782759715.771945:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031616 00000100:00100000:3.0:1782759715.771998:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1782759715.772008:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212031616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759715.772045:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759715.772092:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212031616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759715.772100:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00080000:3.0:1782759715.772193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759715.772236:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212031616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759715.822846:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759716.853040:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759717.164188:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759717.164196:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759717.164200:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759717.164251:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759717.164264:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759717.164276:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759717.164302:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212031744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759717.164428:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759717.164489:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759717.166604:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031744 00000100:00100000:1.0:1782759717.166617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031744 00000100:00100000:1.0:1782759717.166687:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:1.0:1782759717.166698:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212031744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759717.166735:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759717.166758:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e08fd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759717.166803:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759717.166818:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759717.166847:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759717.166922:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212031744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759717.166928:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:0.0:1782759717.168169:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212031744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759717.168199:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759717.168212:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759717.168237:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759717.168258:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759717.168266:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759717.805585:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212031872:0@lo:400:kworker.0 00000100:00100000:2.0:1782759717.805659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759717.805711:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212032384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759717.805781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759717.805885:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212032000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.805916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759717.805941:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212032512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.805991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759717.806020:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212032128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.806046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759717.806144:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759717.806151:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212032256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.806178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759717.806212:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212031872 00000100:00100000:3.0:1782759717.806220:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212031872 00000100:00100000:3.0:1782759717.806397:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:3.0:1782759717.806407:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212031872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.806589:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212031872:12345-0@lo:400:kworker.0 Request processed in 182us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759717.806597:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:3.0:1782759717.806631:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032384 00000100:00100000:3.0:1782759717.806635:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032384 00000100:00100000:3.0:1782759717.806669:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032000 00000100:00100000:3.0:1782759717.806672:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032000 00000100:00100000:3.0:1782759717.806689:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032128 00000100:00100000:3.0:1782759717.806691:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032128 00000100:00100000:3.0:1782759717.806713:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:3.0:1782759717.806720:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212032384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.806756:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212032384:12345-0@lo:400:kworker.0 Request processed in 37us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759717.806763:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:3.0:1782759717.806775:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1782759717.806781:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.806847:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212032000:12345-0@lo:400:kworker.0 Request processed in 66us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759717.806854:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1782759717.806865:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:3.0:1782759717.806871:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212032128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.806903:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212032128:12345-0@lo:400:kworker.0 Request processed in 31us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759717.806909:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:3.0:1782759717.806925:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032512 00000100:00100000:3.0:1782759717.806929:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032512 00000100:00100000:3.0:1782759717.806953:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032256 00000100:00100000:3.0:1782759717.806956:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032256 00000100:00100000:3.0:1782759717.806976:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1782759717.806982:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212032512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807013:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212032512:12345-0@lo:400:kworker.0 Request processed in 31us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759717.807019:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1782759717.807030:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:3.0:1782759717.807037:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212032256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807219:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212032256:12345-0@lo:400:kworker.0 Request processed in 181us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759717.807319:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00080000:3.0:1782759717.807350:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759717.807355:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759717.807357:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759717.807399:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212032256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807426:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212032128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807587:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212031872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807600:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212032384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807632:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212032000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759717.807644:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212032512:0@lo:400:kworker.0 00010000:00010000:0.0:1782759717.870336:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759718.323479:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759718.323513:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212032640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759718.323610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759718.323800:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032640 00000100:00100000:0.0:1782759718.323811:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032640 00000100:00100000:0.0:1782759718.323901:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1782759718.323913:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212032640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759718.323966:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759718.324047:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212032640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759718.324066:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1782759718.324445:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212032640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759718.891958:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759718.950792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759718.950837:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197337984 00000100:00100000:3.0:1782759718.950846:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197337984 00000100:00100000:3.0:1782759718.950901:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2238 00000100:00100000:3.0:1782759718.950909:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:106970:x1869355197337984:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759718.950928:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782759718.951006:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759718.951038:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e090b lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671dc expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.951437:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.951450:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.951471:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.951501:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.951509:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.951532:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759718.952554:0:146757:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36:0x0], index 1: 0 00010000:00010000:3.0:1782759718.952799:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0920 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952810:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0920 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952819:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0920 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952874:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952881:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952886:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952893:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759718.952903:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952910:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952922:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1400) 00010000:00010000:3.0:1782759718.952925:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759718.952929:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.952935:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0912 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759718.952948:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093f12918 reply state 00000000456371e5 transno 4294968145 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759718.952957:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759718.952989:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e090b lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671dc expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.953008:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0920 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671dc expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.953016:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x22:0x0].0x0 (ffff9171908a1100) 00010000:00010000:3.0:1782759718.953018:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759718.953021:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759718.953090:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106970:x1869355197337984:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2181us (2307us total) trans 4294968145 rc 0/0 00000100:00100000:3.0:1782759718.953098:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2238 00010000:00010000:0.0:1782759718.960256:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.960275:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.960284:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.960291:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759718.960296:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.960306:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.960343:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1500) 00010000:00010000:0.0:1782759718.960346:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759718.960352:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.960358:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc000/0xdd99f5c4777e0919 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759718.995287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759718.996644:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338112 00000100:00100000:2.0:1782759718.996657:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338112 00000100:00100000:2.0:1782759718.996756:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:2.0:1782759718.996766:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197338112:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759718.996813:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782759718.996838:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759718.996857:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:2.0:1782759718.996861:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759718.996868:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759718.996883:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759718.997374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782759719.015216:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.015232:0:55099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.015264:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212032768:0@lo:101:ll_ost_io00_003.0 00000100:00100000:2.0:1782759719.015321:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759719.015368:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759719.015545:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032768 00000100:00100000:3.0:1782759719.015553:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032768 00000100:00080000:2.0:1782759719.015838:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759719.015841:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1782759719.015851:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+6:55099:x1869355212032768:12345-0@lo:101:ll_ost_io00_003.0 00010000:00010000:3.0:1782759719.015867:0:121722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759719.015929:0:121722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0935 expref: -99 pid: 121722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.018022:0:121722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.018036:0:121722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.018049:0:121722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759719.018124:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212032768:12345-0@lo:101:ll_ost_io00_003.0 Request processed in 2275us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.018149:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1782759719.018943:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212032768:0@lo:101:ll_ost_io00_003.0 00010000:00010000:2.0:1782759719.018966:0:55099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.018975:0:55099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.019004:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.019015:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782759719.019355:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1782759719.019393:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212032896:0@lo:601:ll_ost_io00_003.0 00000100:00100000:2.0:1782759719.019441:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.019641:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212032896 00000100:00100000:3.0:1782759719.019648:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212032896 00000100:00100000:2.0:1782759719.019659:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082448540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759719.019694:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1782759719.019704:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212032896:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759719.019731:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.020028:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212032896:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 325us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.020035:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1782759719.020544:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212032896:0@lo:601:ll_ost_io00_003.0 00010000:00010000:2.0:1782759719.020575:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782759719.020584:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000001:00080000:3.0:1782759719.060228:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967410 is committed 00002000:00010000:2.0:1782759719.060548:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1782759719.060553:0:55099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb mtime from disk: 0 -> 1782759718 00002000:00010000:2.0:1782759719.060555:0:55099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb ctime from disk: 0 -> 1782759718 00002000:00010000:2.0:1782759719.060558:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1782759719.060571:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.060585:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.060594:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.060601:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759719.060606:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.060616:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.060650:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.060659:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e092e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.060758:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197338112:12345-192.168.204.31@tcp:4:dd.0 Request processed in 63988us (65475us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1782759719.060769:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:0.0:1782759719.082749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759719.082872:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338240 00000100:00100000:3.0:1782759719.082881:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338240 00000100:00100000:3.0:1782759719.082960:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:3.0:1782759719.082971:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197338240:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759719.083021:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 1048576, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x803 00010000:00010000:3.0:1782759719.083030:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.083046:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:3.0:1782759719.083050:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759719.083057:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.083071:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.091730:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000100:00100000:1.0:1782759719.091783:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212033024:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759719.091861:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.091926:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759719.092076:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033024 00000100:00100000:2.0:1782759719.092084:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033024 00000100:00100000:2.0:1782759719.092144:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1782759719.092154:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212033024:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:2.0:1782759719.092183:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.092547:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212033024:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 393us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759719.092555:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1782759719.092598:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212033024:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759719.092624:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00010000:00010000:2.0:1782759719.092634:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00002000:00010000:1.0:1782759719.127245:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1782759719.127255:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 2051 -> 4103 00000001:00080000:3.0:1782759719.127263:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967411 is committed 00010000:00010000:1.0:1782759719.127270:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.127284:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.127313:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.127319:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759719.127324:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.127333:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.127351:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.127359:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057437be6/0xdd99f5c4777e0943 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759719.127605:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197338240:12345-192.168.204.31@tcp:4:dd.0 Request processed in 44631us (44860us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1782759719.127615:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:0.0:1782759719.150170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759719.150581:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338368 00000100:00100000:2.0:1782759719.150591:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338368 00000100:00100000:2.0:1782759719.150722:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:2.0:1782759719.150733:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197338368:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759719.150790:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 2097152, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x1007 00010000:00010000:2.0:1782759719.150799:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.150814:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:2.0:1782759719.150818:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759719.150868:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.150892:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.158277:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:1.0:1782759719.158329:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212033152:0@lo:601:ll_ost_io00_000.0 00000100:00100000:1.0:1782759719.158381:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.158449:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759719.158993:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033152 00000100:00100000:3.0:1782759719.159000:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033152 00000100:00100000:3.0:1782759719.159042:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1782759719.159051:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212033152:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:3.0:1782759719.159079:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.159436:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212033152:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 385us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.159444:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1782759719.159629:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212033152:0@lo:601:ll_ost_io00_000.0 00010000:00010000:2.0:1782759719.159657:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1782759719.159667:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:2.0:1782759719.190963:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967412 is committed 00002000:00010000:3.0:1782759719.191256:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1782759719.191262:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1782759719.191275:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.191289:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.191298:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.191305:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759719.191310:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.191318:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.191337:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.191344:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e094a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.191595:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197338368:12345-192.168.204.31@tcp:4:dd.0 Request processed in 40845us (41416us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1782759719.191605:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:3.0:1782759719.213539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759719.213681:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338496 00000100:00100000:2.0:1782759719.213700:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338496 00000100:00100000:2.0:1782759719.213774:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:2.0:1782759719.213784:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197338496:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759719.213862:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 3145728, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x1807 00010000:00010000:2.0:1782759719.213872:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.213889:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:2.0:1782759719.213893:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759719.213899:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.213913:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.223252:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:1.0:1782759719.223304:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212033280:0@lo:601:ll_ost_io00_001.0 00000100:00100000:1.0:1782759719.223358:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.223499:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826953c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759719.223810:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033280 00000100:00100000:2.0:1782759719.223818:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033280 00000100:00100000:2.0:1782759719.223882:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1782759719.223891:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212033280:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:2.0:1782759719.223920:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.224306:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212033280:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 415us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759719.224314:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1782759719.225692:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212033280:0@lo:601:ll_ost_io00_001.0 00010000:00010000:3.0:1782759719.225749:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1782759719.225760:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:1.0:1782759719.281099:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967413 is committed 00002000:00010000:3.0:1782759719.281410:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1782759719.281427:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1782759719.281443:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.281458:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.281468:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.281476:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759719.281481:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.281491:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.281510:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.281530:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0951 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.281662:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197338496:12345-192.168.204.31@tcp:4:dd.0 Request processed in 67874us (68128us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1782759719.281672:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:2.0:1782759719.301367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759719.301506:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338624 00000100:00100000:0.0:1782759719.301515:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338624 00000100:00100000:0.0:1782759719.301591:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:0.0:1782759719.301614:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197338624:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759719.301665:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 4194304, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x2007 00010000:00010000:0.0:1782759719.301674:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.301690:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:0.0:1782759719.301695:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759719.301701:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.301715:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.309299:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:0.0:1782759719.309352:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212033408:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759719.309412:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759719.309459:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759719.309677:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033408 00000100:00100000:3.0:1782759719.309685:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033408 00000100:00100000:3.0:1782759719.309734:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1782759719.309743:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c17050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212033408:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759719.309774:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.310161:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c17050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212033408:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 418us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.310169:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1782759719.310408:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212033408:0@lo:601:ll_ost_io00_003.0 00010000:00010000:0.0:1782759719.310496:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1782759719.310507:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:3.0:1782759719.349247:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967414 is committed 00002000:00010000:1.0:1782759719.349671:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1782759719.349676:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1782759719.349689:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.349702:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.349710:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.349717:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759719.349721:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.349730:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.349749:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.349777:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d948a02/0xdd99f5c4777e0958 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759719.350029:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197338624:12345-192.168.204.31@tcp:4:dd.0 Request processed in 48423us (48665us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1782759719.350040:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:2.0:1782759719.370219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759719.370347:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338752 00000100:00100000:1.0:1782759719.370356:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338752 00000100:00100000:1.0:1782759719.370436:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:1.0:1782759719.370447:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197338752:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759719.370496:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 5242880, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x2807 00010000:00010000:1.0:1782759719.370506:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.370520:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:1.0:1782759719.370525:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759719.370531:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759719.370546:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.382309:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:2.0:1782759719.382360:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212033536:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759719.382429:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759719.382496:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759719.382606:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033536 00000100:00100000:0.0:1782759719.382614:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033536 00000100:00100000:0.0:1782759719.382655:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1782759719.382663:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212033536:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:0.0:1782759719.382690:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759719.383145:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212033536:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 481us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759719.383162:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782759719.383607:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212033536:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759719.383637:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782759719.383648:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00002000:00010000:2.0:1782759719.427492:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1782759719.427503:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1782759719.427520:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.427533:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.427544:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.427551:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759719.427557:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.427587:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.427609:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.427617:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024156745/0xdd99f5c4777e095f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.427772:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2361:x1869355197338752:12345-192.168.204.31@tcp:4:dd.0 Request processed in 57323us (57558us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1782759719.427782:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000001:00080000:3.0:1782759719.427934:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967415 is committed 00000100:00100000:2.0:1782759719.467999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759719.468163:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197338880 00000100:00100000:3.0:1782759719.468174:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197338880 00000100:00100000:3.0:1782759719.468383:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:3.0:1782759719.468394:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197338880:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759719.468458:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 6291456, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x3007 00010000:00010000:3.0:1782759719.468468:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.468509:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3787s v=(0 0) 00010000:00010000:3.0:1782759719.468513:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759719.468519:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.468533:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.483311:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:3.0:1782759719.483365:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212033664:0@lo:601:ll_ost_io00_000.0 00000100:00100000:3.0:1782759719.483419:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759719.483863:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033664 00000100:00100000:0.0:1782759719.483871:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033664 00000100:00100000:0.0:1782759719.483923:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1782759719.483933:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212033664:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:0.0:1782759719.483964:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759719.484335:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212033664:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 403us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759719.484343:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1782759719.484611:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c09780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759719.484639:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212033664:0@lo:601:ll_ost_io00_000.0 00010000:00010000:3.0:1782759719.484728:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:3.0:1782759719.484739:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00002000:00010000:3.0:1782759719.546612:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1782759719.546621:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1782759719.546636:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.546679:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.546690:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.546698:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759719.546703:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.546713:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.546733:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.546742:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e0966 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.546867:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2364:x1869355197338880:12345-192.168.204.31@tcp:4:dd.0 Request processed in 78470us (78873us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1782759719.546877:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00000001:00080000:1.0:1782759719.547561:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967416 is committed 00000100:00100000:0.0:1782759719.622334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759719.622439:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197339008 00000100:00100000:3.0:1782759719.622450:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197339008 00000100:00100000:3.0:1782759719.622528:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:3.0:1782759719.622539:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197339008:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759719.622611:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 7340032, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x3807 00010000:00010000:3.0:1782759719.622621:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.622638:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3788s v=(0 0) 00010000:00010000:3.0:1782759719.622643:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759719.622650:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.622672:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.650137:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:3.0:1782759719.650190:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212033792:0@lo:601:ll_ost_io00_001.0 00000100:00100000:3.0:1782759719.650250:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.650350:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c09780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759719.652556:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033792 00000100:00100000:1.0:1782759719.652568:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033792 00000100:00100000:1.0:1782759719.652637:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1782759719.652646:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212033792:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:1.0:1782759719.652857:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759719.653322:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212033792:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 676us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.653330:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1782759719.654588:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212033792:0@lo:601:ll_ost_io00_001.0 00010000:00010000:3.0:1782759719.654642:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1782759719.654653:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.655969:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759719.656356:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759719.656375:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212033920:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759719.659651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759719.660284:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212033920 00000100:00100000:2.0:1782759719.660294:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212033920 00000100:00100000:2.0:1782759719.660340:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782759719.660349:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212033920:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:2.0:1782759719.660382:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.662155:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212033920:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1802us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759719.662167:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:0.0:1782759719.665630:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759719.665649:0:3305:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:0.0:1782759719.665667:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212033920:0@lo:601:lquota_wb_lustr.0 00000001:00080000:0.0:1782759719.709806:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967417 is committed 00002000:00010000:3.0:1782759719.710376:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1782759719.710392:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1782759719.710435:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.710448:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.710458:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.710537:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759719.710543:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.710553:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.710573:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.710581:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d56e01c8/0xdd99f5c4777e096d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759719.710678:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197339008:12345-192.168.204.31@tcp:4:dd.0 Request processed in 88136us (88350us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1782759719.710689:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:0.0:1782759719.739947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759719.741523:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197339136 00000100:00100000:2.0:1782759719.741536:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197339136 00000100:00100000:2.0:1782759719.741616:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:2.0:1782759719.741639:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197339136:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759719.741688:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 8388608, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x4007 00010000:00010000:2.0:1782759719.741698:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.741714:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3788s v=(0 0) 00010000:00010000:2.0:1782759719.741718:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759719.741725:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.741739:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759719.819341:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967418 is committed 00002000:00010000:2.0:1782759719.819540:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1782759719.819545:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1782759719.819560:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.819573:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.819583:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.819591:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759719.819597:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.819624:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.819645:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.819653:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e0974 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.819890:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197339136:12345-192.168.204.31@tcp:4:dd.0 Request processed in 78248us (79947us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1782759719.819902:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00010000:00010000:1.0:1782759719.820552:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:3.0:1782759719.820678:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212034048:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759719.820732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.822525:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034048 00000100:00100000:1.0:1782759719.822538:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034048 00000100:00100000:1.0:1782759719.822594:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1782759719.822603:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3307:x1869355212034048:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:1.0:1782759719.822635:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759719.823354:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3307:x1869355212034048:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 750us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.823363:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1782759719.823479:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212034176:0@lo:106: 00000100:00100000:0.0:1782759719.823514:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759719.823559:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62600 going to sleep for 11 seconds 00010000:00010000:3.0:1782759719.823596:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1782759719.823610:0:3307:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:3.0:1782759719.823625:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212034048:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759719.823656:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759719.823668:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034176 00000100:00100000:1.0:1782759719.823672:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034176 00000100:00100000:1.0:1782759719.824185:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1782759719.824194:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212034176:12345-0@lo:106: 00010000:00010000:1.0:1782759719.824211:0:5783:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759719.824220:0:5783:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:1.0:1782759719.824287:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbfd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212034176:12345-0@lo:106: Request processed in 95us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.824295:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1782759719.824396:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212034176:0@lo:106: 00000100:00100000:0.0:1782759719.864356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759719.864454:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197339264 00000100:00100000:2.0:1782759719.864464:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197339264 00000100:00100000:2.0:1782759719.864534:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:2.0:1782759719.864545:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197339264:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759719.864593:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 9437184, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x4807 00010000:00010000:2.0:1782759719.864601:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.864616:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3788s v=(0 0) 00010000:00010000:2.0:1782759719.864621:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759719.864627:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.864660:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877386:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877405:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877427:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877435:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759719.877440:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877466:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877487:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.877495:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e097b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759719.877604:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197339264:12345-192.168.204.31@tcp:4:dd.0 Request processed in 13057us (13256us total) trans 0 rc -122/-122 00000100:00100000:2.0:1782759719.877629:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:3.0:1782759719.888575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759719.888663:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197339520 00000100:00100000:2.0:1782759719.888673:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197339520 00000100:00100000:2.0:1782759719.888730:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 329 00000100:00100000:2.0:1782759719.888740:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc10850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:106970:x1869355197339520:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:2.0:1782759719.889110:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc10850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106970:x1869355197339520:12345-192.168.204.31@tcp:35:dd.0 Request processed in 370us (543us total) trans 4294968146 rc 0/0 00000100:00100000:2.0:1782759719.889118:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 329 00010000:00010000:2.0:1782759719.915949:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759719.928780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759719.928877:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197339648 00000100:00100000:2.0:1782759719.928889:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197339648 00000100:00100000:2.0:1782759719.928949:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1036 00000100:00100000:2.0:1782759719.928959:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197339648:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759719.928978:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759719.928998:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671e3 expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759719.929023:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 9437184, mtime: 0x6a42c126, atime: 0x0, ctime: 0x6a42c126, blocks: 0x4807 00010000:00010000:2.0:1782759719.929042:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=3788s v=(0 0) 00010000:00010000:2.0:1782759719.929047:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759719.929056:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 9 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.929074:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 9 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.929114:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782759719.929179:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2364:x1869355197339648:12345-192.168.204.31@tcp:101:rm.0 Request processed in 221us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759719.929187:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1036 00000100:00100000:1.0:1782759719.932214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759719.932303:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197339904 00000100:00100000:3.0:1782759719.932311:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197339904 00000100:00100000:3.0:1782759719.932377:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2239 00000100:00100000:3.0:1782759719.932387:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:106973:x1869355197339904:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782759719.932477:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759719.932504:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0920 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671dc expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.932524:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x22:0x0].0x0 (ffff9171908a1100) 00010000:00010000:3.0:1782759719.932533:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759719.932556:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.932569:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.932578:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.932590:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.932610:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.932618:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.934504:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.934532:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.934544:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759719.936170:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].51, 64 off11600 00000004:00080000:0.0:1782759719.936184:0:19544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3788339360901ns, next at 3789339356829ns, rc = 0 00010000:00010000:0.0:1782759719.936259:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 3/0,1 mode: --/PW res: [0x200000418:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936274:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936285:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936294:0:19544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936301:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936307:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936471:0:19544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759719.936497:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936504:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936517:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936523:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759719.936528:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936535:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936546:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x22:0x0].0x0 (ffff9171908a1000) 00010000:00010000:0.0:1782759719.936549:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759719.936553:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936559:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0997 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936576:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936583:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936589:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936594:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759719.936597:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936612:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936620:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:0.0:1782759719.936622:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759719.936625:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759719.936631:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0989 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759719.936645:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004186494f reply state 000000001441250c transno 4294968147 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759719.936654:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759719.936934:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:106973:x1869355197339904:12345-192.168.204.31@tcp:36:rm.0 Request processed in 4544us (4723us total) trans 4294968147 rc 0/0 00000100:00100000:0.0:1782759719.936943:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2239 00010000:00010000:3.0:1782759719.946218:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.946236:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.946245:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.946251:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759719.946257:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.946265:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.946283:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1200) 00010000:00010000:3.0:1782759719.946286:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759719.946292:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.946299:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0990 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.948572:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759719.948585:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.948596:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759719.948600:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.948610:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.948625:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x22:0x0].0x0 (ffff9171908a1000) 00010000:00010000:2.0:1782759719.948628:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759719.948632:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 1/0,0 mode: --/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.948638:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e099e lrc: 0/0,0 mode: --/PW res: [0x200000418:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759719.948670:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759719.948672:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759719.948674:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759720.127894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759720.127949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759720.128078:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340160 00000100:00100000:2.0:1782759720.128078:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340032 00000100:00100000:2.0:1782759720.128096:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340032 00000100:00100000:3.0:1782759720.128105:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340160 00000100:00100000:3.0:1782759720.128159:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2172 00000100:00100000:2.0:1782759720.128159:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2990 00000100:00100000:3.0:1782759720.128169:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197340160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759720.128169:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197340032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759720.128233:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197340160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759720.128240:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2172 00000100:00080000:0.0:1782759720.128323:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759720.128529:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197340032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 361us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759720.128536:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2990 00000100:00100000:2.0:1782759720.881447:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759720.881471:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212034304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759720.881535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759720.881592:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034304 00000100:00100000:2.0:1782759720.881600:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034304 00000100:00100000:2.0:1782759720.881652:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1782759720.881660:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212034304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759720.881700:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759720.881744:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212034304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759720.881750:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1782759720.881792:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212034304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759720.881978:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759720.941081:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759720.944427:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968147 is committed 00000004:00080000:2.0:1782759720.944439:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 125 committed 00000100:00100000:0.0:1782759720.944787:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759720.944806:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212034432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782759720.944891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759720.944967:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034432 00000100:00100000:0.0:1782759720.944974:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034432 00000100:00100000:0.0:1782759720.945024:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1782759720.945033:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212034432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782759720.945060:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:54 count 1 00010000:00010000:0.0:1782759720.945092:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.945125:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 8 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.945134:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782759720.945138:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759720.945142:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.945168:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 8 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.945183:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 8 pid: 9120 timeout: 3889 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759720.945194:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355212034560:192.168.204.31@tcp:104: 00000100:00100000:0.0:1782759720.945367:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62180 going to sleep for 11 seconds 00000100:00080000:0.0:1782759720.945379:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759720.962655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759720.962754:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340288 00000100:00100000:2.0:1782759720.962765:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340288 00010000:00010000:2.0:1782759720.962857:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 9 pid: 9120 timeout: 3889 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759720.962890:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00100000:2.0:1782759720.962900:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197340288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759720.962928:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759720.962934:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 9 pid: 9120 timeout: 3889 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.962948:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 9 pid: 9120 timeout: 3889 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.962987:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759720.962992:0:134476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759720.962998:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.963010:0:134476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.963030:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759720.963088:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197340288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 189us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759720.963096:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 701 00010000:00010000:0.0:1782759720.963518:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f07f17c/0xdd99f5c4777e0982 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671e3 expref: 8 pid: 9120 timeout: 3889 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759720.963537:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1869355212034560:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759720.963559:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.963582:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.963588:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.963597:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.963604:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759720.963627:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782759720.964304:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212034432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19269us (19410us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1782759720.964314:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000004:00080000:0.0:1782759720.964371:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9171b2dfe300/2, rc 0, transno 4294967419 00000100:00100000:0.0:1782759720.964378:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212034432:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782759720.964989:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759720.964997:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.965009:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759720.965013:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.965037:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.965053:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.965060:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c34c9f37/0xdd99f5c4777e09a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759720.965088:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759720.965090:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759720.965092:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782759720.965210:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782759721.975385:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782759722.247814:0:156310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3790650988604ns, next at 3762461641361ns, rc = 0 00000004:00080000:0.0:1782759722.248396:0:156310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3790651571846ns, next at 3789339356829ns, rc = 0 00000004:00080000:3.0:1782759722.253126:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 126 committed 00000004:00080000:3.0:1782759722.253152:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 128 committed 00000100:00100000:1.0:1782759722.928929:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212034688:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929006:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759722.929063:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212035200:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759722.929118:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759722.929125:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212035072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759722.929174:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212034944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759722.929211:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782759722.929215:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212034816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759722.929254:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212035328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759722.929299:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035200 00000100:00100000:1.0:1782759722.929306:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035200 00000100:00100000:1.0:1782759722.929365:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034944 00000100:00100000:1.0:1782759722.929368:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034944 00000100:00100000:1.0:1782759722.929603:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034816 00000100:00100000:1.0:1782759722.929607:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034816 00000100:00100000:1.0:1782759722.929628:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1782759722.929637:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212035200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929704:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212035200:12345-0@lo:400:kworker.0 Request processed in 68us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759722.929710:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:1.0:1782759722.929730:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1782759722.929735:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212034944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929760:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212034944:12345-0@lo:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759722.929765:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1782759722.929775:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1782759722.929780:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212034816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929803:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212034816:12345-0@lo:400:kworker.0 Request processed in 23us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759722.929808:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1782759722.929845:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035072 00000100:00100000:1.0:1782759722.929848:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035072 00000100:00100000:1.0:1782759722.929873:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035328 00000100:00100000:1.0:1782759722.929875:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035328 00000100:00100000:1.0:1782759722.929895:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:1.0:1782759722.929908:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212035072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929942:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212035072:12345-0@lo:400:kworker.0 Request processed in 35us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759722.929947:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:1.0:1782759722.929958:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:1.0:1782759722.929964:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355212035328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.929991:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355212035328:12345-0@lo:400:kworker.0 Request processed in 27us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759722.929996:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00080000:1.0:1782759722.930020:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759722.930023:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759722.930026:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759722.930075:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212034816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.930087:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212035328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.930096:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212034944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.930128:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212035072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759722.930137:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212035200:0@lo:400:kworker.0 00000100:00100000:3.0:1782759722.938133:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212034688 00000100:00100000:3.0:1782759722.938153:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212034688 00000100:00100000:3.0:1782759722.938226:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:3.0:1782759722.938237:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212034688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759722.938343:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212034688:12345-0@lo:400:kworker.0 Request processed in 107us (9337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759722.938351:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:3.0:1782759722.938488:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212034688:0@lo:400:kworker.0 00010000:00010000:2.0:1782759722.988108:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759723.436038:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759723.436063:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212035456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759723.436135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759723.436201:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035456 00000100:00100000:3.0:1782759723.436209:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035456 00000100:00100000:3.0:1782759723.436256:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1782759723.436265:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212035456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759723.436308:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3849322496 avail 3847225344 00000100:00100000:3.0:1782759723.436359:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212035456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759723.436378:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1782759723.436430:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212035456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759724.012058:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759725.026902:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967419 is committed 00000100:00100000:2.0:1782759725.027235:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212035584:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759725.027321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759725.028629:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035584 00000100:00100000:2.0:1782759725.028638:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035584 00000100:00100000:2.0:1782759725.028706:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1782759725.028717:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212035584:12345-0@lo:601:lquota_wb_lustr.0 00000100:00080000:0.0:1782759725.029212:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759725.030042:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212035712:0@lo:106: 00000100:00100000:2.0:1782759725.030057:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212035584:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1342us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759725.030077:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759725.030113:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759725.030130:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035712 00000100:00100000:1.0:1782759725.030135:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035712 00000100:00100000:2.0:1782759725.030159:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1782759725.030168:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1782759725.030175:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212035712:12345-0@lo:106: 00010000:00010000:1.0:1782759725.030193:0:73865:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759725.030203:0:73865:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:2.0:1782759725.030231:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212035584:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759725.030240:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212035712:12345-0@lo:106: Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759725.030245:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1782759725.030294:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212035712:0@lo:106: 00010000:00010000:2.0:1782759725.030571:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759725.030581:0:7506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759725.030588:0:7506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759725.030594:0:7506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759725.030737:0:7506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759725.031969:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759725.031978:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759725.031999:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc1e39e50) 00040000:00010000:3.0:1782759725.032003:0:5789:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759725.032013:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00040000:00010000:3.0:1782759725.032021:0:5789:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759725.033208:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759725.033221:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759725.033462:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759725.033473:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b90200/0xdd99f5c4777e0935 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e093c expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759725.033520:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759725.033523:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759725.033526:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759725.033567:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212035840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759725.033647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759725.033762:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035840 00000100:00100000:3.0:1782759725.033769:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035840 00000100:00100000:3.0:1782759725.033848:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782759725.033858:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212035840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759725.033872:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759725.033891:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dccc00/0xdd99f5c4777e093c lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd99f5c4777e0935 expref: 7 pid: 121722 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759725.033964:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759725.034025:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212035840:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759725.034033:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1782759725.034247:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212035840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759725.035953:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759725.240198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759725.240230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759725.240256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759725.240281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759725.240523:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340544 00000100:00100000:1.0:1782759725.240534:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340544 00000100:00100000:0.0:1782759725.240695:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340416 00000100:00100000:0.0:1782759725.240700:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340416 00000100:00100000:0.0:1782759725.240765:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2992 00000100:00100000:0.0:1782759725.240776:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197340416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759725.240875:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197340416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 101us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759725.240883:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2992 00000100:00100000:0.0:1782759725.240918:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340800 00000100:00100000:0.0:1782759725.240921:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340800 00000100:00100000:1.0:1782759725.241080:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2729 00000100:00100000:1.0:1782759725.241089:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197340544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759725.241127:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197340544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759725.241134:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2729 00000100:00100000:1.0:1782759725.241158:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340672 00000100:00100000:1.0:1782759725.241161:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340672 00000100:00100000:0.0:1782759725.241616:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2175 00000100:00100000:0.0:1782759725.241624:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197340800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759725.241657:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197340800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759725.241663:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2175 00000100:00080000:0.0:1782759725.241695:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759725.241699:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759725.241702:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759725.243841:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2176 00000100:00100000:1.0:1782759725.243855:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197340672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759725.243938:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197340672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759725.243946:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2176 00000100:00100000:1.0:1782759725.996270:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759725.996297:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212035968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759725.996365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759725.996561:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212035968 00000100:00100000:2.0:1782759725.996570:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212035968 00000100:00100000:2.0:1782759725.996640:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1782759725.996649:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212035968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759725.996688:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759725.996759:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212035968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759725.996766:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1782759725.996983:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212035968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759725.997047:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759726.060182:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759727.084033:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759728.044194:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212036352:0@lo:400:kworker.0 00000100:00100000:3.0:1782759728.044301:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212036224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759728.044377:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212036096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759728.044377:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212036480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759728.047138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759728.047217:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212036736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759728.047340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759728.047394:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036736 00000100:00100000:3.0:1782759728.047402:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036736 00000100:00100000:3.0:1782759728.047458:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:3.0:1782759728.047467:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212036736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759728.047523:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212036736:12345-0@lo:400:kworker.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759728.047530:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:3.0:1782759728.047568:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967419 gen 2 00000004:00080000:3.0:1782759728.047573:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9171b2dfe300, transno 4294967419 00000100:00100000:3.0:1782759728.047586:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212036736:0@lo:400:kworker.0 00000100:00100000:1.0:1782759728.047814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759728.047877:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036224 00000100:00100000:1.0:1782759728.047881:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036224 00000100:00100000:1.0:1782759728.047908:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036352 00000100:00100000:1.0:1782759728.047911:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036352 00000100:00100000:1.0:1782759728.047944:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:1.0:1782759728.047951:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212036224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759728.048003:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212036224:12345-0@lo:400:kworker.0 Request processed in 52us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759728.048011:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:1.0:1782759728.048028:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1782759728.048033:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212036352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759728.048065:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212036352:12345-0@lo:400:kworker.0 Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759728.048072:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1782759728.048097:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212036352:0@lo:400:kworker.0 00000100:00080000:1.0:1782759728.048137:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759728.048142:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759728.048193:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212036224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759728.052583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759728.052897:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036480 00000100:00100000:1.0:1782759728.052907:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036480 00000100:00100000:1.0:1782759728.052988:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:1.0:1782759728.052999:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212036480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759728.053083:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212036480:12345-0@lo:400:kworker.0 Request processed in 85us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759728.053091:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00080000:0.0:1782759728.055014:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759728.055081:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212036480:0@lo:400:kworker.0 00000100:00100000:2.0:1782759728.056382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759728.056511:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212036608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759728.056556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759728.057368:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036608 00000100:00100000:3.0:1782759728.057377:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036608 00000100:00100000:3.0:1782759728.057460:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1782759728.057468:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212036608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759728.057537:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212036608:12345-0@lo:400:kworker.0 Request processed in 70us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759728.057544:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1782759728.057588:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212036608:0@lo:400:kworker.0 00000100:00080000:0.0:1782759728.058443:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759728.065065:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036096 00000100:00100000:1.0:1782759728.065081:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036096 00000100:00100000:1.0:1782759728.065358:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:1.0:1782759728.065370:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212036096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759728.065472:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212036096:12345-0@lo:400:kworker.0 Request processed in 105us (9095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759728.065479:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:3.0:1782759728.065587:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212036096:0@lo:400:kworker.0 00010000:00010000:2.0:1782759728.107953:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759728.556446:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212036864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759728.556511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759728.556659:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036864 00000100:00100000:2.0:1782759728.556667:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036864 00000100:00100000:2.0:1782759728.556707:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1782759728.556716:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212036864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759728.556747:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759728.557437:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212036864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 720us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759728.557446:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1782759728.557512:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212036864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759729.132124:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759730.158052:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759730.357408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759730.357453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759730.357489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759730.357524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759730.357641:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341184 00000100:00100000:3.0:1782759730.357653:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341184 00000100:00100000:3.0:1782759730.357722:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341312 00000100:00100000:3.0:1782759730.357725:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341312 00000100:00100000:3.0:1782759730.357753:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2179 00000100:00100000:3.0:1782759730.357763:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197341184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759730.357866:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197341184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 105us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759730.357874:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2179 00000100:00100000:3.0:1782759730.357904:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2180 00000100:00100000:3.0:1782759730.357911:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197341312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759730.357936:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197341312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759730.357943:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2180 00000100:00100000:0.0:1782759730.358312:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341056 00000100:00100000:0.0:1782759730.358318:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341056 00000100:00100000:0.0:1782759730.358352:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2733 00000100:00100000:0.0:1782759730.358360:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197341056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759730.358390:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197341056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759730.358409:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2733 00000100:00100000:2.0:1782759730.358507:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197340928 00000100:00100000:2.0:1782759730.358513:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197340928 00000100:00100000:2.0:1782759730.358551:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2994 00000100:00100000:2.0:1782759730.358559:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197340928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759730.358586:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197340928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759730.358593:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2994 00000100:00080000:1.0:1782759730.359757:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759730.359772:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759730.359775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759731.116845:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759731.116881:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212036992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759731.116951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759731.117079:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212036992 00000100:00100000:3.0:1782759731.117087:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212036992 00000100:00100000:3.0:1782759731.117617:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1782759731.117627:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212036992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759731.117680:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759731.117740:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212036992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759731.117748:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1782759731.117845:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212036992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759731.121400:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759731.180012:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759732.204024:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759733.164248:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212037248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.164392:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212037760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.164446:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759733.164452:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212037376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.164505:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037760 00000100:00100000:1.0:1782759733.164512:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037760 00000100:00100000:1.0:1782759733.164562:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1782759733.164571:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212037760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164623:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212037760:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.164631:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1782759733.164657:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037248 00000100:00100000:1.0:1782759733.164661:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037248 00000100:00100000:1.0:1782759733.164694:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037376 00000100:00100000:1.0:1782759733.164697:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037376 00000100:00100000:1.0:1782759733.164720:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1782759733.164725:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212037248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164756:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212037248:12345-0@lo:400:kworker.0 Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.164781:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1782759733.164795:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1782759733.164800:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212037376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164876:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212037376:12345-0@lo:400:kworker.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.164883:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1782759733.164921:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212037376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164931:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212037248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759733.164939:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212037760:0@lo:400:kworker.0 00000100:00080000:1.0:1782759733.164965:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759733.164970:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759733.165250:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212037504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759733.165284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759733.165318:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759733.165324:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212037120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759733.165354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759733.165378:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212037632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759733.165398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759733.165424:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037120 00000100:00100000:0.0:1782759733.165429:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037120 00000100:00100000:0.0:1782759733.165459:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:0.0:1782759733.165466:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212037120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759733.165499:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212037120:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.165505:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:0.0:1782759733.165532:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037632 00000100:00100000:0.0:1782759733.165536:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037632 00000100:00100000:0.0:1782759733.165565:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1782759733.165571:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212037632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759733.165599:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212037632:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.165606:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1782759733.165632:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212037120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759733.165643:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212037632:0@lo:400:kworker.0 00000100:00080000:0.0:1782759733.165683:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759733.166016:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037504 00000100:00100000:3.0:1782759733.166021:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037504 00000100:00100000:3.0:1782759733.166070:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:3.0:1782759733.166078:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759733.166122:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212037504:12345-0@lo:400:kworker.0 Request processed in 44us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759733.166128:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1782759733.166297:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212037504:0@lo:400:kworker.0 00000100:00080000:0.0:1782759733.166316:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759733.230962:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759733.676176:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212037888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759733.676251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759733.676421:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212037888 00000100:00100000:3.0:1782759733.676431:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212037888 00000100:00100000:3.0:1782759733.676486:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1782759733.676495:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212037888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759733.676529:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759733.676586:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212037888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759733.676593:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1782759733.676864:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212037888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759734.252066:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759735.278204:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759735.481305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759735.481354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759735.481391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759735.481423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759735.481456:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341568 00000100:00100000:1.0:1782759735.481465:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341568 00000100:00100000:1.0:1782759735.481523:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2737 00000100:00100000:1.0:1782759735.481534:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197341568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759735.481604:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197341568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759735.481623:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2737 00000100:00100000:1.0:1782759735.481649:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341696 00000100:00100000:1.0:1782759735.481653:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341696 00000100:00100000:1.0:1782759735.481676:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341824 00000100:00100000:1.0:1782759735.481678:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341824 00000100:00100000:1.0:1782759735.481699:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2183 00000100:00100000:1.0:1782759735.481706:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197341696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759735.481734:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197341696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759735.481741:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2183 00000100:00100000:1.0:1782759735.481754:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2184 00000100:00100000:1.0:1782759735.481760:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197341824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759735.481796:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197341824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759735.481803:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2184 00000100:00100000:2.0:1782759735.482019:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341440 00000100:00100000:2.0:1782759735.482024:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341440 00000100:00100000:2.0:1782759735.482059:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2996 00000100:00100000:2.0:1782759735.482074:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197341440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759735.482109:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197341440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759735.482115:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2996 00000100:00080000:0.0:1782759735.484475:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759735.484484:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759735.484488:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759736.236275:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759736.236301:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212038016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759736.236374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759736.236519:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038016 00000100:00100000:2.0:1782759736.236527:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038016 00000100:00100000:2.0:1782759736.236596:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1782759736.236607:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212038016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759736.236643:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759736.236692:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212038016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759736.236700:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1782759736.236810:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212038016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759736.237062:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759736.300182:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759737.324483:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759738.285297:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212038272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759738.285297:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212038144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759738.285363:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212038528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759738.285376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759738.285376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759738.285415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759738.285435:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212038656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759738.285463:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038144 00000100:00100000:1.0:1782759738.285464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759738.285473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038144 00000100:00100000:1.0:1782759738.285518:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212038400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759738.285542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759738.285573:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038272 00000100:00100000:1.0:1782759738.285578:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038272 00000100:00100000:0.0:1782759738.285612:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038656 00000100:00100000:0.0:1782759738.285617:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038656 00000100:00100000:1.0:1782759738.285631:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038400 00000100:00100000:1.0:1782759738.285637:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038400 00000100:00100000:0.0:1782759738.285662:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:0.0:1782759738.285674:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212038272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759738.285692:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:1.0:1782759738.285702:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212038656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759738.285745:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212038272:12345-0@lo:400:kworker.0 Request processed in 61us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759738.285754:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:1.0:1782759738.285760:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212038656:12345-0@lo:400:kworker.0 Request processed in 59us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759738.285768:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:0.0:1782759738.285781:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:0.0:1782759738.285790:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759738.285847:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212038656:0@lo:400:kworker.0 00000100:00100000:0.0:1782759738.285870:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212038400:12345-0@lo:400:kworker.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759738.285877:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:1.0:1782759738.285900:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212038400:0@lo:400:kworker.0 00000100:00080000:0.0:1782759738.285916:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759738.285956:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038528 00000100:00100000:0.0:1782759738.285960:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038528 00000100:00100000:0.0:1782759738.286008:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:0.0:1782759738.286015:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759738.286151:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212038528:12345-0@lo:400:kworker.0 Request processed in 136us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759738.286163:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00080000:1.0:1782759738.286192:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759738.286194:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212038528:0@lo:400:kworker.0 00000100:00100000:3.0:1782759738.287640:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:3.0:1782759738.287652:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212038144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759738.287723:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212038144:12345-0@lo:400:kworker.0 Request processed in 73us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759738.287751:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1782759738.287783:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212038144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759738.288022:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212038272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759738.288034:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212038784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759738.288074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759738.289058:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038784 00000100:00100000:1.0:1782759738.289066:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038784 00000100:00100000:1.0:1782759738.289191:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:1.0:1782759738.289201:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212038784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759738.289273:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212038784:12345-0@lo:400:kworker.0 Request processed in 74us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759738.289281:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:2.0:1782759738.289387:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212038784:0@lo:400:kworker.0 00000100:00080000:0.0:1782759738.296054:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782759738.348094:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759738.799034:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759738.799060:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212038912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759738.799129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759738.799259:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212038912 00000100:00100000:0.0:1782759738.799267:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212038912 00000100:00100000:0.0:1782759738.799319:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1782759738.799329:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212038912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759738.799364:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759738.799418:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212038912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759738.799425:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1782759738.799511:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212038912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759739.372102:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759740.398608:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759740.596377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759740.596423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759740.596449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759740.596512:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342080 00000100:00100000:0.0:1782759740.596522:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342080 00000100:00100000:0.0:1782759740.596577:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2741 00000100:00100000:0.0:1782759740.596585:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197342080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759740.596664:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197342080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759740.596671:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2741 00000100:00080000:0.0:1782759740.596704:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759740.599960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759740.600016:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342336 00000100:00100000:3.0:1782759740.600026:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342336 00000100:00100000:3.0:1782759740.600079:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342208 00000100:00100000:3.0:1782759740.600082:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342208 00000100:00100000:3.0:1782759740.600107:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2187 00000100:00100000:3.0:1782759740.600116:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197342336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759740.600181:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197342336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759740.600189:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2187 00000100:00100000:3.0:1782759740.600206:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2188 00000100:00100000:3.0:1782759740.600213:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197342208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759740.600235:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197342208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759740.600241:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2188 00000100:00080000:0.0:1782759740.603552:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759740.603563:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759740.604093:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197341952 00000100:00100000:1.0:1782759740.604104:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197341952 00000100:00100000:1.0:1782759740.604439:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2998 00000100:00100000:1.0:1782759740.604451:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197341952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759740.604544:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197341952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (8092us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759740.604552:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2998 00000100:00100000:2.0:1782759741.358130:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759741.358162:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212039040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759741.358234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759741.358362:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039040 00000100:00100000:3.0:1782759741.358370:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039040 00000100:00100000:3.0:1782759741.358431:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1782759741.358440:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212039040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759741.358474:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759741.358536:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212039040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759741.358544:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1782759741.358589:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212039040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759741.358702:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759741.420843:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759742.445551:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759743.405144:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212039552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759743.405268:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759743.405274:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212039168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759743.405321:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212039680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759743.405367:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212039296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759743.405404:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212039808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759743.405437:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759743.405442:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212039424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759743.405490:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039552 00000100:00100000:3.0:1782759743.405497:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039552 00000100:00100000:3.0:1782759743.405543:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039808 00000100:00100000:3.0:1782759743.405546:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039808 00000100:00100000:3.0:1782759743.405567:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1782759743.405574:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212039552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405624:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212039552:12345-0@lo:400:kworker.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759743.405654:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1782759743.405671:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:3.0:1782759743.405677:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212039808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405710:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212039808:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759743.405716:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:3.0:1782759743.405732:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039168 00000100:00100000:3.0:1782759743.405736:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039168 00000100:00100000:3.0:1782759743.405759:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1782759743.405765:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212039168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405793:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212039168:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759743.405799:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1782759743.405853:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039680 00000100:00100000:3.0:1782759743.405856:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039680 00000100:00100000:3.0:1782759743.405881:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039296 00000100:00100000:3.0:1782759743.405883:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039296 00000100:00100000:3.0:1782759743.405900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039424 00000100:00100000:3.0:1782759743.405902:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039424 00000100:00100000:3.0:1782759743.405920:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:3.0:1782759743.405925:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212039680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.405954:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212039680:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759743.405960:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:3.0:1782759743.405971:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1782759743.405976:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212039296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406012:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212039296:12345-0@lo:400:kworker.0 Request processed in 36us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759743.406019:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1782759743.406030:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1782759743.406036:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212039424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406061:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212039424:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759743.406066:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00080000:3.0:1782759743.406090:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759743.406094:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759743.406096:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759743.406122:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212039168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406134:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212039680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406143:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212039552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406171:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212039424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406180:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b76f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212039296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759743.406187:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212039808:0@lo:400:kworker.0 00010000:00010000:2.0:1782759743.476327:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759743.919332:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212039936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759743.919415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759743.919499:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212039936 00000100:00100000:0.0:1782759743.919515:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212039936 00000100:00100000:0.0:1782759743.919562:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1782759743.919571:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212039936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759743.919607:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759743.919668:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212039936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759743.919675:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1782759743.919727:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212039936:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1782759744.454591:0:156733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef12ffde0 20000000:00000080:1.0:1782759744.454690:0:156733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfef800 uarg=0000000000000000 00010000:00010000:1.0:1782759744.456170:0:156733:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759744.456190:0:156733:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759744.456207:0:156733:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759744.456225:0:156733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.456243:0:156733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.456252:0:156733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.456295:0:156733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.456312:0:156733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 18 pid: 5796 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759744.456328:0:156733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156733:1869355212040064:0@lo:104: 00000100:00100000:1.0:1782759744.456391:0:156733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759744.456436:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040064 00000100:00100000:1.0:1782759744.456442:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040064 00000100:00100000:1.0:1782759744.456486:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1782759744.456496:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:156733:x1869355212040064:12345-0@lo:104: 00010000:00010000:1.0:1782759744.456516:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.456564:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759744.456571:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:156733:x1869355212040064:12345-0@lo:104: Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759744.456579:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00010000:00010000:1.0:1782759744.457147:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759744.457155:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457164:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759744.457168:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457177:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759744.457185:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759744.457192:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759744.457227:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457235:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759744.457257:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457264:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e08fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0904 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457285:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759744.457287:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759744.457288:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759744.457303:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212040192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759744.457339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759744.457397:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040192 00000100:00100000:1.0:1782759744.457401:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040192 00010000:00010000:1.0:1782759744.457419:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 19 pid: 5796 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759744.457444:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1782759744.457451:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212040192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759744.457462:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759744.457467:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 19 pid: 5796 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457477:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 19 pid: 5796 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457494:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457502:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457515:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457522:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457534:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457540:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457545:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759744.457549:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457556:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457565:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.457575:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759744.458220:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212040192:12345-0@lo:103:ldlm_bl.0 Request processed in 766us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759744.458228:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1782759744.458278:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212040192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759744.458314:0:156733:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695000 going to sleep for 11 seconds 00010000:00010000:1.0:1782759744.458328:0:156733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777e0904 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e08fd expref: 18 pid: 5796 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759744.458341:0:156733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156733:1869355212040064:0@lo:104: 00010000:00010000:1.0:1782759744.458353:0:156733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.458374:0:156733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.458381:0:156733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.458387:0:156733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031400/0xdd99f5c4777e09ac lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759744.494344:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759745.516135:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759745.716339:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759745.716393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759745.716430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759745.716458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759745.716484:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342464 00000100:00100000:0.0:1782759745.716493:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342464 00000100:00100000:0.0:1782759745.716542:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3000 00000100:00100000:0.0:1782759745.716552:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197342464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759745.716639:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197342464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.716646:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3000 00000100:00100000:0.0:1782759745.716679:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342848 00000100:00100000:0.0:1782759745.716683:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342848 00000100:00100000:0.0:1782759745.716716:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342720 00000100:00100000:0.0:1782759745.716719:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342720 00000100:00100000:0.0:1782759745.716742:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2191 00000100:00100000:0.0:1782759745.716749:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197342848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759745.716778:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197342848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.716798:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2191 00000100:00100000:0.0:1782759745.716812:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2192 00000100:00100000:0.0:1782759745.716818:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197342720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759745.716875:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197342720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.716881:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2192 00000100:00080000:0.0:1782759745.716902:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759745.716907:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759745.717155:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197342592 00000100:00100000:3.0:1782759745.717159:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197342592 00000100:00100000:3.0:1782759745.717299:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2745 00000100:00100000:3.0:1782759745.717307:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197342592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759745.717349:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197342592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 43us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759745.717366:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2745 00000100:00080000:0.0:1782759745.717409:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1782759745.837686:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759745.837694:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759745.837700:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759745.837744:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.837756:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.837767:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759745.837805:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212040320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759745.838094:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759745.838152:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b28180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759745.838214:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040320 00000100:00100000:0.0:1782759745.838223:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040320 00000100:00100000:0.0:1782759745.838280:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:0.0:1782759745.838289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212040320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759745.838302:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759745.838315:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e09b3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.838338:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.838360:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.838370:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75000, rc 0) 00000100:00100000:0.0:1782759745.838412:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212040320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.838419:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:3.0:1782759745.838760:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212040320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759745.838774:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.838783:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759745.838800:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759745.838805:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.838812:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759746.476617:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212040448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759746.476690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759746.476779:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040448 00000100:00100000:1.0:1782759746.476786:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040448 00000100:00100000:1.0:1782759746.476870:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1782759746.476880:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212040448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759746.476916:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 71237632 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759746.476986:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212040448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759746.476993:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00080000:1.0:1782759746.477017:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759746.477055:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212040448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759746.541428:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759747.444371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759747.444456:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343104 00000100:00100000:3.0:1782759747.444466:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343104 00000100:00100000:3.0:1782759747.444542:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2240 00000100:00100000:3.0:1782759747.444564:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:107410:x1869355197343104:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759747.444586:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759747.444609:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e09c1 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671ea expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.445068:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.445084:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.445098:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.445110:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.445117:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.445124:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759747.446148:0:19544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37:0x0], index 0: 0 00010000:00010000:3.0:1782759747.446423:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e09d6 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446447:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e09d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446457:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e09d6 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446496:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446504:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446510:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446516:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759747.446520:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446528:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446540:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1200) 00010000:00010000:3.0:1782759747.446543:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759747.446547:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446568:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09c8 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759747.446580:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb1c6ed4 reply state 0000000037794b8e transno 4294968148 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759747.446594:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759747.446627:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e09c1 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ea expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446646:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e09d6 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ea expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.446653:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x23:0x0].0x0 (ffff9171908a1100) 00010000:00010000:3.0:1782759747.446656:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759747.446658:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc400, rc 0) 00000100:00100000:3.0:1782759747.446733:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:107410:x1869355197343104:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2182us (2371us total) trans 4294968148 rc 0/0 00000100:00100000:3.0:1782759747.446742:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2240 00000100:00080000:1.0:1782759747.446938:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759747.452430:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.452459:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.452468:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.452474:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759747.452479:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.452487:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.452504:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1b00) 00010000:00010000:1.0:1782759747.452507:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759747.452511:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.452518:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e09cf lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759747.475462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759747.475597:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343232 00000100:00100000:2.0:1782759747.475608:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343232 00000100:00100000:2.0:1782759747.475712:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:2.0:1782759747.475723:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197343232:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759747.475786:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782759747.475795:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.475812:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3815s v=(0 0) 00010000:00010000:2.0:1782759747.475817:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759747.475884:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759747.475887:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759747.475966:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.512224:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.512240:0:55099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759747.512269:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212040576:0@lo:101:ll_ost_io00_003.0 00000100:00100000:1.0:1782759747.512326:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759747.512398:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759747.512665:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040576 00000100:00100000:3.0:1782759747.512682:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040576 00000100:00100000:3.0:1782759747.512747:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1782759747.512756:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+6:55099:x1869355212040576:12345-0@lo:101:ll_ost_io00_003.0 00010000:00010000:3.0:1782759747.512772:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759747.512786:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e09eb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.516763:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.516781:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.516809:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759747.516919:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212040576:12345-0@lo:101:ll_ost_io00_003.0 Request processed in 4162us (4591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759747.517620:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212040576:0@lo:101:ll_ost_io00_003.0 00010000:00010000:0.0:1782759747.517645:0:55099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759747.517656:0:55099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759747.517686:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759747.517696:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782759747.518112:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1782759747.518153:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212040704:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759747.518201:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759747.518244:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759747.518267:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040704 00000100:00100000:0.0:1782759747.518272:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040704 00000100:00100000:0.0:1782759747.518316:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1782759747.518323:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+8:55099:x1869355212040704:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:0.0:1782759747.518348:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 8 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759747.518692:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+8:55099:x1869355212040704:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 367us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759747.518700:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1782759747.518733:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212040704:0@lo:601:ll_ost_io00_003.0 00010000:00010000:0.0:1782759747.518748:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782759747.518757:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1782759747.520808:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:1.0:1782759747.529064:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759747.571620:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759747.641761:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967435 is committed 00002000:00010000:1.0:1782759747.642338:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1782759747.642343:0:55099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb mtime from disk: 0 -> 1782759746 00002000:00010000:1.0:1782759747.642346:0:55099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb ctime from disk: 0 -> 1782759746 00002000:00010000:1.0:1782759747.642348:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1782759747.642361:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.642374:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.642383:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.642390:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759747.642394:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.642402:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.642421:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.642429:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e09e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759747.642514:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197343232:12345-192.168.204.31@tcp:4:dd.0 Request processed in 166790us (167060us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1782759747.642536:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:3.0:1782759747.675008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759747.675321:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343360 00000100:00100000:2.0:1782759747.675333:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343360 00000100:00100000:2.0:1782759747.675419:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:2.0:1782759747.675430:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197343360:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759747.675481:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 1048576, mtime: 0x6a42c142, atime: 0x0, ctime: 0x6a42c142, blocks: 0x803 00010000:00010000:2.0:1782759747.675504:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.675520:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:2.0:1782759747.675525:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759747.675531:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.675555:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.695747:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1782759747.695801:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212040832:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759747.695929:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759747.695996:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759747.696028:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040832 00000100:00100000:1.0:1782759747.696037:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040832 00000100:00100000:1.0:1782759747.696080:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1782759747.696090:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212040832:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:1.0:1782759747.696118:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759747.696507:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212040832:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 418us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759747.696515:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1782759747.698979:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212040832:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759747.699033:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782759747.699046:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00002000:00010000:2.0:1782759747.783257:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1782759747.783266:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1782759747.783282:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.783308:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.783317:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.783324:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759747.783330:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.783340:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.783373:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759747.783382:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000022e867f/0xdd99f5c4777e09f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759747.783471:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197343360:12345-192.168.204.31@tcp:4:dd.0 Request processed in 108039us (108468us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1782759747.783482:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 74 00000001:00080000:3.0:1782759747.785514:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967436 is committed 00000100:00100000:3.0:1782759747.815435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759747.816393:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343488 00000100:00100000:1.0:1782759747.816404:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343488 00000100:00100000:1.0:1782759747.816504:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:1.0:1782759747.816514:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197343488:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759747.816585:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 2097152, mtime: 0x6a42c142, atime: 0x0, ctime: 0x6a42c142, blocks: 0x1007 00010000:00010000:1.0:1782759747.816593:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.816609:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:1.0:1782759747.816613:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759747.816619:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.816633:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.829195:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:1.0:1782759747.829252:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212040960:0@lo:601:ll_ost_io00_001.0 00000100:00100000:1.0:1782759747.829308:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759747.829366:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759747.829490:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212040960 00000100:00100000:3.0:1782759747.829496:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212040960 00000100:00100000:3.0:1782759747.829533:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1782759747.829540:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212040960:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:3.0:1782759747.829580:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759747.830368:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212040960:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 826us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759747.830378:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1782759747.830453:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212040960:0@lo:601:ll_ost_io00_001.0 00010000:00010000:3.0:1782759747.830751:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:3.0:1782759747.830765:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:0.0:1782759747.858762:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967437 is committed 00002000:00010000:1.0:1782759747.859286:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1782759747.859291:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1782759747.859305:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.859319:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.859328:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.859335:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759747.859340:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.859349:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.859369:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.859392:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759747.859486:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197343488:12345-192.168.204.31@tcp:4:dd.0 Request processed in 42970us (44061us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1782759747.859497:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:2.0:1782759747.879156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759747.879509:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343616 00000100:00100000:3.0:1782759747.879522:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343616 00000100:00100000:3.0:1782759747.879633:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:3.0:1782759747.879644:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197343616:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759747.879710:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 3145728, mtime: 0x6a42c142, atime: 0x0, ctime: 0x6a42c142, blocks: 0x1807 00010000:00010000:3.0:1782759747.879718:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.879734:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:3.0:1782759747.879738:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759747.879745:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759747.879758:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.897325:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:1.0:1782759747.897378:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:6603:1869355212041088:0@lo:601:ll_ost_io00_000.0 00000100:00100000:1.0:1782759747.897440:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759747.897503:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759747.897854:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041088 00000100:00100000:2.0:1782759747.898075:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041088 00000100:00100000:2.0:1782759747.898129:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1782759747.898139:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc11050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6603:x1869355212041088:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:2.0:1782759747.898170:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759747.898581:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc11050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6603:x1869355212041088:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 442us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759747.898589:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1782759747.899530:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:6603:1869355212041088:0@lo:601:ll_ost_io00_000.0 00010000:00010000:1.0:1782759747.899582:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1782759747.899595:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:0.0:1782759747.949574:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967438 is committed 00002000:00010000:1.0:1782759747.950212:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1782759747.950218:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1782759747.950231:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.950244:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.950267:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.950274:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759747.950278:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.950287:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.950305:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.950313:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759747.950438:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197343616:12345-192.168.204.31@tcp:4:dd.0 Request processed in 70792us (71287us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1782759747.950447:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:2.0:1782759747.972307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759747.972411:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343744 00000100:00100000:1.0:1782759747.972420:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343744 00000100:00100000:1.0:1782759747.972496:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:1.0:1782759747.972506:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197343744:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759747.972569:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 4194304, mtime: 0x6a42c142, atime: 0x0, ctime: 0x6a42c142, blocks: 0x2007 00010000:00010000:1.0:1782759747.972579:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.972607:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:1.0:1782759747.972611:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759747.972618:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.972633:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759747.983911:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:1.0:1782759747.984033:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212041216:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759747.984090:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759747.984152:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759747.984390:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041216 00000100:00100000:3.0:1782759747.984398:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041216 00000100:00100000:3.0:1782759747.984484:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1782759747.984494:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212041216:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759747.984524:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759747.985099:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+7:55099:x1869355212041216:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 606us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759747.985107:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1782759747.985333:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:55099:1869355212041216:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759747.985360:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1782759747.985372:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:2.0:1782759748.046549:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967439 is committed 00002000:00010000:1.0:1782759748.048197:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1782759748.048204:0:55099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb mtime from disk: 1782759746 -> 1782759747 00002000:00010000:1.0:1782759748.048208:0:55099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb ctime from disk: 1782759746 -> 1782759747 00002000:00010000:1.0:1782759748.048210:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1782759748.048235:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.048248:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.048257:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.048263:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759748.048268:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.048275:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.048295:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.048302:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759748.048398:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197343744:12345-192.168.204.31@tcp:4:dd.0 Request processed in 75889us (76096us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1782759748.048408:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:2.0:1782759748.080720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759748.080774:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197343872 00000100:00100000:0.0:1782759748.080784:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197343872 00000100:00100000:0.0:1782759748.080881:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:0.0:1782759748.080891:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197343872:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759748.081005:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 5242880, mtime: 0x6a42c143, atime: 0x0, ctime: 0x6a42c143, blocks: 0x2807 00010000:00010000:0.0:1782759748.081014:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.081030:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:0.0:1782759748.081035:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759748.081041:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.081055:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759748.089056:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968148 is committed 00010000:00010000:3.0:1782759748.092377:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:3.0:1782759748.092431:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212041344:0@lo:601:ll_ost_io00_002.0 00000100:00100000:3.0:1782759748.092488:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759748.092623:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759748.092715:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041344 00000100:00100000:2.0:1782759748.092723:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041344 00000100:00100000:2.0:1782759748.092770:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782759748.092780:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212041344:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:2.0:1782759748.092809:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759748.094143:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:6605:x1869355212041344:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 1361us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759748.094153:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1782759748.094260:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:6605:1869355212041344:0@lo:601:ll_ost_io00_002.0 00010000:00010000:0.0:1782759748.094339:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1782759748.094352:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000001:00080000:3.0:1782759748.128164:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967440 is committed 00002000:00010000:0.0:1782759748.128512:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1782759748.128517:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1782759748.128531:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.128553:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.128562:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.128570:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759748.128576:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.128586:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.128624:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.128632:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e0a15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759748.128815:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197343872:12345-192.168.204.31@tcp:4:dd.0 Request processed in 47921us (48099us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1782759748.128868:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:3.0:1782759748.147520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759748.147660:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197344000 00000100:00100000:1.0:1782759748.147671:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197344000 00000100:00100000:1.0:1782759748.147798:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:1.0:1782759748.147808:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197344000:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759748.148032:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 6291456, mtime: 0x6a42c143, atime: 0x0, ctime: 0x6a42c143, blocks: 0x3007 00010000:00010000:1.0:1782759748.148043:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.148059:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:1.0:1782759748.148063:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759748.148069:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.148084:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.156670:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:0.0:1782759748.156728:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212041472:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759748.156788:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759748.157070:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759748.157111:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041472 00000100:00100000:2.0:1782759748.157118:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041472 00000100:00100000:2.0:1782759748.157160:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1782759748.157169:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212041472:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:2.0:1782759748.157196:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759748.157566:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:6604:x1869355212041472:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 398us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759748.157574:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1782759748.157693:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb963b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:6604:1869355212041472:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759748.157721:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1782759748.157732:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:3.0:1782759748.185520:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967441 is committed 00002000:00010000:0.0:1782759748.185906:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1782759748.185911:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1782759748.185926:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.185949:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.185960:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.185967:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759748.185972:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.185981:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.186000:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.186008:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f09520f/0xdd99f5c4777e0a1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759748.186099:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197344000:12345-192.168.204.31@tcp:4:dd.0 Request processed in 38288us (38583us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1782759748.186109:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:0.0:1782759748.209085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759748.209207:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197344128 00000100:00100000:2.0:1782759748.209216:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197344128 00000100:00100000:2.0:1782759748.209360:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:2.0:1782759748.209370:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197344128:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759748.209423:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 7340032, mtime: 0x6a42c143, atime: 0x0, ctime: 0x6a42c143, blocks: 0x3807 00010000:00010000:2.0:1782759748.209432:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.209448:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:2.0:1782759748.209453:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759748.209459:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.209473:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.218742:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:2.0:1782759748.218796:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cba300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:6603:1869355212041600:0@lo:601:ll_ost_io00_000.0 00000100:00100000:2.0:1782759748.219199:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759748.219301:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759748.219419:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041600 00000100:00100000:0.0:1782759748.219426:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041600 00000100:00100000:0.0:1782759748.219510:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1782759748.219519:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6603:x1869355212041600:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:0.0:1782759748.219556:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759748.219950:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:6603:x1869355212041600:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 431us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759748.219958:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1782759748.220025:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cba300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:6603:1869355212041600:0@lo:601:ll_ost_io00_000.0 00010000:00010000:2.0:1782759748.220060:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1782759748.220070:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759748.220479:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759748.220805:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759748.220844:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212041728:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759748.220879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759748.221377:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041728 00000100:00100000:3.0:1782759748.221383:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041728 00000100:00100000:2.0:1782759748.221427:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1782759748.221436:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212041728:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:2.0:1782759748.221458:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759748.221732:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212041728:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 296us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759748.221740:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:1.0:1782759748.221842:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759748.222065:0:3306:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:1.0:1782759748.222079:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212041728:0@lo:601:lquota_wb_lustr.0 00000001:00080000:0.0:1782759748.265756:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967442 is committed 00002000:00010000:3.0:1782759748.265757:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1782759748.265765:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1782759748.265782:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.265797:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.265807:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.265817:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759748.265869:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.265881:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.265974:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.265998:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e0a23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759748.266102:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197344128:12345-192.168.204.31@tcp:4:dd.0 Request processed in 56729us (57023us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782759748.266113:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:3.0:1782759748.319094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759748.325046:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197344256 00000100:00100000:2.0:1782759748.325065:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197344256 00000100:00100000:2.0:1782759748.325174:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:2.0:1782759748.325187:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197344256:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759748.325243:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 8388608, mtime: 0x6a42c143, atime: 0x0, ctime: 0x6a42c143, blocks: 0x4007 00010000:00010000:2.0:1782759748.325252:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.325269:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:2.0:1782759748.325274:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759748.325280:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.325316:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759748.395052:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967443 is committed 00010000:00010000:3.0:1782759748.395274:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:3.0:1782759748.395344:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212041856:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759748.395406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759748.395573:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041856 00000100:00100000:2.0:1782759748.395581:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041856 00000100:00100000:2.0:1782759748.395631:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1782759748.395640:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212041856:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:2.0:1782759748.395668:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759748.396238:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212041856:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 598us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759748.396247:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00002000:00010000:2.0:1782759748.396295:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1782759748.396300:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x37:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1782759748.396310:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.396321:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.396330:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.396337:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759748.396341:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.396359:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.396377:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.396384:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0a2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759748.396446:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197344256:12345-192.168.204.31@tcp:4:dd.0 Request processed in 71261us (77359us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1782759748.396454:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 81 00010000:00010000:3.0:1782759748.396624:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1782759748.396635:0:3306:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:3.0:1782759748.396646:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212041856:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759748.396782:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212041984:0@lo:106: 00000100:00100000:1.0:1782759748.396812:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759748.396868:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759748.397108:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212041984 00000100:00100000:3.0:1782759748.397113:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212041984 00000100:00100000:3.0:1782759748.397152:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1782759748.397159:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212041984:12345-0@lo:106: 00010000:00010000:3.0:1782759748.397168:0:5784:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759748.397183:0:5784:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:3.0:1782759748.397225:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212041984:12345-0@lo:106: Request processed in 67us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759748.397232:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1782759748.397274:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552300 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212041984:0@lo:106: 00000100:00100000:3.0:1782759748.423630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759748.423866:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197344384 00000100:00100000:0.0:1782759748.423878:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197344384 00000100:00100000:0.0:1782759748.424073:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:0.0:1782759748.424083:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197344384:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759748.424129:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 9437184, mtime: 0x6a42c143, atime: 0x0, ctime: 0x6a42c143, blocks: 0x4807 00010000:00010000:0.0:1782759748.424138:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.424153:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:0.0:1782759748.424157:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759748.424163:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759748.424177:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438390:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438411:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438420:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438428:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759748.438433:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438460:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438479:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.438487:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d948a02/0xdd99f5c4777e0a31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759748.438582:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197344384:12345-192.168.204.31@tcp:4:dd.0 Request processed in 14496us (14957us total) trans 0 rc -122/-122 00000100:00100000:2.0:1782759748.438593:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:1.0:1782759748.450174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759748.450333:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197344640 00000100:00100000:2.0:1782759748.450346:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197344640 00000100:00100000:2.0:1782759748.450412:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 342 00000100:00100000:2.0:1782759748.450423:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:107410:x1869355197344640:12345-192.168.204.31@tcp:35:dd.0 00000001:00080000:2.0:1782759748.450750:0:154820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968149 00000100:00100000:2.0:1782759748.451190:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:107410:x1869355197344640:12345-192.168.204.31@tcp:35:dd.0 Request processed in 766us (6470us total) trans 4294968150 rc 0/0 00000100:00100000:2.0:1782759748.451198:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 342 00000020:00080000:2.0:1782759748.451204:0:154820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782759748.497524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759748.497643:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197344768 00000100:00100000:3.0:1782759748.497653:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197344768 00000100:00100000:3.0:1782759748.497730:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:3.0:1782759748.497742:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917191923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197344768:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782759748.497761:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759748.497782:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671f1 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759748.497811:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 9437184, mtime: 0x6a42c143, atime: 0x0, ctime: 0x6a42c143, blocks: 0x4807 00010000:00010000:2.0:1782759748.498282:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3816s v=(0 0) 00010000:00010000:2.0:1782759748.498287:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759748.498299:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.498330:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759748.498343:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:2.0:1782759748.498541:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917191923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2363:x1869355197344768:12345-192.168.204.31@tcp:101:rm.0 Request processed in 791us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759748.498549:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1038 00000100:00100000:0.0:1782759748.502583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759748.502678:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345024 00000100:00100000:3.0:1782759748.502687:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345024 00000100:00100000:3.0:1782759748.503080:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2241 00000100:00100000:3.0:1782759748.503092:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:107413:x1869355197345024:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:3.0:1782759748.503160:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759748.503190:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc400/0xdd99f5c4777e09d6 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ea expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503230:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x23:0x0].0x0 (ffff9171908a1100) 00010000:00010000:3.0:1782759748.503240:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759748.503262:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503275:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503285:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503298:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503305:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503310:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503678:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 3/0,1 mode: --/EX res: [0x200000418:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503688:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.503695:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759748.506444:0:146757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].57, 64 off11984 00000004:00080000:3.0:1782759748.506458:0:146757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3816909635102ns, next at 3817909631673ns, rc = 0 00010000:00010000:3.0:1782759748.506550:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506567:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506578:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506587:0:146757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506594:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506599:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506627:0:146757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759748.506651:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506657:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506663:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506668:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759748.506672:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506679:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506699:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x23:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759748.506702:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759748.506707:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 2/0,0 mode: --/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506713:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a4d lrc: 0/0,0 mode: --/EX res: [0x200000418:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506745:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506752:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506757:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506762:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759748.506765:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506770:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506777:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759748.506779:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759748.506782:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.506787:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a3f lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759748.506814:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b909c4db reply state 00000000fb35cc1f transno 4294968151 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.507156:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759748.507163:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.507170:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759748.507173:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.507180:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.507189:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x23:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:1.0:1782759748.507191:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782759748.507194:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 1/0,0 mode: --/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.507200:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e0a54 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759748.507213:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759748.507214:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759748.507216:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759748.507354:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759748.507480:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:107413:x1869355197345024:12345-192.168.204.31@tcp:36:rm.0 Request processed in 4386us (4902us total) trans 4294968151 rc 0/0 00000100:00100000:3.0:1782759748.507490:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2241 00010000:00010000:3.0:1782759748.515106:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.515124:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.515133:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.515140:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759748.515145:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.515153:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.515170:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1500) 00010000:00010000:3.0:1782759748.515173:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759748.515179:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759748.515185:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a46 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759748.524769:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212042368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759748.524871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759748.525108:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212042240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.525141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759748.525224:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042240 00000100:00100000:1.0:1782759748.525232:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042240 00000100:00100000:1.0:1782759748.525285:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:1.0:1782759748.525294:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212042240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759748.525364:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212042240:12345-0@lo:400:kworker.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759748.525372:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:3.0:1782759748.526999:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759748.527016:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212042496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759748.527073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759748.527118:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042368 00000100:00100000:3.0:1782759748.527124:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042368 00000100:00100000:3.0:1782759748.527178:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1782759748.527187:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212042368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759748.527236:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212042368:12345-0@lo:400:kworker.0 Request processed in 50us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759748.527243:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1782759748.527263:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042496 00000100:00100000:3.0:1782759748.527267:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042496 00000100:00100000:3.0:1782759748.527293:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:3.0:1782759748.527300:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212042496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759748.527331:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212042496:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759748.527337:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00080000:3.0:1782759748.527353:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759748.527358:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759748.527577:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212042240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.527595:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782759748.527601:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212042112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.527631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759748.527657:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212042624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.527680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759748.527707:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042112 00000100:00100000:2.0:1782759748.527710:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042112 00000100:00100000:2.0:1782759748.527739:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:2.0:1782759748.527745:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212042112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.527781:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212042112:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759748.527786:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:2.0:1782759748.527848:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042624 00000100:00100000:2.0:1782759748.527863:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042624 00000100:00100000:2.0:1782759748.527895:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1782759748.527901:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212042624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.527946:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212042624:12345-0@lo:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759748.527952:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1782759748.527982:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212042112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759748.527992:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212042624:0@lo:400:kworker.0 00000100:00080000:3.0:1782759748.528091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759748.528113:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212042496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759748.528124:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212042368:0@lo:400:kworker.0 00010000:00010000:1.0:1782759748.588294:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759749.038674:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759749.046295:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212042752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759749.046370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759749.046965:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042752 00000100:00100000:0.0:1782759749.046983:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042752 00000100:00100000:0.0:1782759749.047037:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1782759749.047047:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212042752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759749.047083:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759749.047192:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212042752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759749.047199:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1782759749.057119:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212042752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759749.621070:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782759750.625611:0:156978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3819028785511ns, next at 3817909631673ns, rc = 0 00010000:00010000:1.0:1782759750.638191:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759750.653790:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968150 is committed 00000004:00080000:2.0:1782759750.653847:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 130 committed 00000001:00080000:2.0:1782759750.653861:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968151 is committed 00000004:00080000:2.0:1782759750.653864:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 129 committed 00000100:00100000:2.0:1782759750.654073:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759750.654093:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212042880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782759750.654172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759750.654232:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212042880 00000100:00100000:2.0:1782759750.654239:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212042880 00000100:00100000:2.0:1782759750.654285:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1782759750.654294:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212042880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782759750.654319:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:55 count 1 00010000:00010000:2.0:1782759750.654343:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.654364:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.654388:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1782759750.654392:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759750.654397:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.654424:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.654437:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 6 pid: 6597 timeout: 3919 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.654449:0:6597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082d63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1869355212043008:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759750.654514:0:6597:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c300 going to sleep for 11 seconds 00000100:00080000:2.0:1782759750.654526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759750.658135:0:6597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082d63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1869355212043008:192.168.204.31@tcp:104: 00010000:00010000:2.0:1782759750.658166:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759750.658948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759750.659053:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345152 00000100:00100000:3.0:1782759750.659061:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345152 00010000:00010000:3.0:1782759750.659114:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 7 pid: 6597 timeout: 3919 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782759750.659122:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759750.659148:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 703 00000100:00100000:3.0:1782759750.659160:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197345152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759750.659239:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759750.659245:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 7 pid: 6597 timeout: 3919 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.659260:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 7 pid: 6597 timeout: 3919 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.659284:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afff0b9c/0xdd99f5c4777e0a38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f1 expref: 7 pid: 6597 timeout: 3919 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.659300:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759750.659304:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759750.659309:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.659318:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.659367:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759750.659508:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.659519:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.659541:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.659549:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.659571:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782759750.660104:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197345152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 942us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.660113:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 703 00000100:00100000:2.0:1782759750.662946:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212042880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8644us (8774us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1782759750.662960:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000004:00080000:3.0:1782759750.663395:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917082cba300/2, rc 0, transno 4294967444 00000100:00100000:3.0:1782759750.663414:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212042880:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782759750.663689:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759750.663699:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.663712:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759750.663717:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.663728:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.663751:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.663759:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002620a5fc/0xdd99f5c4777e0a5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.663792:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759750.663807:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759750.663810:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782759750.666525:0:156978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3819069700063ns, next at 3789339356829ns, rc = 0 00000004:00080000:2.0:1782759750.675026:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 127 committed 00000100:00100000:2.0:1782759750.839426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759750.839463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759750.839532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759750.839553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759750.839966:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345408 00000100:00100000:3.0:1782759750.839978:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345408 00000100:00100000:3.0:1782759750.840037:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2748 00000100:00100000:3.0:1782759750.840048:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197345408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759750.840129:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197345408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 83us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.840137:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2748 00000100:00100000:2.0:1782759750.841769:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345280 00000100:00100000:2.0:1782759750.841781:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345280 00000100:00100000:2.0:1782759750.842097:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3003 00000100:00100000:2.0:1782759750.842108:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197345280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759750.842283:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197345280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 176us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759750.842291:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3003 00000100:00080000:2.0:1782759750.842319:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759750.842610:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345664 00000100:00100000:1.0:1782759750.842615:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345664 00000100:00100000:1.0:1782759750.842656:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345536 00000100:00100000:1.0:1782759750.842659:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345536 00000100:00100000:1.0:1782759750.842676:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2195 00000100:00100000:1.0:1782759750.842682:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197345664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759750.842711:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197345664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759750.842717:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2195 00000100:00100000:1.0:1782759750.842732:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2196 00000100:00100000:1.0:1782759750.842739:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197345536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759750.842762:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197345536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759750.842768:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2196 00000100:00080000:2.0:1782759750.843049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759751.596216:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212043136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759751.596299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759751.596424:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043136 00000100:00100000:1.0:1782759751.596433:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043136 00000100:00100000:1.0:1782759751.596499:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1782759751.596510:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212043136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759751.596548:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3850371072 avail 3848273920 00000100:00100000:1.0:1782759751.596596:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212043136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759751.596603:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1782759751.596691:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212043136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759751.662604:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759752.686919:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759753.648079:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212043392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759753.648216:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212043904:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759753.648267:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782759753.648274:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212043264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759753.648321:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212043776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759753.648364:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212043520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759753.648403:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759753.648408:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212043648:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759753.648473:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043392 00000100:00100000:1.0:1782759753.648480:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043392 00000100:00100000:1.0:1782759753.648520:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043776 00000100:00100000:1.0:1782759753.648523:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043776 00000100:00100000:1.0:1782759753.648549:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043520 00000100:00100000:1.0:1782759753.648551:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043520 00000100:00100000:1.0:1782759753.648572:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:1.0:1782759753.648581:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212043392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648633:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212043392:12345-0@lo:400:kworker.0 Request processed in 54us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759753.648640:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:1.0:1782759753.648660:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:1.0:1782759753.648666:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212043776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648702:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212043776:12345-0@lo:400:kworker.0 Request processed in 37us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759753.648708:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:1.0:1782759753.648720:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:1.0:1782759753.648725:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3305:x1869355212043520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648767:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3305:x1869355212043520:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759753.648773:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:1.0:1782759753.648792:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043904 00000100:00100000:1.0:1782759753.648796:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043904 00000100:00100000:1.0:1782759753.648819:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043648 00000100:00100000:1.0:1782759753.648846:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043648 00000100:00100000:1.0:1782759753.648868:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:1.0:1782759753.648874:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212043904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648905:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212043904:12345-0@lo:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759753.648911:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:1.0:1782759753.648923:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:1.0:1782759753.648929:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355212043648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.648956:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869355212043648:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759753.648961:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:1.0:1782759753.648978:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212043264 00000100:00100000:1.0:1782759753.648981:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212043264 00000100:00100000:1.0:1782759753.649000:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:1.0:1782759753.649006:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212043264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.649041:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212043264:12345-0@lo:400:kworker.0 Request processed in 36us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759753.649048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00080000:1.0:1782759753.649085:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759753.649089:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759753.649092:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759753.649125:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212043648:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.649134:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212043520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.649158:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212043264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.649167:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212043776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.649175:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212043392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759753.649182:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212043904:0@lo:400:kworker.0 00010000:00010000:0.0:1782759753.709647:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759753.714794:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967444 is committed 00000100:00100000:3.0:1782759753.715072:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759753.715093:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212044032:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759753.715166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759753.715227:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044032 00000100:00100000:2.0:1782759753.715234:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044032 00000100:00100000:2.0:1782759753.715289:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1782759753.715298:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212044032:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759753.716312:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212044032:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1014us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759753.716322:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1782759753.716512:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4a80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212044160:0@lo:106: 00000100:00100000:3.0:1782759753.716546:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759753.716588:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759753.716610:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044160 00000100:00100000:2.0:1782759753.716616:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044160 00000100:00100000:2.0:1782759753.716655:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1782759753.716662:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212044160:12345-0@lo:106: 00010000:00010000:2.0:1782759753.716674:0:5783:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:0.0:1782759753.716679:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212044032:0@lo:601:lquota_wb_lustr.0 00010000:00010000:2.0:1782759753.716685:0:5783:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:2.0:1782759753.716724:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:5826:x1869355212044160:12345-0@lo:106: Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759753.716731:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1782759753.716771:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4a80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212044160:0@lo:106: 00010000:00010000:2.0:1782759753.717229:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759753.717239:0:6621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759753.717246:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759753.717260:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759753.717283:0:6621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759753.717307:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759753.717314:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759753.717322:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc1e39e50) 00040000:00010000:3.0:1782759753.717326:0:5789:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759753.717335:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00040000:00010000:3.0:1782759753.717343:0:5789:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759753.717371:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759753.717378:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759753.717404:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759753.717411:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0000 lock: ffff917180031a00/0xdd99f5c4777e09eb lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e09f2 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759753.717426:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759753.717438:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759753.717439:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759753.717482:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212044288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759753.717517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759753.717666:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044288 00000100:00100000:3.0:1782759753.717671:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044288 00000100:00100000:3.0:1782759753.717714:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782759753.717721:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0000_UUID+7:3306:x1869355212044288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759753.717757:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759753.717772:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e09f2 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd99f5c4777e09eb expref: 7 pid: 5805 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759753.718017:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759753.718052:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212044288:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759753.718059:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782759753.718176:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212044288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759754.156170:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212044416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759754.156253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759754.161601:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044416 00000100:00100000:2.0:1782759754.161620:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044416 00000100:00100000:2.0:1782759754.161702:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1782759754.161713:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212044416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759754.161754:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759754.161886:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212044416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (5632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759754.161893:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1782759754.161965:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212044416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759754.732141:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759755.757099:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759755.958601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759755.958648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759755.958680:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759755.958715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759755.958745:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346176 00000100:00100000:1.0:1782759755.958754:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346176 00000100:00100000:1.0:1782759755.958811:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346048 00000100:00100000:1.0:1782759755.958814:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346048 00000100:00100000:1.0:1782759755.958856:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2199 00000100:00100000:1.0:1782759755.958865:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197346176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759755.958935:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197346176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.958952:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2199 00000100:00100000:1.0:1782759755.958975:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2200 00000100:00100000:1.0:1782759755.958981:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197346048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759755.959006:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197346048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.959013:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2200 00000100:00100000:1.0:1782759755.959031:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345792 00000100:00100000:1.0:1782759755.959034:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345792 00000100:00100000:1.0:1782759755.959059:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3005 00000100:00100000:1.0:1782759755.959064:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197345792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759755.959087:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197345792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.959094:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3005 00000100:00080000:1.0:1782759755.959122:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759755.959126:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759755.959536:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197345920 00000100:00100000:0.0:1782759755.959541:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197345920 00000100:00100000:0.0:1782759755.959595:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2752 00000100:00100000:0.0:1782759755.959603:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197345920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759755.959635:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197345920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759755.959641:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2752 00000100:00080000:1.0:1782759755.961002:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759756.716405:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212044544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759756.716483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759756.716628:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044544 00000100:00100000:0.0:1782759756.716637:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044544 00000100:00100000:0.0:1782759756.716711:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1782759756.716721:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212044544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759756.716761:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759756.716860:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212044544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759756.716868:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00080000:1.0:1782759756.717091:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759756.717160:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967444 gen 2 00000004:00080000:2.0:1782759756.717165:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917082cba300, transno 4294967444 00000100:00100000:2.0:1782759756.717190:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212044544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759756.780111:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759757.807341:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759758.764967:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212044672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759758.765373:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212044928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.765398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759758.765405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759758.765441:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212045184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.765465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759758.765489:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759758.765494:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212044800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.765517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759758.765546:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212045312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.765569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759758.765599:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212045056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.765622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759758.765987:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044672 00000100:00100000:2.0:1782759758.765995:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044672 00000100:00100000:2.0:1782759758.766039:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:2.0:1782759758.766047:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212044672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.766098:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212044672:12345-0@lo:400:kworker.0 Request processed in 52us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759758.766106:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:2.0:1782759758.766137:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045312 00000100:00100000:2.0:1782759758.766141:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045312 00000100:00100000:2.0:1782759758.766171:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045056 00000100:00100000:2.0:1782759758.766174:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045056 00000100:00100000:2.0:1782759758.766193:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:2.0:1782759758.766199:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212045312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.766230:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212045312:12345-0@lo:400:kworker.0 Request processed in 31us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759758.766236:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:2.0:1782759758.766246:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:2.0:1782759758.766251:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212045056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.766280:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212045056:12345-0@lo:400:kworker.0 Request processed in 28us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759758.766286:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00080000:2.0:1782759758.766307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759758.766311:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759758.766380:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044928 00000100:00100000:3.0:1782759758.766385:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044928 00000100:00100000:3.0:1782759758.766411:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045184 00000100:00100000:3.0:1782759758.766414:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045184 00000100:00100000:3.0:1782759758.766430:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212044800 00000100:00100000:3.0:1782759758.766433:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212044800 00000100:00100000:3.0:1782759758.766451:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00080000:2.0:1782759758.766454:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759758.766457:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212044928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.766491:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212045056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759758.767520:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212044928:12345-0@lo:400:kworker.0 Request processed in 1059us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759758.767529:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:3.0:1782759758.767548:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1782759758.767555:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212045184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759758.767594:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212045184:12345-0@lo:400:kworker.0 Request processed in 41us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759758.767600:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1782759758.767609:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:3.0:1782759758.767615:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212044800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759758.767635:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212044800:12345-0@lo:400:kworker.0 Request processed in 21us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759758.767641:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:3.0:1782759758.768082:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212044928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.772489:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212045312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.772545:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212044672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.772556:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212045184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759758.772585:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212044800:0@lo:400:kworker.0 00010000:00010000:0.0:1782759758.828071:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759759.277629:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212045440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759759.277766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759759.278750:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045440 00000100:00100000:1.0:1782759759.278759:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045440 00000100:00100000:1.0:1782759759.278819:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1782759759.278851:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212045440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759759.278888:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759759.278938:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212045440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759759.278961:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1782759759.279434:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212045440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759759.852695:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759760.876845:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759761.082121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759761.082166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759761.082210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759761.082241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759761.082344:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346304 00000100:00100000:1.0:1782759761.082355:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346304 00000100:00100000:1.0:1782759761.082410:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3007 00000100:00100000:1.0:1782759761.082420:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197346304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759761.082493:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197346304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759761.082500:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3007 00000100:00100000:2.0:1782759761.082889:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346560 00000100:00100000:2.0:1782759761.082894:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346560 00000100:00100000:2.0:1782759761.082941:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346688 00000100:00100000:2.0:1782759761.082945:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346688 00000100:00100000:2.0:1782759761.082967:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2203 00000100:00100000:2.0:1782759761.082975:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197346560:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759761.083016:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197346560:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759761.083023:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2203 00000100:00100000:2.0:1782759761.083054:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2204 00000100:00100000:2.0:1782759761.083060:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197346688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759761.083086:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197346688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759761.083092:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2204 00000100:00080000:1.0:1782759761.083341:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759761.083346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759761.083554:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346432 00000100:00100000:3.0:1782759761.083560:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346432 00000100:00100000:3.0:1782759761.083611:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2756 00000100:00100000:3.0:1782759761.083618:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197346432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759761.083666:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197346432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759761.083673:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2756 00000100:00080000:1.0:1782759761.083844:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759761.836335:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759761.836371:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212045568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759761.836465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759761.836591:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045568 00000100:00100000:2.0:1782759761.836600:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045568 00000100:00100000:2.0:1782759761.836666:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1782759761.836677:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212045568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759761.836731:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759761.836782:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212045568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759761.836789:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:0.0:1782759761.836943:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759761.837177:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212045568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759761.900302:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759762.924447:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759763.885581:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212046080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759763.885646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759763.886462:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212045824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759763.886610:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212045952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759763.887885:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046080 00000100:00100000:0.0:1782759763.887896:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046080 00000100:00100000:0.0:1782759763.887951:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:0.0:1782759763.887961:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212046080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.888060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759763.888106:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212046336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.888132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759763.888151:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782759763.888157:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212045696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.888184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759763.888201:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212046208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.888219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759763.888358:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045824 00000100:00100000:3.0:1782759763.888374:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045824 00000100:00100000:3.0:1782759763.888400:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046208 00000100:00100000:3.0:1782759763.888403:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046208 00000100:00100000:3.0:1782759763.888436:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1782759763.888443:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212045824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759763.888480:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212045824:12345-0@lo:400:kworker.0 Request processed in 38us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759763.888486:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1782759763.888501:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1782759763.888506:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212046208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759763.888532:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212046208:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759763.888538:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1782759763.888582:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046336 00000100:00100000:3.0:1782759763.888586:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046336 00000100:00100000:3.0:1782759763.888610:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:3.0:1782759763.888615:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212046336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759763.888646:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212046336:12345-0@lo:400:kworker.0 Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759763.888652:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:2.0:1782759763.890463:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212046208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.890487:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212045824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.890500:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212046336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.890545:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045696 00000100:00100000:2.0:1782759763.890550:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045696 00000100:00100000:2.0:1782759763.890598:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1782759763.890606:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212045696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759763.890678:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212045696:12345-0@lo:400:kworker.0 Request processed in 72us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759763.890686:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1782759763.890737:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212045696:0@lo:400:kworker.0 00000100:00080000:3.0:1782759763.891001:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759763.891008:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759763.891010:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759763.893349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759763.893818:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212045952 00000100:00100000:3.0:1782759763.893854:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212045952 00000100:00100000:3.0:1782759763.893909:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:3.0:1782759763.893918:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212045952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759763.893986:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212045952:12345-0@lo:400:kworker.0 Request processed in 68us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759763.893992:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00080000:1.0:1782759763.894219:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759763.894262:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212045952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759763.899755:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212046080:12345-0@lo:400:kworker.0 Request processed in 11783us (14096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759763.899772:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:3.0:1782759763.900174:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212046080:0@lo:400:kworker.0 00010000:00010000:1.0:1782759763.950152:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759764.396480:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212046464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759764.396561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759764.396685:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046464 00000100:00100000:3.0:1782759764.396694:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046464 00000100:00100000:3.0:1782759764.396750:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1782759764.396759:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212046464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759764.396794:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759764.398133:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212046464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1371us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759764.398154:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1782759764.400250:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212046464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759764.972355:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759765.996208:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759766.197767:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759766.197838:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759766.197970:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346816 00000100:00100000:0.0:1782759766.197980:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346816 00000100:00100000:0.0:1782759766.198038:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3009 00000100:00100000:0.0:1782759766.198048:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197346816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759766.198138:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197346816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759766.198147:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3009 00000100:00100000:3.0:1782759766.198383:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197346944 00000100:00100000:3.0:1782759766.198388:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197346944 00000100:00100000:3.0:1782759766.198520:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2760 00000100:00100000:3.0:1782759766.198529:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197346944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759766.198680:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197346944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 152us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759766.198687:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2760 00000100:00080000:1.0:1782759766.198790:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759766.202021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759766.202125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759766.203091:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347200 00000100:00100000:2.0:1782759766.203389:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347200 00000100:00080000:1.0:1782759766.204073:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759766.205005:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347072 00000100:00100000:3.0:1782759766.205014:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347072 00000100:00080000:1.0:1782759766.205369:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759766.205379:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2207 00000100:00100000:2.0:1782759766.205394:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197347200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759766.205428:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2208 00000100:00100000:0.0:1782759766.205439:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197347072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759766.205484:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197347200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (3617us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759766.205487:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197347072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759766.208377:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2207 00000100:00100000:0.0:1782759766.208395:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2208 00000100:00100000:3.0:1782759766.956353:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212046592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759766.956439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759766.956800:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046592 00000100:00100000:2.0:1782759766.956808:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046592 00000100:00080000:3.0:1782759766.956949:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759766.956987:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1782759766.956998:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212046592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759766.957045:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759766.957114:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212046592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759766.957121:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1782759766.957203:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212046592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759767.021682:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759768.044064:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759769.005029:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212046976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759769.005103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.005168:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759769.005175:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212047104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759769.005202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.005235:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047104 00000100:00100000:0.0:1782759769.005242:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047104 00000100:00100000:0.0:1782759769.005297:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:0.0:1782759769.005306:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212047104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759769.005359:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212047104:12345-0@lo:400:kworker.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.005367:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:0.0:1782759769.005407:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212047104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005512:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212046720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759769.005571:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212047232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759769.005626:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782759769.005628:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046976 00000100:00100000:0.0:1782759769.005631:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046976 00000100:00100000:3.0:1782759769.005632:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212046848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759769.005669:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212047360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759769.005672:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047232 00000100:00100000:0.0:1782759769.005681:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047232 00000100:00100000:0.0:1782759769.005704:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046848 00000100:00100000:3.0:1782759769.005707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.005707:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046848 00000100:00100000:0.0:1782759769.005724:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:0.0:1782759769.005730:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212046976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005735:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:3.0:1782759769.005741:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212047232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759769.005765:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212046976:12345-0@lo:400:kworker.0 Request processed in 35us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.005769:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212047232:12345-0@lo:400:kworker.0 Request processed in 29us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.005772:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:3.0:1782759769.005775:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:3.0:1782759769.005787:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1782759769.005793:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212046848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759769.005812:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212046976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005817:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212046848:12345-0@lo:400:kworker.0 Request processed in 25us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.005840:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00080000:3.0:1782759769.005855:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759769.005860:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759769.005868:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212046720 00000100:00100000:3.0:1782759769.005871:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212046720 00000100:00100000:3.0:1782759769.005904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1782759769.005910:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212046720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.005939:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212046720:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.005946:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1782759769.005978:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047360 00000100:00100000:3.0:1782759769.005986:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047360 00000100:00100000:3.0:1782759769.006024:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:3.0:1782759769.006030:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212047360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.006060:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212047360:12345-0@lo:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.006066:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:3.0:1782759769.006096:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212046848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.006107:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212047360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.006114:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212046720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759769.006122:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212047232:0@lo:400:kworker.0 00000100:00080000:1.0:1782759769.006126:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759769.069803:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759769.517787:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212047488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759769.517936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.518107:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047488 00000100:00100000:0.0:1782759769.518115:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047488 00000100:00100000:0.0:1782759769.518172:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1782759769.518180:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212047488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759769.518217:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759769.518261:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212047488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.518268:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1782759769.518919:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212047488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759770.094565:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759771.117759:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759771.316471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759771.316512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759771.316535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759771.316663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759771.316691:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347328 00000100:00100000:0.0:1782759771.316700:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347328 00000100:00100000:0.0:1782759771.316753:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3011 00000100:00100000:0.0:1782759771.316763:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197347328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759771.316926:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197347328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 162us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.316935:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3011 00000100:00100000:0.0:1782759771.316985:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347456 00000100:00100000:0.0:1782759771.316989:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347456 00000100:00100000:0.0:1782759771.317082:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2764 00000100:00100000:0.0:1782759771.318268:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197347456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759771.318323:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197347456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.318331:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2764 00000100:00100000:0.0:1782759771.318367:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347584 00000100:00100000:0.0:1782759771.318372:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347584 00000100:00080000:3.0:1782759771.318434:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759771.318440:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759771.319878:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347712 00000100:00100000:1.0:1782759771.319887:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347712 00000100:00100000:1.0:1782759771.319953:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2211 00000100:00100000:1.0:1782759771.319963:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197347712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759771.320026:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197347712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 64us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.320034:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2211 00000100:00080000:3.0:1782759771.322880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759771.323888:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2212 00000100:00100000:0.0:1782759771.323903:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197347584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759771.323988:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197347584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (7451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.323995:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2212 00000100:00100000:3.0:1782759772.076058:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212047616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759772.076245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759772.076627:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047616 00000100:00100000:1.0:1782759772.076636:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047616 00000100:00100000:1.0:1782759772.076736:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1782759772.076746:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212047616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759772.076782:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759772.076857:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212047616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759772.076866:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1782759772.076880:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212047616:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759772.077055:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759772.143351:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759772.281506:0:157393:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8f7745c0 20000000:00000080:0.0:1782759772.281525:0:157393:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917081117c00 uarg=0000000000000000 00010000:00010000:0.0:1782759772.282141:0:157393:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759772.282156:0:157393:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759772.282169:0:157393:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759772.282185:0:157393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.282201:0:157393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.282216:0:157393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.282256:0:157393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.282270:0:157393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 18 pid: 5796 timeout: 3940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759772.282284:0:157393:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:157393:1869355212047744:0@lo:104: 00000100:00100000:0.0:1782759772.282346:0:157393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759772.282405:0:157393:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193118780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759772.282421:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047744 00000100:00100000:3.0:1782759772.282428:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047744 00000100:00100000:3.0:1782759772.282475:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1782759772.282485:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:157393:x1869355212047744:12345-0@lo:104: 00010000:00010000:3.0:1782759772.282498:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759772.283449:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759772.283463:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:157393:x1869355212047744:12345-0@lo:104: Request processed in 979us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759772.283472:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00010000:00010000:0.0:1782759772.283553:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759772.283559:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.283567:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dccc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759772.283571:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.283580:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759772.283588:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759772.283593:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759772.283632:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.283650:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759772.283678:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.283685:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dccc00/0xdd99f5c4777e09b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e09ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.283703:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759772.283704:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759772.283706:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759772.283718:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212047872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759772.283753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759772.283991:0:157393:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:157393:1869355212047744:0@lo:104: 00010000:00010000:2.0:1782759772.284019:0:157393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759772.284134:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212047872 00000100:00100000:0.0:1782759772.284141:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212047872 00010000:00010000:0.0:1782759772.284163:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 19 pid: 5796 timeout: 3940 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759772.284233:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1782759772.284260:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212047872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759772.284273:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759772.284279:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 19 pid: 5796 timeout: 3940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284289:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 19 pid: 5796 timeout: 3940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284304:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75000/0xdd99f5c4777e09ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e09b3 expref: 19 pid: 5796 timeout: 3940 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284327:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284336:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284351:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284358:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284365:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284371:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284376:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759772.284380:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284387:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284408:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759772.284416:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759772.284449:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212047872:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759772.284461:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00010000:00010000:2.0:1782759772.284521:0:157393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759772.284531:0:157393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759772.284538:0:157393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0a62 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759772.285629:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212047872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759773.166098:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759773.419899:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759773.419907:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759773.419912:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759773.419958:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759773.419970:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759773.419981:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759773.420006:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212048000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759773.420086:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759773.420226:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048000 00000100:00100000:2.0:1782759773.420235:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048000 00000100:00100000:3.0:1782759773.420286:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759773.423448:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:2.0:1782759773.423466:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212048000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759773.423484:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759773.423505:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0a69 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759773.423535:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759773.423547:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759773.423557:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782759773.423847:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212048000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 386us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759773.423854:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:3.0:1782759773.424104:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212048000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759773.424124:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759773.424135:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759773.424155:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759773.424160:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759773.424167:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759774.127173:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212048512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.127253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759774.127315:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759774.127322:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212048128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.127348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759774.127366:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212048640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.127387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759774.127424:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212048384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.127454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759774.127471:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782759774.127477:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212048256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.127494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759774.127509:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212048768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.127530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759774.127555:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048640 00000100:00100000:2.0:1782759774.127563:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048640 00000100:00100000:2.0:1782759774.127606:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048384 00000100:00100000:2.0:1782759774.127609:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048384 00000100:00100000:2.0:1782759774.127625:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048256 00000100:00100000:2.0:1782759774.127628:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048256 00000100:00100000:2.0:1782759774.127646:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1782759774.127654:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212048640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759774.127970:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048512 00000100:00100000:3.0:1782759774.127975:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048512 00000100:00100000:2.0:1782759774.128196:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212048640:12345-0@lo:400:kworker.0 Request processed in 541us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759774.128205:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1782759774.128222:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1782759774.128228:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212048384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.128256:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212048384:12345-0@lo:400:kworker.0 Request processed in 29us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759774.128262:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1782759774.128271:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:2.0:1782759774.128276:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212048256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.128296:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3308:x1869355212048256:12345-0@lo:400:kworker.0 Request processed in 20us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759774.128312:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00080000:2.0:1782759774.128334:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759774.128338:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759774.128370:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212048256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.128379:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212048384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.128417:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212048640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759774.128482:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048768 00000100:00100000:3.0:1782759774.128486:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048768 00000100:00100000:3.0:1782759774.128511:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1782759774.128526:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212048512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759774.128562:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212048512:12345-0@lo:400:kworker.0 Request processed in 46us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759774.128568:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1782759774.128579:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:3.0:1782759774.128584:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212048768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759774.128606:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212048768:12345-0@lo:400:kworker.0 Request processed in 22us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759774.128611:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00080000:2.0:1782759774.129808:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759774.129889:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212048768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759774.129930:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212048512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759774.132680:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048128 00000100:00100000:1.0:1782759774.132693:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048128 00000100:00100000:1.0:1782759774.132757:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:1.0:1782759774.132782:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212048128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759774.133563:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212048128:12345-0@lo:400:kworker.0 Request processed in 794us (6210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759774.133586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000100:00100000:2.0:1782759774.133818:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212048128:0@lo:400:kworker.0 00010000:00010000:3.0:1782759774.195323:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759774.640094:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212048896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759774.640172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759774.640221:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212048896 00000100:00100000:3.0:1782759774.640230:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212048896 00000100:00100000:3.0:1782759774.640324:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1782759774.640335:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212048896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759774.640373:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57606144 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759774.640437:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212048896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759774.640444:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1782759774.640564:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212048896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759775.054182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759775.054273:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197347968 00000100:00100000:3.0:1782759775.054283:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197347968 00000100:00100000:3.0:1782759775.054360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2242 00000100:00100000:3.0:1782759775.054379:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:107849:x1869355197347968:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759775.054401:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759775.054421:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0a77 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671f8 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.054881:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.054896:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.054909:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.054923:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.054929:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.054935:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759775.055959:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37:0x0], index 1: 0 00010000:00010000:3.0:1782759775.056220:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a8c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056234:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a8c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056244:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a8c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056287:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056294:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056301:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056306:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759775.056311:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056318:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056331:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1200) 00010000:00010000:3.0:1782759775.056334:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759775.056339:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056345:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0a7e lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759775.056358:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2bf94e7 reply state 0000000008eb46d2 transno 4294968152 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.056367:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759775.056399:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd200/0xdd99f5c4777e0a77 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f8 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056430:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a8c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f8 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.056437:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x24:0x0].0x0 (ffff9171908a1000) 00010000:00010000:3.0:1782759775.056440:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759775.056442:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759775.056534:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:107849:x1869355197347968:12345-192.168.204.31@tcp:101:dd.0 Request processed in 2158us (2361us total) trans 4294968152 rc 0/0 00000100:00100000:3.0:1782759775.056543:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2242 00000100:00080000:0.0:1782759775.056915:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759775.064061:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.064079:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.064087:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.064093:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759775.064098:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.064107:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.064125:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1100) 00010000:00010000:1.0:1782759775.064129:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759775.064133:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.064139:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcda00/0xdd99f5c4777e0a85 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.101157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759775.107372:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348096 00000100:00100000:3.0:1782759775.107390:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348096 00000100:00100000:3.0:1782759775.107489:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:3.0:1782759775.107501:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197348096:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759775.107550:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782759775.107559:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.107575:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3843s v=(0 0) 00010000:00010000:3.0:1782759775.107580:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759775.107586:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.107603:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759775.107785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759775.133848:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.133862:0:55099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.133890:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212049024:0@lo:101:ll_ost_io00_003.0 00000100:00100000:3.0:1782759775.133948:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759775.133994:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c46540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759775.134085:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049024 00000100:00100000:2.0:1782759775.134092:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049024 00000100:00100000:2.0:1782759775.134140:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1782759775.134151:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+6:55099:x1869355212049024:12345-0@lo:101:ll_ost_io00_003.0 00010000:00010000:2.0:1782759775.134166:0:154820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759775.134181:0:154820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0aa1 expref: -99 pid: 154820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.135318:0:154820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.135344:0:154820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.135360:0:154820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90200, rc 0) 00000100:00100000:2.0:1782759775.135425:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212049024:12345-0@lo:101:ll_ost_io00_003.0 Request processed in 1276us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759775.135433:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1782759775.137265:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212049024:0@lo:101:ll_ost_io00_003.0 00010000:00010000:1.0:1782759775.137291:0:55099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.137303:0:55099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.137347:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.137356:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782759775.137752:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1782759775.137793:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212049152:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759775.137876:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759775.137911:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759775.138931:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049152 00000100:00100000:3.0:1782759775.138940:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049152 00000100:00100000:3.0:1782759775.139082:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1782759775.139094:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212049152:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759775.139127:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.139519:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212049152:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 426us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759775.139527:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1782759775.139644:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212049152:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759775.139666:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782759775.139733:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00002000:00010000:1.0:1782759775.181404:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1782759775.181413:0:55099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb mtime from disk: 0 -> 1782759774 00002000:00010000:1.0:1782759775.181416:0:55099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb ctime from disk: 0 -> 1782759774 00002000:00010000:1.0:1782759775.181419:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1782759775.181434:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.181448:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.181468:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.181476:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759775.181481:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.181490:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.181509:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.181517:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d46c9cc/0xdd99f5c4777e0a9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759775.181616:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2364:x1869355197348096:12345-192.168.204.31@tcp:4:dd.0 Request processed in 74113us (80465us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1782759775.181626:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 83 00000001:00080000:2.0:1782759775.183255:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967420 is committed 00000100:00100000:1.0:1782759775.214154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759775.214262:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348224 00000100:00100000:2.0:1782759775.214274:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348224 00000100:00100000:2.0:1782759775.214352:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:2.0:1782759775.214362:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197348224:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759775.214414:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 1048576, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x803 00010000:00010000:2.0:1782759775.214422:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.214439:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3843s v=(0 0) 00010000:00010000:2.0:1782759775.214443:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759775.214451:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.214464:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.215082:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759775.230601:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1782759775.230673:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212049280:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759775.230738:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.230800:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c0990cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759775.231514:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049280 00000100:00100000:3.0:1782759775.231522:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049280 00000100:00100000:3.0:1782759775.231682:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1782759775.231693:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212049280:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:3.0:1782759775.231727:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.232185:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212049280:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 492us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759775.232194:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1782759775.232288:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212049280:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759775.232447:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782759775.232459:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000001:00080000:2.0:1782759775.279546:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967421 is committed 00002000:00010000:2.0:1782759775.279634:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1782759775.279639:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1782759775.279655:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.279669:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.279679:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.279686:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759775.279691:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.279718:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.279738:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.279745:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0aaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759775.279862:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197348224:12345-192.168.204.31@tcp:4:dd.0 Request processed in 65497us (65714us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1782759775.279871:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 84 00000100:00100000:1.0:1782759775.300263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759775.300368:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348352 00000100:00100000:3.0:1782759775.300378:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348352 00000100:00100000:3.0:1782759775.300451:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:3.0:1782759775.300462:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197348352:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759775.300515:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 2097152, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x1007 00010000:00010000:3.0:1782759775.300524:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.300541:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3843s v=(0 0) 00010000:00010000:3.0:1782759775.300545:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759775.300551:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.300566:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.313736:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:2.0:1782759775.315432:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212049408:0@lo:601:ll_ost_io00_000.0 00000100:00100000:2.0:1782759775.315503:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.315552:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759775.316087:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049408 00000100:00100000:2.0:1782759775.316095:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049408 00000100:00100000:2.0:1782759775.316191:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1782759775.316201:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212049408:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:2.0:1782759775.316236:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759775.316858:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212049408:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 657us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759775.316867:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1782759775.317099:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212049408:0@lo:601:ll_ost_io00_000.0 00010000:00010000:1.0:1782759775.317138:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1782759775.317161:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:0.0:1782759775.372995:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967422 is committed 00002000:00010000:1.0:1782759775.373333:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1782759775.373338:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1782759775.373351:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.373363:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.373372:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.373379:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759775.373384:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.373394:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.373414:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.373422:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f6d227/0xdd99f5c4777e0ab6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759775.373544:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197348352:12345-192.168.204.31@tcp:4:dd.0 Request processed in 73078us (73286us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1782759775.373555:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 85 00000100:00100000:0.0:1782759775.417223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759775.417341:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348480 00000100:00100000:3.0:1782759775.417352:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348480 00000100:00100000:3.0:1782759775.417423:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:3.0:1782759775.417433:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197348480:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759775.417493:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 3145728, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x1807 00010000:00010000:3.0:1782759775.417501:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.417517:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3843s v=(0 0) 00010000:00010000:3.0:1782759775.417522:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759775.417528:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.417542:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.441024:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:2.0:1782759775.441081:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212049536:0@lo:601:ll_ost_io00_001.0 00000100:00100000:2.0:1782759775.441148:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.441222:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759775.442131:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049536 00000100:00100000:0.0:1782759775.442140:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049536 00000100:00100000:0.0:1782759775.442200:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1782759775.442209:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc12c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212049536:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:0.0:1782759775.442241:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.442985:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc12c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212049536:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 775us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759775.442994:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1782759775.443267:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212049536:0@lo:601:ll_ost_io00_001.0 00010000:00010000:2.0:1782759775.443305:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1782759775.443328:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:0.0:1782759775.482027:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967423 is committed 00002000:00010000:3.0:1782759775.482343:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1782759775.482348:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1782759775.482362:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.482377:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.482386:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.482392:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759775.482397:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.482425:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.482445:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.482452:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0abd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.482548:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197348480:12345-192.168.204.31@tcp:4:dd.0 Request processed in 65110us (65331us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1782759775.482558:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 86 00000100:00100000:0.0:1782759775.503171:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759775.503278:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348608 00000100:00100000:1.0:1782759775.503288:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348608 00000100:00100000:1.0:1782759775.503387:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:1.0:1782759775.503398:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197348608:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:1.0:1782759775.503448:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 4194304, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x2007 00010000:00010000:1.0:1782759775.503457:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.503473:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3843s v=(0 0) 00010000:00010000:1.0:1782759775.503477:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759775.503483:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.503498:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.512709:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:1.0:1782759775.512770:0:55099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212049664:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759775.512861:0:55099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759775.512956:0:55099:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181a780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759775.513500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049664 00000100:00100000:0.0:1782759775.513509:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049664 00000100:00100000:0.0:1782759775.513567:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1782759775.513577:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212049664:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:0.0:1782759775.513611:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.514097:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:55099:x1869355212049664:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 519us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759775.514105:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1782759775.517189:0:55099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3181f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:55099:1869355212049664:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759775.517252:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1782759775.517265:0:55099:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:0.0:1782759775.574161:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967424 is committed 00002000:00010000:3.0:1782759775.574563:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1782759775.574568:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1782759775.574582:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.574595:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.574605:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.574612:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759775.574617:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.574639:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.574659:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.574666:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006990957a/0xdd99f5c4777e0ac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.574801:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197348608:12345-192.168.204.31@tcp:4:dd.0 Request processed in 71399us (71636us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1782759775.574811:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 87 00000100:00100000:3.0:1782759775.604404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759775.604602:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348736 00000100:00100000:2.0:1782759775.604612:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348736 00000100:00100000:2.0:1782759775.604688:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:2.0:1782759775.604699:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197348736:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759775.604748:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 5242880, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x2807 00010000:00010000:2.0:1782759775.604758:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.604775:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:2.0:1782759775.604780:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759775.604787:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.604803:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.616207:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:2.0:1782759775.616269:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212049792:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759775.616332:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.616385:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759775.616941:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049792 00000100:00100000:1.0:1782759775.616950:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049792 00000100:00100000:1.0:1782759775.617018:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782759775.617029:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212049792:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:1.0:1782759775.617065:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759775.617529:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:6605:x1869355212049792:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 501us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759775.617538:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782759775.618034:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:6605:1869355212049792:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759775.618085:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782759775.618099:0:6605:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000001:00080000:3.0:1782759775.659052:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967425 is committed 00002000:00010000:0.0:1782759775.659591:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1782759775.659597:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1782759775.659610:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.659623:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.659633:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.659640:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759775.659645:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.659654:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.659674:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.659681:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002620a5fc/0xdd99f5c4777e0acb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.659797:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197348736:12345-192.168.204.31@tcp:4:dd.0 Request processed in 55094us (55400us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1782759775.659809:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 88 00000100:00100000:0.0:1782759775.686921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759775.687086:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348864 00000100:00100000:2.0:1782759775.687097:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348864 00000100:00100000:2.0:1782759775.687185:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:2.0:1782759775.687196:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197348864:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759775.687249:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 6291456, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x3007 00010000:00010000:2.0:1782759775.687258:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.687274:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:2.0:1782759775.687278:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759775.687284:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.687330:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.697208:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:2.0:1782759775.697268:0:6603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212049920:0@lo:601:ll_ost_io00_000.0 00000100:00100000:2.0:1782759775.697337:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.697393:0:6603:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759775.697579:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212049920 00000100:00100000:0.0:1782759775.697587:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212049920 00000100:00100000:0.0:1782759775.697640:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1782759775.697650:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212049920:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:0.0:1782759775.697683:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.698298:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:6603:x1869355212049920:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 647us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759775.698307:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1782759775.699524:0:6603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:6603:1869355212049920:0@lo:601:ll_ost_io00_000.0 00010000:00010000:2.0:1782759775.699573:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1782759775.699587:0:6603:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:0.0:1782759775.731302:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967426 is committed 00002000:00010000:1.0:1782759775.731786:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1782759775.731791:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1782759775.731806:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.731892:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.731904:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.731931:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759775.731936:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.731946:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.731967:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759775.731975:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000022e867f/0xdd99f5c4777e0ad2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759775.732132:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197348864:12345-192.168.204.31@tcp:4:dd.0 Request processed in 44933us (45217us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1782759775.732144:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 89 00000100:00100000:3.0:1782759775.754394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759775.754531:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197348992 00000100:00100000:2.0:1782759775.754542:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197348992 00000100:00100000:2.0:1782759775.754623:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:2.0:1782759775.754633:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197348992:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759775.754682:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 7340032, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x3807 00010000:00010000:2.0:1782759775.754692:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.754707:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:2.0:1782759775.754724:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759775.754731:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.754747:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.778285:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:2.0:1782759775.778397:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212050048:0@lo:601:ll_ost_io00_001.0 00000100:00100000:2.0:1782759775.778549:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.778691:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759775.778806:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050048 00000100:00100000:1.0:1782759775.778814:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050048 00000100:00100000:1.0:1782759775.778975:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1782759775.778985:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212050048:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:1.0:1782759775.779035:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759775.779466:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:6604:x1869355212050048:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 471us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759775.779483:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1782759775.779565:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:6604:1869355212050048:0@lo:601:ll_ost_io00_001.0 00010000:00010000:3.0:1782759775.779605:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1782759775.779616:0:6604:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759775.780127:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:3.0:1782759775.780516:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212050176:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759775.780559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759775.781120:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050176 00000100:00100000:2.0:1782759775.781127:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050176 00000100:00100000:2.0:1782759775.781177:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1782759775.781186:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212050176:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:2.0:1782759775.781215:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759775.781631:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212050176:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 445us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759775.781638:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:2.0:1782759775.781698:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1782759775.781708:0:3305:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:2.0:1782759775.781730:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212050176:0@lo:601:lquota_wb_lustr.0 00002000:00010000:3.0:1782759775.841042:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:3.0:1782759775.841068:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1782759775.841085:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.841099:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.841114:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.841121:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759775.841126:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.841136:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759775.841153:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967427 is committed 00010000:00010000:3.0:1782759775.841156:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759775.841162:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ec183e/0xdd99f5c4777e0ad9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759775.841273:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197348992:12345-192.168.204.31@tcp:4:dd.0 Request processed in 86636us (86885us total) trans 4294967427 rc 0/0 00000100:00100000:3.0:1782759775.841283:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:3.0:1782759775.879385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759775.882664:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349120 00000100:00100000:1.0:1782759775.882680:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349120 00000100:00100000:2.0:1782759775.883698:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:2.0:1782759775.883711:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197349120:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759775.883763:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 8388608, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x4007 00010000:00010000:2.0:1782759775.883771:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.883788:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:2.0:1782759775.883792:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759775.883799:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759775.883812:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759775.991008:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:0.0:1782759775.991018:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:0.0:1782759775.991034:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.991048:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.991077:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.991084:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759775.991088:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.991097:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.991119:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759775.991127:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000633079/0xdd99f5c4777e0ae0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.991234:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2362:x1869355197349120:12345-192.168.204.31@tcp:4:dd.0 Request processed in 107520us (111853us total) trans 4294967428 rc 0/0 00000100:00100000:0.0:1782759775.991255:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 91 00000001:00080000:1.0:1782759775.991368:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967428 is committed 00010000:00010000:0.0:1782759775.991602:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:0.0:1782759775.991673:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759775.991689:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212050304:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759775.991739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759775.991817:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050304 00000100:00100000:0.0:1782759775.991865:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050304 00000100:00100000:0.0:1782759775.991904:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782759775.991912:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212050304:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:0.0:1782759775.991941:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759775.992386:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212050304:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 474us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759775.992394:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782759775.992454:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212050432:0@lo:106: 00000100:00100000:0.0:1782759775.992485:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759775.992512:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759775.992531:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759775.992541:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050432 00000100:00100000:0.0:1782759775.992545:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050432 00000100:00100000:0.0:1782759775.992573:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1782759775.992579:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212050432:12345-0@lo:106: 00010000:00010000:0.0:1782759775.992589:0:73865:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1782759775.992600:0:73865:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:0.0:1782759775.992640:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212050432:12345-0@lo:106: Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759775.992647:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1782759775.992727:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212050432:0@lo:106: 00010000:00010000:0.0:1782759775.992783:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1782759775.992793:0:3305:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:0.0:1782759775.992807:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212050304:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759776.046516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759776.048713:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349248 00000100:00100000:0.0:1782759776.048728:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349248 00000100:00100000:0.0:1782759776.048810:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:0.0:1782759776.048837:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197349248:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759776.048907:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 9437184, mtime: 0x6a42c15e, atime: 0x0, ctime: 0x6a42c15e, blocks: 0x4807 00010000:00010000:0.0:1782759776.048917:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.048934:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:0.0:1782759776.048938:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759776.048944:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.048958:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759776.179060:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967429 is committed 00000100:00100000:1.0:1782759776.179951:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759776.179976:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212050560:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759776.180064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759776.180187:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050560 00000100:00100000:3.0:1782759776.180195:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050560 00000100:00100000:3.0:1782759776.180270:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1782759776.180280:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212050560:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759776.180750:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212050560:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 470us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759776.180759:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1782759776.180872:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212050560:0@lo:601:lquota_wb_lustr.0 00000100:00080000:1.0:1782759776.181526:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:0.0:1782759776.182468:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:0.0:1782759776.182476:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb mtime from disk: 1782759774 -> 1782759775 00002000:00010000:0.0:1782759776.182479:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb ctime from disk: 1782759774 -> 1782759775 00002000:00010000:0.0:1782759776.182505:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 18439 -> 20489 00010000:00010000:0.0:1782759776.182521:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.182534:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.182543:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.182550:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759776.182555:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.182563:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.182582:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.182589:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a47dd235/0xdd99f5c4777e0ae7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759776.182686:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197349248:12345-192.168.204.31@tcp:4:dd.0 Request processed in 133863us (136176us total) trans 4294967429 rc 0/0 00000100:00100000:0.0:1782759776.182697:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:1.0:1782759776.221938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759776.222058:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349376 00000100:00100000:2.0:1782759776.222068:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349376 00000100:00100000:2.0:1782759776.222137:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00100000:2.0:1782759776.222148:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197349376:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:2.0:1782759776.222199:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 10485760, mtime: 0x6a42c15f, atime: 0x0, ctime: 0x6a42c15f, blocks: 0x5009 00010000:00010000:2.0:1782759776.222207:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.222222:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:2.0:1782759776.222238:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759776.222245:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.222260:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.239173:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782759776.305637:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:2.0:1782759776.305647:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 20489 -> 22537 00010000:00010000:2.0:1782759776.306116:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.306198:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.306209:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.306218:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759776.306223:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.306234:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.306255:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.306284:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49d0e16/0xdd99f5c4777e0aee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759776.306451:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2364:x1869355197349376:12345-192.168.204.31@tcp:4:dd.0 Request processed in 84300us (84518us total) trans 4294967430 rc 0/0 00000100:00100000:2.0:1782759776.306533:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 93 00000001:00080000:3.0:1782759776.308084:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967430 is committed 00000100:00100000:3.0:1782759776.309871:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212050688:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759776.309940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759776.310026:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050688 00000100:00100000:3.0:1782759776.310033:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050688 00000100:00100000:3.0:1782759776.310079:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1782759776.310088:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212050688:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759776.310654:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212050688:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 566us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759776.310663:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782759776.312206:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212050688:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759776.358234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759776.358727:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349504 00000100:00100000:3.0:1782759776.358737:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349504 00000100:00100000:3.0:1782759776.358936:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:3.0:1782759776.358947:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197349504:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759776.359015:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 11534336, mtime: 0x6a42c15f, atime: 0x0, ctime: 0x6a42c15f, blocks: 0x5809 00010000:00010000:3.0:1782759776.359025:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.359075:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:3.0:1782759776.359080:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759776.359086:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.359101:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759776.423243:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967431 is committed 00002000:00010000:2.0:1782759776.423422:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:2.0:1782759776.423427:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 22537 -> 24585 00010000:00010000:2.0:1782759776.423441:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.423454:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.423463:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.423470:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759776.423475:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.423484:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.423522:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.423530:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d64d12f/0xdd99f5c4777e0af5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759776.423620:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197349504:12345-192.168.204.31@tcp:4:dd.0 Request processed in 64671us (65461us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1782759776.423630:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 94 00000100:00100000:0.0:1782759776.424448:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759776.424465:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212050816:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759776.424516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759776.424577:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050816 00000100:00100000:0.0:1782759776.424597:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050816 00000100:00100000:0.0:1782759776.424638:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1782759776.424646:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212050816:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759776.425667:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212050816:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1019us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759776.425676:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1782759776.426376:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212050816:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759776.442198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759776.442328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759776.442369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759776.442431:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349888 00000100:00100000:1.0:1782759776.442442:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349888 00000100:00100000:1.0:1782759776.442522:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2215 00000100:00100000:1.0:1782759776.442533:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197349888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782759776.442582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759776.442609:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197349888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.442617:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2215 00000100:00100000:0.0:1782759776.442706:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349760 00000100:00100000:0.0:1782759776.442711:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349760 00000100:00100000:0.0:1782759776.442753:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2768 00000100:00100000:0.0:1782759776.442761:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197349760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759776.442805:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197349760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759776.442811:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2768 00000100:00100000:3.0:1782759776.446644:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197349632 00000100:00100000:3.0:1782759776.446658:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197349632 00000100:00100000:0.0:1782759776.447168:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3014 00000100:00100000:0.0:1782759776.447180:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197349632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759776.447268:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197349632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 88us (5080us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759776.447275:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3014 00000100:00100000:2.0:1782759776.456541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759776.456634:0:55099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197350016 00000100:00100000:0.0:1782759776.456645:0:55099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197350016 00000100:00100000:0.0:1782759776.456745:0:55099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 95 00000100:00100000:0.0:1782759776.456757:0:55099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197350016:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759776.456815:0:55099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 12582912, mtime: 0x6a42c15f, atime: 0x0, ctime: 0x6a42c15f, blocks: 0x6009 00010000:00010000:0.0:1782759776.456858:0:55099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.456877:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:0.0:1782759776.456882:0:55099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759776.456887:0:55099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.456902:0:55099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759776.534755:0:55099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:3.0:1782759776.534765:0:55099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 24585 -> 26633 00010000:00010000:3.0:1782759776.534782:0:55099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.534796:0:55099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.534806:0:55099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.534813:0:55099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759776.534818:0:55099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.534861:0:55099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.534897:0:55099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.534905:0:55099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009017d43a/0xdd99f5c4777e0afc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759776.535014:0:55099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+10:2361:x1869355197350016:12345-192.168.204.31@tcp:4:dd.0 Request processed in 78254us (78477us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1782759776.535025:0:55099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 95 00000001:00080000:0.0:1782759776.535268:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967432 is committed 00000100:00100000:3.0:1782759776.535635:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759776.535653:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212050944:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759776.535709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759776.535769:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212050944 00000100:00100000:3.0:1782759776.535776:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212050944 00000100:00100000:3.0:1782759776.535814:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782759776.536475:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212050944:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759776.536932:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212050944:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1108us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759776.536942:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782759776.541202:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212050944:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759776.559600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759776.559683:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197350144 00000100:00100000:0.0:1782759776.559705:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197350144 00000100:00100000:0.0:1782759776.559782:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:0.0:1782759776.559792:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197350144:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:0.0:1782759776.559869:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 13631488, mtime: 0x6a42c15f, atime: 0x0, ctime: 0x6a42c15f, blocks: 0x6809 00010000:00010000:0.0:1782759776.559879:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.559895:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3844s v=(0 0) 00010000:00010000:0.0:1782759776.559900:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759776.559906:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.559939:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759776.689717:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967433 is committed 00002000:00010000:0.0:1782759776.690518:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1782759776.690526:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 26633 -> 28681 00010000:00010000:0.0:1782759776.690544:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.690567:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.690576:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.690584:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759776.690589:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.690599:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.690621:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.690629:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d98fd512/0xdd99f5c4777e0b03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759776.690747:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197350144:12345-192.168.204.31@tcp:4:dd.0 Request processed in 130952us (131153us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1782759776.690758:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 96 00000100:00100000:2.0:1782759776.693748:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759776.693769:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212051072:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759776.693859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.702232:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051072 00000100:00100000:1.0:1782759776.702248:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051072 00000100:00100000:1.0:1782759776.702318:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1782759776.702328:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212051072:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759776.703358:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212051072:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1027us (9494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.703369:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1782759776.703703:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212051072:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759776.750571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759776.750665:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197350272 00000100:00100000:3.0:1782759776.750675:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197350272 00000100:00100000:3.0:1782759776.750761:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:3.0:1782759776.751310:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197350272:12345-192.168.204.31@tcp:4:dd.0 00002000:00010000:3.0:1782759776.751533:0:6603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 14680064, mtime: 0x6a42c15f, atime: 0x0, ctime: 0x6a42c15f, blocks: 0x7009 00010000:00010000:3.0:1782759776.751545:0:6603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.751562:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3845s v=(0 0) 00010000:00010000:3.0:1782759776.751567:0:6603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759776.751574:0:6603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.751589:0:6603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759776.807309:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968152 is committed 00000001:00080000:2.0:1782759776.848608:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967434 is committed 00000100:00100000:2.0:1782759776.849087:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212051200:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759776.849179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759776.849328:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051200 00000100:00100000:0.0:1782759776.849336:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051200 00000100:00100000:0.0:1782759776.849387:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782759776.849396:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212051200:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759776.850508:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3308:x1869355212051200:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1110us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759776.850518:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00002000:00010000:0.0:1782759776.850546:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:0.0:1782759776.850549:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x37:0x0] updating lvb blocks from disk: 28681 -> 30729 00010000:00010000:0.0:1782759776.850562:0:6603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.850574:0:6603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.850583:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.850590:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759776.850595:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.850617:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.850635:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.850643:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e6d163b/0xdd99f5c4777e0b0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759776.850770:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197350272:12345-192.168.204.31@tcp:4:dd.0 Request processed in 99998us (100206us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1782759776.850778:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 97 00000100:00100000:2.0:1782759776.855012:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212051200:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759776.857617:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759776.857785:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197350528 00000100:00100000:0.0:1782759776.857796:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197350528 00000100:00100000:0.0:1782759776.858254:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 361 00000100:00100000:0.0:1782759776.858269:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc11450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:107849:x1869355197350528:12345-192.168.204.31@tcp:35:dd.0 00000001:00080000:0.0:1782759776.858599:0:121722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968153 00000100:00100000:0.0:1782759776.858860:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc11450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:107849:x1869355197350528:12345-192.168.204.31@tcp:35:dd.0 Request processed in 593us (1251us total) trans 4294968154 rc 0/0 00000100:00100000:0.0:1782759776.858868:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 361 00000020:00080000:0.0:1782759776.858873:0:121722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782759776.872004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759776.872226:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197350656 00000100:00100000:0.0:1782759776.872236:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197350656 00000100:00100000:0.0:1782759776.872350:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1040 00000100:00100000:0.0:1782759776.872363:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197350656:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:0.0:1782759776.872394:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759776.872417:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf671ff expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759776.872445:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 15728640, mtime: 0x6a42c15f, atime: 0x0, ctime: 0x6a42c15f, blocks: 0x7809 00010000:00010000:0.0:1782759776.872472:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=3845s v=(0 0) 00010000:00010000:0.0:1782759776.872477:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759776.872486:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.872505:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.872518:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75c00, rc 0) 00000100:00100000:0.0:1782759776.872587:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2362:x1869355197350656:12345-192.168.204.31@tcp:101:rm.0 Request processed in 227us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759776.872594:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1040 00000100:00100000:3.0:1782759776.883819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759776.884309:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197350912 00000100:00100000:2.0:1782759776.884318:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197350912 00000100:00100000:2.0:1782759776.884377:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2243 00000100:00100000:2.0:1782759776.884387:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:107851:x1869355197350912:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:2.0:1782759776.884443:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759776.884488:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0a8c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671f8 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.884509:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x24:0x0].0x0 (ffff9171908a1000) 00010000:00010000:2.0:1782759776.884520:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759776.884545:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.884558:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.884568:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.884581:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.884588:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.884595:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.885273:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.885283:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.885292:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759776.894713:0:146757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].52, 64 off11664 00000004:00080000:3.0:1782759776.894736:0:146757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3845297912761ns, next at 3846297908343ns, rc = 0 00010000:00010000:3.0:1782759776.894993:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 3/0,1 mode: --/PW res: [0x200000418:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895013:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895024:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895033:0:146757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895040:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895056:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895130:0:146757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759776.895158:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895165:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895171:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895176:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759776.895180:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895187:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895199:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x24:0x0].0x0 (ffff917191f75b00) 00010000:00010000:3.0:1782759776.895202:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759776.895206:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895212:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0b26 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895231:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895247:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895253:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895258:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759776.895261:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895267:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895275:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917191f75a00) 00010000:00010000:3.0:1782759776.895277:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759776.895281:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759776.895287:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b18 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759776.895304:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dd93316 reply state 00000000e324a392 transno 4294968155 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759776.895313:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759776.895447:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:107851:x1869355197350912:12345-192.168.204.31@tcp:36:rm.0 Request processed in 11057us (11634us total) trans 4294968155 rc 0/0 00000100:00100000:3.0:1782759776.895456:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2243 00010000:00010000:0.0:1782759776.896489:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759776.896500:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.896510:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759776.896514:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.896523:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.896550:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x24:0x0].0x0 (ffff917191f75b00) 00010000:00010000:0.0:1782759776.896553:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782759776.896557:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 1/0,0 mode: --/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.896563:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0b2d lrc: 0/0,0 mode: --/PW res: [0x200000418:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759776.896580:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759776.896582:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759776.896584:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759776.905097:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.905116:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.905125:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.905131:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759776.905136:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.905145:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.905164:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff917191f75c00) 00010000:00010000:2.0:1782759776.905167:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759776.905172:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759776.905178:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0b1f lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759777.196922:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759777.196955:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212051328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759777.197053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759777.198508:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051328 00000100:00100000:3.0:1782759777.198521:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051328 00000100:00100000:3.0:1782759777.198622:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1782759777.198630:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212051328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759777.198667:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759777.198741:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212051328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759777.198748:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00080000:2.0:1782759777.198933:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759777.199396:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212051328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759777.264084:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759778.284657:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759779.247742:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212051840:0@lo:400:kworker.0 00000100:00100000:2.0:1782759779.247816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759779.247923:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759779.247940:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212051456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759779.247969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759779.247989:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212051968:0@lo:400:kworker.0 00000100:00100000:2.0:1782759779.248013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759779.248035:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212051584:0@lo:400:kworker.0 00000100:00100000:2.0:1782759779.248056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759779.248070:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212052096:0@lo:400:kworker.0 00000100:00100000:2.0:1782759779.248087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759779.248101:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759779.248226:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212051712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759779.248250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759779.248466:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051968 00000100:00100000:0.0:1782759779.248474:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051968 00000100:00100000:0.0:1782759779.248536:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051584 00000100:00100000:0.0:1782759779.248540:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051584 00000100:00100000:0.0:1782759779.248555:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051712 00000100:00100000:0.0:1782759779.248557:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051712 00000100:00100000:0.0:1782759779.248576:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1782759779.248585:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212051968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759779.248642:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3305:x1869355212051968:12345-0@lo:400:kworker.0 Request processed in 58us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759779.248649:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1782759779.248665:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1782759779.248671:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212051584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759779.248702:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212051584:12345-0@lo:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759779.248708:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1782759779.248729:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:0.0:1782759779.248735:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212051712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759779.248753:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051840 00000100:00100000:1.0:1782759779.248758:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051840 00000100:00100000:0.0:1782759779.248763:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212051712:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759779.248769:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00080000:0.0:1782759779.248783:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759779.248784:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052096 00000100:00100000:1.0:1782759779.248786:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052096 00000100:00080000:0.0:1782759779.248787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759779.248810:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:1.0:1782759779.248816:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212051840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759779.248817:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212051968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759779.248869:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212051840:12345-0@lo:400:kworker.0 Request processed in 54us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759779.248873:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212051840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759779.248876:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:1.0:1782759779.248891:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:0.0:1782759779.248892:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212051712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759779.248897:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212052096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759779.248901:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212051584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759779.248974:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212051456 00000100:00100000:0.0:1782759779.248978:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212051456 00000100:00100000:0.0:1782759779.249004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:0.0:1782759779.249010:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212051456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759779.249048:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212051456:12345-0@lo:400:kworker.0 Request processed in 38us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759779.249054:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:0.0:1782759779.249089:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212051456:0@lo:400:kworker.0 00000100:00080000:0.0:1782759779.250242:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759779.251684:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212052096:12345-0@lo:400:kworker.0 Request processed in 2779us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759779.251698:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:0.0:1782759779.253261:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212052096:0@lo:400:kworker.0 00010000:00010000:0.0:1782759779.308609:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782759779.465582:0:157639:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3847868755566ns, next at 3817909631673ns, rc = 0 00000004:00080000:3.0:1782759779.465698:0:157639:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3847868874153ns, next at 3846297908343ns, rc = 0 00000001:00080000:2.0:1782759779.518281:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968154 is committed 00000004:00080000:2.0:1782759779.518326:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 129 committed 00000004:00080000:2.0:1782759779.518343:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 131 committed 00000001:00080000:2.0:1782759779.518356:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968155 is committed 00000004:00080000:2.0:1782759779.518359:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 128 committed 00000100:00100000:3.0:1782759779.518744:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759779.518768:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212052224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782759779.518961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759779.519068:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052224 00000100:00100000:3.0:1782759779.519077:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052224 00000100:00100000:3.0:1782759779.519130:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1782759779.519139:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212052224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782759779.519175:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:55 count 1 00010000:00010000:3.0:1782759779.519206:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.519232:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.519253:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782759779.519259:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759779.519264:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.519315:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.519330:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 8 pid: 6598 timeout: 3947 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759779.519344:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355212052352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759779.519408:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181a900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759779.522668:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1869355212052352:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759779.522711:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759779.528160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759779.528391:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351040 00000100:00100000:1.0:1782759779.528404:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351040 00010000:00010000:1.0:1782759779.528515:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 9 pid: 6598 timeout: 3947 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759779.528690:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 705 00000100:00100000:1.0:1782759779.528704:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2362:x1869355197351040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759779.528725:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759779.528731:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 9 pid: 6598 timeout: 3947 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759779.528748:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 9 pid: 6598 timeout: 3947 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759779.528804:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fbaf2bc/0xdd99f5c4777e0b11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf671ff expref: 9 pid: 6598 timeout: 3947 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759779.528881:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759779.528887:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759779.528894:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759779.528905:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759779.528948:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759779.529029:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197351040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 327us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759779.529037:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 705 00010000:00010000:3.0:1782759779.529137:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.529148:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.529161:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.529170:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.529205:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1782759779.529412:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759779.530183:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212052224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11041us (11219us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1782759779.530195:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00010000:00010000:3.0:1782759779.530225:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759779.530232:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.530243:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759779.530248:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.530260:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.530277:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759779.530285:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009208f27d/0xdd99f5c4777e0b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759779.530304:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917081ad4e00/2, rc 0, transno 4294967435 00010000:00010000:3.0:1782759779.530308:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759779.530310:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759779.530312:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759779.530326:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212052224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782759779.756417:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759779.756486:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212052480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759779.756618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759779.756945:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052480 00000100:00100000:3.0:1782759779.756964:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052480 00000100:00100000:3.0:1782759779.757035:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1782759779.757048:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212052480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759779.757104:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3843031040 avail 3840933888 00000100:00100000:3.0:1782759779.757174:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212052480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759779.757183:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1782759779.757260:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212052480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759780.337310:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759781.356165:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759781.560292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759781.560332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759781.560373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759781.560410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759781.560489:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351168 00000100:00100000:3.0:1782759781.560506:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351168 00000100:00100000:3.0:1782759781.560581:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3016 00000100:00100000:1.0:1782759781.560592:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351552 00000100:00100000:1.0:1782759781.560603:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351552 00000100:00100000:3.0:1782759781.560610:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197351168:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759781.560661:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351424 00000100:00100000:1.0:1782759781.560665:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351424 00000100:00100000:1.0:1782759781.560698:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2218 00000100:00100000:3.0:1782759781.560707:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197351168:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759781.560712:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197351552:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759781.560726:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3016 00000100:00100000:3.0:1782759781.560798:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2219 00000100:00100000:3.0:1782759781.560810:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197351424:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759781.560871:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351296 00000100:00100000:0.0:1782759781.560877:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351296 00000100:00100000:0.0:1782759781.560934:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2772 00000100:00100000:0.0:1782759781.560943:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197351296:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:2.0:1782759781.561027:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759781.561033:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759781.561035:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759781.563659:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197351552:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2936us (3309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759781.563678:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2218 00000100:00100000:3.0:1782759781.566232:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197351424:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5333us (5728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.566249:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2219 00000100:00100000:0.0:1782759781.567950:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197351296:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 6990us (7654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759781.567970:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2772 00000001:00080000:0.0:1782759781.927070:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967435 is committed 00000100:00100000:0.0:1782759781.927784:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212052608:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759781.928067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.928399:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052608 00000100:00100000:3.0:1782759781.928409:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052608 00000100:00100000:3.0:1782759781.928566:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1782759781.928577:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212052608:12345-0@lo:601:lquota_wb_lustr.0 00000100:00080000:0.0:1782759781.928926:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759781.932619:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212052736:0@lo:106: 00000100:00100000:0.0:1782759781.932671:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759781.932998:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052736 00000100:00100000:2.0:1782759781.933009:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052736 00000100:00100000:2.0:1782759781.933080:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1782759781.933092:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212052736:12345-0@lo:106: 00010000:00010000:2.0:1782759781.933108:0:5783:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759781.933123:0:5783:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:2.0:1782759781.933182:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:5826:x1869355212052736:12345-0@lo:106: Request processed in 92us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759781.933191:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1782759781.933316:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3306:x1869355212052608:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 4738us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.933343:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1782759781.933446:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708182c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759781.933508:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212052736:0@lo:106: 00010000:00010000:3.0:1782759781.936417:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759781.936511:0:7506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759781.936520:0:7506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1782759781.936528:0:7506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:0.0:1782759781.936635:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212052608:0@lo:601:lquota_wb_lustr.0 00010000:00010000:3.0:1782759781.936719:0:7506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759781.937021:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759781.937045:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759781.937054:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc1e39e50) 00040000:00010000:1.0:1782759781.937058:0:7496:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1782759781.937068:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00040000:00010000:1.0:1782759781.937076:0:7496:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759781.937354:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759781.937363:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759781.937492:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212052864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759781.937584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759781.937655:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759781.937673:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171b7dcc600/0xdd99f5c4777e0aa1 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd99f5c4777e0aa8 expref: -99 pid: 55099 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1782759781.937708:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759781.937711:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759781.937713:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759781.938138:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052864 00000100:00100000:3.0:1782759781.938149:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052864 00000100:00100000:3.0:1782759781.938390:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782759781.938403:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3307:x1869355212052864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759781.938424:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759781.938459:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0aa8 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd99f5c4777e0aa1 expref: 7 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.938499:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759781.938603:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212052864:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.938611:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782759781.939135:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212052864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759782.319993:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212052992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759782.320108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759782.320286:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212052992 00000100:00100000:3.0:1782759782.320298:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212052992 00000100:00080000:0.0:1782759782.320359:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759782.320568:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1782759782.320580:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212052992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759782.320632:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759782.320698:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212052992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759782.320707:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1782759782.320758:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212052992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759782.380105:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759783.405998:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759784.368031:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212053120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759784.368225:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212053248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759784.368265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759784.368289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759784.369499:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212053376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.369611:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212053504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.369644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759784.370426:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053504 00000100:00100000:0.0:1782759784.370437:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053504 00000100:00100000:0.0:1782759784.370718:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:0.0:1782759784.370730:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212053504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.370794:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212053504:12345-0@lo:400:kworker.0 Request processed in 66us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759784.370801:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1782759784.371555:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212053760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759784.371621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759784.371652:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759784.371660:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212053632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759784.371690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759784.371755:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053248 00000100:00100000:3.0:1782759784.371763:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053248 00000100:00100000:3.0:1782759784.371809:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053632 00000100:00100000:3.0:1782759784.371812:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053632 00000100:00100000:3.0:1782759784.371869:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:3.0:1782759784.371878:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212053248:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759784.371925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759784.371935:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759784.371945:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212053248:12345-0@lo:400:kworker.0 Request processed in 65us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759784.371954:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1782759784.371971:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1782759784.371991:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212053632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759784.372034:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212053248:0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.372078:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212053632:12345-0@lo:400:kworker.0 Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759784.372084:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212053632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.372100:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1782759784.372154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759784.372292:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212053504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.372393:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053120 00000100:00100000:0.0:1782759784.372402:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053120 00000100:00100000:3.0:1782759784.372504:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053760 00000100:00100000:3.0:1782759784.372510:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053760 00000100:00100000:3.0:1782759784.372550:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:3.0:1782759784.372558:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212053760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759784.372608:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212053760:12345-0@lo:400:kworker.0 Request processed in 51us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759784.372616:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:3.0:1782759784.372642:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967435 gen 2 00000004:00080000:3.0:1782759784.372648:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917081ad4e00, transno 4294967435 00000100:00100000:3.0:1782759784.372660:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212053760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.373559:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1782759784.373572:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212053120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759784.373638:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212053120:12345-0@lo:400:kworker.0 Request processed in 70us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759784.373646:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00080000:0.0:1782759784.373682:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759784.375340:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053376 00000100:00100000:2.0:1782759784.375359:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053376 00000100:00100000:2.0:1782759784.375457:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:2.0:1782759784.375468:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212053376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759784.375493:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759784.375596:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212053376:12345-0@lo:400:kworker.0 Request processed in 130us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759784.375604:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1782759784.375636:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212053376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759784.379067:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212053120:0@lo:400:kworker.0 00010000:00010000:2.0:1782759784.429455:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759784.876899:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212053888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759784.876986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759784.877071:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212053888 00000100:00100000:0.0:1782759784.877079:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212053888 00000100:00100000:0.0:1782759784.877121:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1782759784.877128:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212053888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759784.877164:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759784.877210:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212053888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759784.877217:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1782759784.877282:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212053888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759785.452378:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759786.476435:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759786.678019:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759786.678073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759786.678183:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351680 00000100:00100000:2.0:1782759786.678196:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351680 00000100:00100000:3.0:1782759786.678327:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351808 00000100:00100000:3.0:1782759786.678331:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351808 00000100:00100000:3.0:1782759786.678392:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2776 00000100:00100000:3.0:1782759786.678402:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197351808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759786.678478:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197351808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759786.678486:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2776 00000100:00100000:2.0:1782759786.679196:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3018 00000100:00100000:2.0:1782759786.679209:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197351680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759786.679242:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197351680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.679248:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3018 00000100:00100000:3.0:1782759786.679563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759786.679932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759786.679997:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197351936 00000100:00100000:3.0:1782759786.680004:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197351936 00000100:00100000:3.0:1782759786.680045:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352064 00000100:00100000:3.0:1782759786.680049:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352064 00000100:00100000:3.0:1782759786.680074:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2222 00000100:00100000:3.0:1782759786.680082:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197351936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:1.0:1782759786.680189:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759786.680194:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759786.680197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759786.680226:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2223 00000100:00100000:1.0:1782759786.680237:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197352064:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759786.680310:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197352064:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759786.680317:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2223 00000100:00100000:3.0:1782759786.681174:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197351936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 1090us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759786.681189:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2222 00000100:00100000:1.0:1782759787.437380:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759787.437451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759787.437590:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054016 00000100:00100000:3.0:1782759787.437598:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054016 00000100:00100000:3.0:1782759787.437655:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1782759787.437664:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759787.437697:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759787.437756:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759787.437764:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00080000:1.0:1782759787.437837:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759787.437933:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212054016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759787.500029:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759788.524367:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759789.484576:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212054272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.484649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759789.484717:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212054784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.484753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759789.484801:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782759789.484808:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212054144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.484866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759789.484886:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212054656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.484921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759789.484953:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054784 00000100:00100000:2.0:1782759789.484960:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054784 00000100:00100000:2.0:1782759789.485009:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:2.0:1782759789.485016:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212054784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.485070:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212054784:12345-0@lo:400:kworker.0 Request processed in 54us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759789.485077:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00100000:2.0:1782759789.485105:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212054528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.485131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759789.485148:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759789.485153:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212054400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759789.485175:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759789.485211:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212054784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759789.485449:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054528 00000100:00100000:1.0:1782759789.485454:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054528 00000100:00100000:1.0:1782759789.485490:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:1.0:1782759789.485498:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759789.485542:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212054528:12345-0@lo:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759789.485548:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00080000:1.0:1782759789.485569:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759789.485572:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759789.485586:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212054528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.485751:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054144 00000100:00100000:0.0:1782759789.485756:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054144 00000100:00100000:0.0:1782759789.485788:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:0.0:1782759789.485802:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212054144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.485863:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212054144:12345-0@lo:400:kworker.0 Request processed in 69us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759789.485869:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:0.0:1782759789.485900:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054272 00000100:00100000:0.0:1782759789.485915:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054272 00000100:00100000:0.0:1782759789.485938:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054656 00000100:00100000:0.0:1782759789.485940:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054656 00000100:00100000:0.0:1782759789.485960:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054400 00000100:00100000:0.0:1782759789.485962:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054400 00000100:00100000:0.0:1782759789.485988:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:0.0:1782759789.485993:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212054272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.486023:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212054272:12345-0@lo:400:kworker.0 Request processed in 29us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759789.486029:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:0.0:1782759789.486040:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1782759789.486045:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212054656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.486070:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212054656:12345-0@lo:400:kworker.0 Request processed in 26us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759789.486076:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1782759789.486087:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:0.0:1782759789.486093:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212054400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.486120:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212054400:12345-0@lo:400:kworker.0 Request processed in 28us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759789.486126:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00080000:0.0:1782759789.486140:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759789.486160:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212054144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.486170:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212054656:0@lo:400:kworker.0 00000100:00100000:0.0:1782759789.486179:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212054272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759789.486496:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212054400:0@lo:400:kworker.0 00010000:00010000:0.0:1782759789.548188:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759789.996162:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759789.996185:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212054912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759789.996266:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759789.996929:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212054912 00000100:00100000:1.0:1782759789.996938:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212054912 00000100:00100000:1.0:1782759789.996991:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1782759789.997000:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212054912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759789.997032:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759789.997150:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212054912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759789.997158:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1782759789.997222:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212054912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759790.572330:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759791.601082:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759791.802036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759791.802090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759791.802130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759791.802234:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352192 00000100:00100000:2.0:1782759791.802243:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352192 00000100:00100000:2.0:1782759791.802307:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3020 00000100:00100000:2.0:1782759791.802318:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197352192:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759791.802406:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197352192:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.802414:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3020 00000100:00100000:3.0:1782759791.802632:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352576 00000100:00100000:3.0:1782759791.802637:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352576 00000100:00080000:1.0:1782759791.802759:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759791.802880:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2226 00000100:00100000:3.0:1782759791.802889:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197352576:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759791.802936:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197352576:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 48us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759791.802943:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2226 00000100:00100000:0.0:1782759791.803100:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352320 00000100:00100000:0.0:1782759791.803105:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352320 00000100:00100000:0.0:1782759791.803145:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2780 00000100:00100000:0.0:1782759791.803152:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197352320:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759791.803192:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197352320:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759791.803198:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2780 00000100:00080000:1.0:1782759791.803266:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759791.805513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759791.805591:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352448 00000100:00100000:1.0:1782759791.805598:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352448 00000100:00100000:1.0:1782759791.805656:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2227 00000100:00100000:1.0:1782759791.805665:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197352448:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759791.805743:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197352448:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759791.805751:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2227 00000100:00080000:0.0:1782759791.806372:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759792.556195:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759792.556223:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212055040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759792.556310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759792.556775:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055040 00000100:00100000:2.0:1782759792.556786:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055040 00000100:00100000:2.0:1782759792.556882:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1782759792.556894:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212055040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759792.556936:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759792.557011:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212055040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759792.557018:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1782759792.557073:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212055040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759792.557174:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759792.620117:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759793.644716:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759794.604024:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212055168:0@lo:400:kworker.0 00000100:00100000:1.0:1782759794.604096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759794.604214:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055168 00000100:00100000:0.0:1782759794.604222:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055168 00000100:00100000:0.0:1782759794.604265:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:0.0:1782759794.604273:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212055168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759794.604381:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212055168:12345-0@lo:400:kworker.0 Request processed in 108us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759794.604388:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:2.0:1782759794.604426:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212055296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759794.604474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759794.604597:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055296 00000100:00100000:0.0:1782759794.604602:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055296 00000100:00100000:0.0:1782759794.604645:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:0.0:1782759794.604652:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212055296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759794.604687:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212055296:12345-0@lo:400:kworker.0 Request processed in 35us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759794.604693:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1782759794.604937:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212055296:0@lo:400:kworker.0 00000100:00100000:1.0:1782759794.605016:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212055168:0@lo:400:kworker.0 00000100:00100000:1.0:1782759794.605220:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212055424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759794.605248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759794.605355:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212055808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759794.605385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759794.605405:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759794.605409:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212055680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759794.605438:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055808 00000100:00100000:3.0:1782759794.605441:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055808 00000100:00100000:3.0:1782759794.605485:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:3.0:1782759794.605492:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212055808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759794.605527:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212055808:12345-0@lo:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759794.605549:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00100000:1.0:1782759794.605615:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759794.605622:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212055552:0@lo:400:kworker.0 00000100:00080000:0.0:1782759794.605653:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759794.605658:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759794.605694:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055552 00000100:00100000:1.0:1782759794.605698:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055552 00000100:00100000:1.0:1782759794.605730:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:1.0:1782759794.605742:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212055552:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759794.605752:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759794.605778:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212055552:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759794.605786:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00100000:0.0:1782759794.605797:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212055552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759794.606058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759794.608230:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212055808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759794.608799:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055424 00000100:00100000:2.0:1782759794.608805:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055424 00000100:00100000:2.0:1782759794.609211:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055680 00000100:00100000:2.0:1782759794.609216:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055680 00000100:00100000:2.0:1782759794.609246:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1782759794.609254:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212055424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759794.609328:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212055424:12345-0@lo:400:kworker.0 Request processed in 75us (4079us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759794.609336:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1782759794.609352:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:2.0:1782759794.609371:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212055680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759794.609406:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212055680:12345-0@lo:400:kworker.0 Request processed in 36us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759794.609412:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:2.0:1782759794.609449:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212055680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759794.609478:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212055424:0@lo:400:kworker.0 00000100:00080000:0.0:1782759794.610541:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759794.670673:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759795.117176:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759795.117252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759795.117398:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212055936 00000100:00100000:0.0:1782759795.117406:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212055936 00000100:00100000:0.0:1782759795.117456:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1782759795.117466:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212055936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759795.117500:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759795.117558:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212055936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759795.117575:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1782759795.118349:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212055936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759795.692168:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759796.716013:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759796.918026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759796.918071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759796.918109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759796.918136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759796.918161:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352832 00000100:00100000:0.0:1782759796.918170:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352832 00000100:00100000:0.0:1782759796.918226:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2784 00000100:00100000:0.0:1782759796.918236:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197352832:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759796.918313:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197352832:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759796.918321:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2784 00000100:00100000:0.0:1782759796.918343:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352960 00000100:00100000:0.0:1782759796.918346:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352960 00000100:00100000:0.0:1782759796.918370:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353088 00000100:00100000:0.0:1782759796.918373:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353088 00000100:00100000:0.0:1782759796.918394:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2230 00000100:00100000:0.0:1782759796.918400:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197352960:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759796.918425:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197352960:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759796.918440:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2230 00000100:00100000:0.0:1782759796.918451:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2231 00000100:00100000:0.0:1782759796.918457:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197353088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759796.918481:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197353088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759796.918486:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2231 00000100:00080000:0.0:1782759796.918502:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759796.918505:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759796.918508:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759796.918627:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197352704 00000100:00100000:2.0:1782759796.918631:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197352704 00000100:00100000:2.0:1782759796.918662:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3022 00000100:00100000:2.0:1782759796.918669:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197352704:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759796.918691:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197352704:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759796.918698:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3022 00000100:00100000:0.0:1782759797.676231:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212056064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759797.676299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759797.676353:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056064 00000100:00100000:2.0:1782759797.676362:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056064 00000100:00100000:2.0:1782759797.676417:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1782759797.676426:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212056064:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759797.676439:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1782759797.676463:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759797.676519:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212056064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759797.676600:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212056064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759797.686549:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00010000:00010000:0.0:1782759797.740200:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759798.765425:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759799.726104:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759799.726128:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212056448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.726207:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212056320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.726275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759799.726325:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759799.726331:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212056192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.726361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759799.726405:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056320 00000100:00100000:1.0:1782759799.726413:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056320 00000100:00100000:1.0:1782759799.726453:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:1.0:1782759799.726461:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212056320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.726523:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212056320:12345-0@lo:400:kworker.0 Request processed in 62us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759799.726802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759799.727091:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00100000:1.0:1782759799.727114:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056448 00000100:00100000:1.0:1782759799.727118:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056448 00000100:00100000:1.0:1782759799.727157:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:1.0:1782759799.727163:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212056448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727203:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212056448:12345-0@lo:400:kworker.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759799.727209:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:1.0:1782759799.727227:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056192 00000100:00100000:1.0:1782759799.727231:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056192 00000100:00100000:1.0:1782759799.727267:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023 00000100:00100000:1.0:1782759799.727274:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212056192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727320:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212056192:12345-0@lo:400:kworker.0 Request processed in 47us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759799.727327:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023 00000100:00100000:1.0:1782759799.727378:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212056448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727449:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759799.727457:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212056576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759799.727625:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056576 00000100:00100000:1.0:1782759799.727630:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056576 00000100:00100000:1.0:1782759799.727659:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:1.0:1782759799.727665:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212056576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727702:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212056576:12345-0@lo:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759799.727708:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00100000:1.0:1782759799.727752:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212056576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727774:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212056832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.727796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759799.727819:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212056192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759799.727980:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212056704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759799.728010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759799.728048:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056704 00000100:00100000:3.0:1782759799.728052:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056704 00000100:00100000:3.0:1782759799.728077:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:3.0:1782759799.728083:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212056704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759799.728177:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212056704:12345-0@lo:400:kworker.0 Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759799.728184:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1782759799.728205:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212056320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759799.728219:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212056704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.728230:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056832 00000100:00100000:1.0:1782759799.728234:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056832 00000100:00100000:1.0:1782759799.728328:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:1.0:1782759799.728335:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212056832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759799.728373:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212056832:12345-0@lo:400:kworker.0 Request processed in 39us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759799.728388:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:1.0:1782759799.728415:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212056832:0@lo:400:kworker.0 00000100:00080000:0.0:1782759799.728615:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759799.728619:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759799.728621:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759799.792581:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759799.950476:0:158010:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc754fe790 20000000:00000080:3.0:1782759799.950494:0:158010:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc3400 uarg=0000000000000000 00010000:00010000:3.0:1782759799.951500:0:158010:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759799.951518:0:158010:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759799.951544:0:158010:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759799.951562:0:158010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.951580:0:158010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.951589:0:158010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.951634:0:158010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.951648:0:158010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 18 pid: 5796 timeout: 3968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759799.951661:0:158010:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158010:1869355212056960:0@lo:104: 00000100:00100000:3.0:1782759799.951720:0:158010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759799.951774:0:158010:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759799.954130:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212056960 00000100:00100000:0.0:1782759799.954143:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212056960 00000100:00100000:0.0:1782759799.954213:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1782759799.954223:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:158010:x1869355212056960:12345-0@lo:104: 00010000:00010000:0.0:1782759799.954240:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759799.954501:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759799.954508:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:158010:x1869355212056960:12345-0@lo:104: Request processed in 287us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759799.954516:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00010000:00010000:2.0:1782759799.954749:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759799.954756:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759799.954764:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759799.954768:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759799.954776:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759799.954784:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759799.954790:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759799.954842:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759799.954857:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759799.954883:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759799.954890:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0a69 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759799.954906:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759799.954908:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759799.954910:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759799.955029:0:158010:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158010:1869355212056960:0@lo:104: 00010000:00010000:3.0:1782759799.955049:0:158010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759799.955891:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212057088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759799.955941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759799.955994:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057088 00000100:00100000:3.0:1782759799.955999:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057088 00010000:00010000:3.0:1782759799.956020:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 19 pid: 5796 timeout: 3968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759799.956046:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782759799.956053:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718853e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212057088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759799.956064:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759799.956069:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 19 pid: 5796 timeout: 3968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956079:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 19 pid: 5796 timeout: 3968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956103:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e0a70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0a69 expref: 19 pid: 5796 timeout: 3968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956117:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956125:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956139:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956147:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956153:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956159:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956164:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759799.956168:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956176:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956189:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956223:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759799.956364:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718853e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212057088:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759799.956371:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782759799.956427:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212057088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759799.956446:0:158010:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956453:0:158010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759799.956460:0:158010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc800/0xdd99f5c4777e0b3b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759800.244699:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212057216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759800.244778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759800.246933:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057216 00000100:00100000:0.0:1782759800.246944:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057216 00000100:00100000:0.0:1782759800.246998:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1782759800.247010:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212057216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759800.247047:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759800.247122:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212057216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759800.247129:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1782759800.251738:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212057216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759800.813688:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759801.840904:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759801.968915:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759801.968924:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759801.968929:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759801.968972:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759801.968983:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759801.968995:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759801.969021:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212057344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759801.969320:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759801.969375:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759801.970365:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057344 00000100:00100000:2.0:1782759801.970374:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057344 00000100:00100000:2.0:1782759801.970425:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024 00000100:00100000:2.0:1782759801.970434:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212057344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759801.970451:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759801.970466:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0b42 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759801.970504:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759801.970517:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759801.970527:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759801.970582:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212057344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759801.970589:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024 00000100:00100000:2.0:1782759801.970646:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212057344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759801.970662:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759801.970671:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759801.970691:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759801.970696:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759801.970711:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759802.036269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759802.036314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759802.036350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759802.036379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759802.036408:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353216 00000100:00100000:3.0:1782759802.036418:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353216 00000100:00100000:3.0:1782759802.036467:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3025 00000100:00100000:3.0:1782759802.036478:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197353216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759802.036558:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197353216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759802.036566:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3025 00000100:00100000:3.0:1782759802.036603:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353600 00000100:00100000:3.0:1782759802.036607:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353600 00000100:00100000:3.0:1782759802.036639:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353472 00000100:00100000:3.0:1782759802.036642:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353472 00000100:00100000:3.0:1782759802.036664:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2234 00000100:00100000:3.0:1782759802.036671:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197353600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759802.036699:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197353600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759802.036705:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2234 00000100:00100000:3.0:1782759802.036716:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2235 00000100:00100000:3.0:1782759802.036722:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197353472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759802.036744:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197353472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759802.036768:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2235 00000100:00080000:0.0:1782759802.037217:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759802.037221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759802.037886:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353344 00000100:00100000:2.0:1782759802.037894:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353344 00000100:00100000:2.0:1782759802.037939:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2788 00000100:00100000:2.0:1782759802.037947:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197353344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759802.037999:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197353344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759802.038006:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2788 00000100:00080000:0.0:1782759802.039529:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759802.796396:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212057472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759802.796482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759802.798558:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057472 00000100:00100000:1.0:1782759802.798571:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057472 00000100:00100000:1.0:1782759802.798645:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1782759802.798655:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212057472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759802.798695:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759802.800278:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212057472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1514us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759802.800293:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00080000:1.0:1782759802.800327:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759802.801100:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212057472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759802.861706:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759803.341712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759803.341874:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353728 00000100:00100000:1.0:1782759803.341884:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353728 00000100:00100000:1.0:1782759803.341938:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2244 00000100:00100000:1.0:1782759803.341949:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108247:x1869355197353728:12345-192.168.204.31@tcp:101:ls.0 00010000:00010000:1.0:1782759803.341972:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759803.342053:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e0b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67206 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.342121:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e0b57 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.342135:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e0b57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.342146:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e0b57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759803.342430:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 7680 00000004:00200000:1.0:1782759803.342435:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759803.342531:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e0b57 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.342560:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e0b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67206 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.342582:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e0b57 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67206 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.342591:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759803.342594:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759803.342598:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031400, rc 0) 00000100:00100000:1.0:1782759803.342652:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:108247:x1869355197353728:12345-192.168.204.31@tcp:101:ls.0 Request processed in 705us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759803.342660:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2244 00000100:00100000:0.0:1782759803.414973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759803.415214:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197353984 00000100:00100000:3.0:1782759803.415224:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197353984 00000100:00100000:3.0:1782759803.415285:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2245 00000100:00100000:3.0:1782759803.415295:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:108249:x1869355197353984:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759803.415315:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759803.415318:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782759803.415343:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e0b57 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67206 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.415373:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:3.0:1782759803.415383:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759803.415399:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0b5e lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6720d expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.416305:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.416321:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.416331:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.417454:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.417546:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759803.417558:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759803.426758:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 7680 00010000:00010000:2.0:1782759803.426810:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430177:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430195:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430202:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcce00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759803.430207:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430216:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430235:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1000) 00010000:00010000:2.0:1782759803.430254:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759803.430260:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430267:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0b65 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430288:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430294:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430300:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430306:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759803.430309:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430316:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430323:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1200) 00010000:00010000:2.0:1782759803.430325:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759803.430328:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430333:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0b6c lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430401:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0b5e lrc: 1/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6720d expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430419:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1000) 00010000:00010000:2.0:1782759803.430421:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759803.430426:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0b5e lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6720d expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.430441:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:2.0:1782759803.432524:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108249:x1869355197353984:12345-192.168.204.31@tcp:101:dd.0 Request processed in 17219us (17551us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759803.432536:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2245 00000100:00100000:0.0:1782759803.476315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759803.476580:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354112 00000100:00100000:2.0:1782759803.476590:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354112 00000100:00100000:2.0:1782759803.476650:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2246 00000100:00100000:2.0:1782759803.476661:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108252:x1869355197354112:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:2.0:1782759803.476684:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759803.476708:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b73 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67214 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.476792:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.476806:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759803.477179:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477269:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477279:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477287:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477580:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477595:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477603:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477609:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759803.477614:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477621:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477635:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782759803.477638:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759803.477643:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477649:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0b7a lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477664:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477670:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477675:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477680:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759803.477690:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477696:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477705:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff917182dd1700) 00010000:00010000:0.0:1782759803.477707:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759803.477710:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477716:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0b81 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477750:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b73 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67214 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477773:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782759803.477783:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759803.477787:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0b73 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67214 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759803.477800:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:0.0:1782759803.478260:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108252:x1869355197354112:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1599us (1953us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759803.478270:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2246 00000100:00100000:3.0:1782759803.493633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759803.493711:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354240 00000100:00100000:1.0:1782759803.493725:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354240 00000100:00100000:1.0:1782759803.493803:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2247 00000100:00100000:1.0:1782759803.493852:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108252:x1869355197354240:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759803.493874:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759803.493902:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e0b88 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6721b expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494160:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494195:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494207:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494233:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494240:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494247:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494549:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494558:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494564:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494570:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759803.494575:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494582:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494594:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:1.0:1782759803.494602:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759803.494608:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494614:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0b8f lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494627:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494633:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494639:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494644:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759803.494647:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494652:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494660:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171889c5400) 00010000:00010000:1.0:1782759803.494662:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759803.494665:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494670:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0b96 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494703:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e0b88 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6721b expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494720:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:1.0:1782759803.494722:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759803.494726:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e0b88 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6721b expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759803.494738:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759803.495588:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108252:x1869355197354240:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1763us (1960us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759803.495599:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2247 00010000:00010000:3.0:1782759803.885009:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759804.844306:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212057728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.844379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759804.844424:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212057984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.844448:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212058240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759804.844471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759804.844488:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212057856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759804.844505:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759804.844510:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212057600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.844511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759804.844536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759804.844556:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057984 00000100:00100000:3.0:1782759804.844558:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212058112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.844575:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057984 00000100:00100000:3.0:1782759804.844580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759804.844603:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057600 00000100:00100000:3.0:1782759804.844606:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057600 00000100:00100000:0.0:1782759804.844623:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:3.0:1782759804.844627:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:3.0:1782759804.844632:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212057600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.844632:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212057984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759804.844769:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057728 00000100:00100000:2.0:1782759804.844779:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057728 00000100:00100000:2.0:1782759804.844809:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212057856 00000100:00100000:2.0:1782759804.844811:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212057856 00000100:00100000:2.0:1782759804.844848:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058112 00000100:00100000:2.0:1782759804.844851:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058112 00000100:00100000:2.0:1782759804.844870:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:2.0:1782759804.844877:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212057728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759804.844912:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212057728:12345-0@lo:400:kworker.0 Request processed in 35us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759804.844918:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:2.0:1782759804.844934:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:2.0:1782759804.844940:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212057856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759804.844969:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212057856:12345-0@lo:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759804.844975:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:2.0:1782759804.844986:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:2.0:1782759804.844991:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212058112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.845059:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212057984:12345-0@lo:400:kworker.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759804.845066:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1782759804.845113:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212057856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.845136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759804.845162:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212057728:0@lo:400:kworker.0 00000100:00080000:1.0:1782759804.845522:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759804.845527:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759804.845555:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058240 00000100:00100000:1.0:1782759804.845559:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058240 00000100:00100000:1.0:1782759804.845603:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:1.0:1782759804.845611:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212058240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759804.845655:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212058240:12345-0@lo:400:kworker.0 Request processed in 45us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759804.845661:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00080000:1.0:1782759804.845678:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759804.845695:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212058240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759804.854585:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212057600:12345-0@lo:400:kworker.0 Request processed in 9942us (10036us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759804.854602:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:0.0:1782759804.855673:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212057600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759804.855898:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212058112:12345-0@lo:400:kworker.0 Request processed in 10904us (11314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759804.855910:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:0.0:1782759804.856031:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212058112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759804.856046:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212057984:0@lo:400:kworker.0 00010000:00010000:3.0:1782759804.908661:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759805.360270:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759805.360294:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212058368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759805.360379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759805.367269:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058368 00000100:00100000:2.0:1782759805.367295:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058368 00000100:00100000:2.0:1782759805.367353:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1782759805.367363:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212058368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759805.367405:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759805.367516:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212058368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (7136us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759805.367542:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1782759805.367969:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212058368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759805.932570:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759806.956086:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759807.165645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759807.165703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759807.165719:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354368 00000100:00100000:0.0:1782759807.165730:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354368 00000100:00100000:0.0:1782759807.165787:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3027 00000100:00100000:0.0:1782759807.165797:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197354368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759807.165904:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197354368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759807.165912:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3027 00000100:00100000:3.0:1782759807.166056:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354624 00000100:00100000:3.0:1782759807.166061:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354624 00000100:00100000:3.0:1782759807.166255:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2238 00000100:00100000:3.0:1782759807.166270:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197354624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759807.166271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759807.166304:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354496 00000100:00100000:0.0:1782759807.166308:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354496 00000100:00100000:3.0:1782759807.166316:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197354624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759807.166324:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2238 00000100:00100000:0.0:1782759807.166346:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2792 00000100:00100000:0.0:1782759807.166355:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197354496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759807.166425:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197354496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759807.166434:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2792 00000100:00100000:2.0:1782759807.167507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759807.167583:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354752 00000100:00100000:0.0:1782759807.167590:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354752 00000100:00100000:0.0:1782759807.167640:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2239 00000100:00100000:0.0:1782759807.167649:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197354752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759807.167708:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197354752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 59us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759807.167715:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2239 00000100:00080000:1.0:1782759807.168336:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759807.168342:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759807.168353:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759807.916249:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759807.916275:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212058496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759807.916348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759807.916610:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058496 00000100:00100000:2.0:1782759807.916619:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058496 00000100:00100000:2.0:1782759807.916692:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1782759807.916701:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212058496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759807.916736:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759807.916783:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212058496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759807.916790:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00080000:1.0:1782759807.916963:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759807.917009:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212058496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759807.980083:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759809.007516:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759809.964199:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759809.964356:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759809.964396:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212059008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759809.964465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759809.964552:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059008 00000100:00100000:1.0:1782759809.964559:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059008 00000100:00100000:1.0:1782759809.964614:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:1.0:1782759809.964625:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212059008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759809.964679:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212059008:12345-0@lo:400:kworker.0 Request processed in 57us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759809.964687:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00080000:1.0:1782759809.964715:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759809.964744:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212059008:0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.964850:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212058752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.964895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759809.964932:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759809.964938:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212058880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.964961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759809.965091:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058752 00000100:00100000:1.0:1782759809.965096:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058752 00000100:00100000:1.0:1782759809.965131:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058880 00000100:00100000:1.0:1782759809.965134:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058880 00000100:00100000:1.0:1782759809.965159:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:1.0:1782759809.965166:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212058752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759809.965203:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212058752:12345-0@lo:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759809.965209:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:1.0:1782759809.965234:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:1.0:1782759809.965239:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212058880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759809.965268:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212058880:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759809.965274:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00080000:1.0:1782759809.965293:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759809.965310:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212058880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759809.965320:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212058752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759809.967642:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212058624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759809.967718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759809.968022:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212058624 00000100:00100000:2.0:1782759809.968030:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212058624 00000100:00100000:2.0:1782759809.968076:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:2.0:1782759809.968086:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212058624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.968155:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212058624:12345-0@lo:400:kworker.0 Request processed in 69us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759809.968162:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1782759809.968434:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212058624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.977022:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759809.977050:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212059264:0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.977141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759809.977261:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759809.977271:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212059136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759809.977304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759809.977403:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059136 00000100:00100000:2.0:1782759809.977410:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059136 00000100:00100000:2.0:1782759809.977480:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:2.0:1782759809.977490:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212059136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759809.977541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212059136:12345-0@lo:400:kworker.0 Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759809.977549:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00080000:1.0:1782759809.977698:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759809.977731:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212059136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759809.978138:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059264 00000100:00100000:3.0:1782759809.978143:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059264 00000100:00100000:3.0:1782759809.978198:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:3.0:1782759809.978206:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212059264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759809.978251:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212059264:12345-0@lo:400:kworker.0 Request processed in 46us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759809.978257:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00080000:1.0:1782759809.978311:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759809.978574:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212059264:0@lo:400:kworker.0 00010000:00010000:3.0:1782759810.028384:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759810.476112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759810.476136:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212059392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759810.476203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759810.476268:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059392 00000100:00100000:2.0:1782759810.476276:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059392 00000100:00100000:2.0:1782759810.476331:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1782759810.476341:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212059392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759810.476378:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759810.476423:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212059392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759810.476431:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1782759810.476476:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212059392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759811.054108:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759812.077618:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759812.282805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759812.282859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759812.282884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759812.282907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759812.282931:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197354880 00000100:00100000:0.0:1782759812.282939:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197354880 00000100:00100000:0.0:1782759812.282985:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3029 00000100:00100000:0.0:1782759812.282995:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197354880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759812.283069:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197354880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759812.283076:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3029 00000100:00100000:0.0:1782759812.283109:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355008 00000100:00100000:0.0:1782759812.283112:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355008 00000100:00100000:0.0:1782759812.283150:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2796 00000100:00100000:0.0:1782759812.283157:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197355008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759812.283187:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197355008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759812.283193:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2796 00000100:00100000:0.0:1782759812.283210:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355136 00000100:00100000:0.0:1782759812.283213:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355136 00000100:00100000:0.0:1782759812.284365:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355264 00000100:00100000:0.0:1782759812.284373:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355264 00000100:00100000:0.0:1782759812.284859:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2242 00000100:00100000:0.0:1782759812.284868:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197355136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759812.284920:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197355136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 54us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759812.284928:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2242 00000100:00100000:0.0:1782759812.284943:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2243 00000100:00100000:0.0:1782759812.284949:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197355264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759812.284975:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197355264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759812.284981:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2243 00000100:00080000:0.0:1782759812.285124:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759812.285137:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759812.285140:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759813.042247:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759813.042269:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212059520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759813.042344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759813.042407:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059520 00000100:00100000:2.0:1782759813.042414:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059520 00000100:00100000:2.0:1782759813.042470:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1782759813.042478:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212059520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759813.042508:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759813.042553:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212059520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759813.042560:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00080000:2.0:1782759813.042580:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759813.042620:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212059520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759813.104839:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759813.619055:0:158407:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea7022da0 20000000:00000080:0.0:1782759813.619069:0:158407:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b783ac00 uarg=0000000000000000 00010000:00010000:0.0:1782759813.619647:0:158407:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759813.619661:0:158407:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759813.619673:0:158407:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759813.619689:0:158407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.619706:0:158407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.619715:0:158407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.619751:0:158407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.619764:0:158407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 18 pid: 5794 timeout: 3982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759813.619876:0:158407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158407:1869355212059648:0@lo:104: 00000100:00100000:0.0:1782759813.619940:0:158407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759813.619984:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059648 00000100:00100000:0.0:1782759813.619991:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059648 00000100:00100000:0.0:1782759813.620033:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1782759813.620043:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:158407:x1869355212059648:12345-0@lo:104: 00010000:00010000:0.0:1782759813.620055:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.620109:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759813.620116:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:158407:x1869355212059648:12345-0@lo:104: Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759813.620123:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00010000:00010000:0.0:1782759813.620146:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759813.620152:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.620160:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759813.620163:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.620171:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759813.620178:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759813.620184:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759813.620214:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.620222:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759813.620243:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.620250:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0b42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0b49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.620288:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759813.620290:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759813.620293:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759813.620315:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212059776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759813.620352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759813.620413:0:158407:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bb916600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759813.620434:0:158407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158407:1869355212059648:0@lo:104: 00010000:00010000:0.0:1782759813.620451:0:158407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759813.621367:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059776 00000100:00100000:1.0:1782759813.621375:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059776 00010000:00010000:1.0:1782759813.621399:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 19 pid: 5794 timeout: 3982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759813.621432:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1782759813.621440:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212059776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759813.621453:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759813.621458:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 19 pid: 5794 timeout: 3982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621482:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 19 pid: 5794 timeout: 3982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621496:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0b49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0b42 expref: 19 pid: 5794 timeout: 3982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621510:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621518:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621533:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621540:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621546:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621553:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621559:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759813.621563:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621570:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621701:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759813.621711:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759813.621811:0:158407:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759813.621912:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355212059776:12345-0@lo:103:ldlm_bl.0 Request processed in 471us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759813.621921:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00010000:00010000:0.0:1782759813.621944:0:158407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759813.621953:0:158407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0b9d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759813.627376:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212059776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759814.133708:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759815.084413:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212060288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759815.084490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759815.084553:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759815.084559:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212060160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759815.084583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759815.084614:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060288 00000100:00100000:1.0:1782759815.084620:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060288 00000100:00100000:1.0:1782759815.084677:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1782759815.084688:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212060288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759815.084738:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212060288:12345-0@lo:400:kworker.0 Request processed in 53us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.084745:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1782759815.084777:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060160 00000100:00100000:1.0:1782759815.084781:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060160 00000100:00100000:1.0:1782759815.084806:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:1.0:1782759815.084812:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212060160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759815.084869:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212060160:12345-0@lo:400:kworker.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.084885:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00080000:1.0:1782759815.084903:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759815.084907:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759815.084937:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212060160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759815.084948:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212060288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085164:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212059904:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.085264:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212060416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.085308:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782759815.085313:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212060032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.085348:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212060544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.085405:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060416 00000100:00100000:2.0:1782759815.085409:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060416 00000100:00100000:2.0:1782759815.085438:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060032 00000100:00100000:2.0:1782759815.085440:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060032 00000100:00100000:2.0:1782759815.085457:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:2.0:1782759815.085464:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212060416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085498:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212060416:12345-0@lo:400:kworker.0 Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759815.085515:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:2.0:1782759815.085530:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759815.085536:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212060032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085566:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3307:x1869355212060032:12345-0@lo:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759815.085571:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759815.085603:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212060032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.085612:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212060416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759815.085992:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060544 00000100:00100000:0.0:1782759815.085997:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060544 00000100:00100000:0.0:1782759815.086033:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:0.0:1782759815.086040:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212060544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759815.086097:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212060544:12345-0@lo:400:kworker.0 Request processed in 58us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.086103:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:1.0:1782759815.086745:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212059904 00000100:00100000:1.0:1782759815.086752:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212059904 00000100:00100000:1.0:1782759815.086796:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1782759815.086804:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212059904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759815.086885:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212059904:12345-0@lo:400:kworker.0 Request processed in 82us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.086892:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00080000:1.0:1782759815.086930:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759815.086936:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759815.087045:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212060544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759815.087057:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212059904:0@lo:400:kworker.0 00010000:00010000:2.0:1782759815.148761:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759815.601442:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212060672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759815.601514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759815.601582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759815.601588:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212060800:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759815.601613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759815.601642:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060672 00000100:00100000:3.0:1782759815.601648:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060672 00000100:00100000:3.0:1782759815.601689:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1782759815.601697:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212060672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759815.601739:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759815.601781:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212060672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.601788:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1782759815.601811:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060800 00000100:00100000:3.0:1782759815.601814:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060800 00000100:00100000:3.0:1782759815.601855:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1782759815.601861:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212060800:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759815.601902:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212060800:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.601909:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1782759815.601949:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212060800:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759815.601967:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212060672:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1782759815.605796:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759815.605804:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759815.605809:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759815.605887:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.605899:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.605910:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.605935:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212060928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759815.606003:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759815.606060:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b34616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759815.606132:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212060928 00000100:00100000:0.0:1782759815.606146:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212060928 00000100:00100000:0.0:1782759815.606201:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031 00000100:00100000:0.0:1782759815.606211:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212060928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759815.606232:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759815.606244:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0ba4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.606267:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.606278:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.606286:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74200, rc 0) 00000100:00100000:0.0:1782759815.606330:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212060928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.606336:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031 00000100:00100000:0.0:1782759815.606390:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212060928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759815.606404:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.606412:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759815.606429:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759815.606434:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.606441:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759816.175998:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759817.198774:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759817.400704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759817.400747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759817.400781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759817.400810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759817.401255:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355520 00000100:00100000:1.0:1782759817.401266:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355520 00000100:00100000:1.0:1782759817.401328:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2800 00000100:00100000:1.0:1782759817.401340:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197355520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759817.401413:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2364:x1869355197355520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759817.401420:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2800 00000100:00100000:1.0:1782759817.401445:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355776 00000100:00100000:1.0:1782759817.401448:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355776 00000100:00100000:1.0:1782759817.401472:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355648 00000100:00100000:1.0:1782759817.401475:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355648 00000100:00100000:1.0:1782759817.401493:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2246 00000100:00100000:1.0:1782759817.401510:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197355776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759817.401536:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197355776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759817.401542:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2246 00000100:00100000:1.0:1782759817.401555:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2247 00000100:00100000:1.0:1782759817.401562:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197355648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759817.402146:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197355392 00000100:00100000:0.0:1782759817.402153:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197355392 00000100:00100000:0.0:1782759817.402198:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3032 00000100:00100000:0.0:1782759817.402206:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197355392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759817.402238:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197355392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759817.402244:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3032 00000100:00080000:0.0:1782759817.403180:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759817.403196:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759817.403199:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759817.403755:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197355648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 2188us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759817.403767:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2247 00000100:00100000:0.0:1782759817.404719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759817.406673:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356032 00000100:00100000:3.0:1782759817.406692:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356032 00000100:00100000:3.0:1782759817.407032:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2248 00000100:00100000:3.0:1782759817.407046:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108481:x1869355197356032:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759817.407073:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759817.407104:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bb2 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67222 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.408420:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.408442:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.408457:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.408474:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.408483:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.408490:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759817.409688:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x20:0x0]: returning size 7680 00010000:00010000:3.0:1782759817.410444:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410472:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410480:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410487:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759817.410493:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410616:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410638:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759817.410642:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759817.410648:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410655:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0bb9 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410672:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410679:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410686:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410691:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcce00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759817.410701:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410709:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410776:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1000) 00010000:00010000:3.0:1782759817.410780:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759817.410783:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410791:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bc0 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410868:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bb2 lrc: 1/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67222 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410881:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759817.410884:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759817.410888:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bb2 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67222 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759817.410902:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759817.411058:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108481:x1869355197356032:12345-192.168.204.31@tcp:101:dd.0 Request processed in 4013us (6338us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759817.411070:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2248 00000100:00100000:3.0:1782759818.156187:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212061056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759818.156328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759818.156370:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061056 00000100:00100000:2.0:1782759818.156379:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061056 00000100:00100000:2.0:1782759818.156450:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1782759818.156461:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212061056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759818.156498:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759818.157114:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212061056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 654us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759818.157122:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00080000:2.0:1782759818.157146:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759818.157191:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212061056:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759818.202025:0:158603:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe41b001b0 20000000:00000080:0.0:1782759818.202042:0:158603:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7839000 uarg=0000000000000000 00010000:00010000:0.0:1782759818.202692:0:158603:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759818.202707:0:158603:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759818.202720:0:158603:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759818.202738:0:158603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.202756:0:158603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.202777:0:158603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.202864:0:158603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.202879:0:158603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 18 pid: 5793 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759818.202896:0:158603:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158603:1869355212061184:0@lo:104: 00000100:00100000:0.0:1782759818.202974:0:158603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759818.203045:0:158603:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718637f300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759818.203324:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061184 00000100:00100000:2.0:1782759818.203336:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061184 00000100:00100000:2.0:1782759818.203393:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1782759818.203404:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:158603:x1869355212061184:12345-0@lo:104: 00010000:00010000:2.0:1782759818.203425:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.203500:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759818.203507:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:158603:x1869355212061184:12345-0@lo:104: Request processed in 105us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759818.203517:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1782759818.203640:0:158603:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158603:1869355212061184:0@lo:104: 00010000:00010000:0.0:1782759818.203661:0:158603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759818.203709:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759818.203714:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759818.203720:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759818.203722:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759818.203728:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759818.203733:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759818.203737:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759818.203766:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759818.203773:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759818.203842:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212061312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759818.203979:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759818.204276:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759818.204285:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0ba4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0bab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759818.204299:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759818.204301:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759818.204303:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759818.204527:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061312 00000100:00100000:2.0:1782759818.204533:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061312 00010000:00010000:2.0:1782759818.204573:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 19 pid: 5793 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759818.204602:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1782759818.204609:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212061312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759818.204619:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759818.204623:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 19 pid: 5793 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204633:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 19 pid: 5793 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204646:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0bab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0ba4 expref: 19 pid: 5793 timeout: 3986 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204659:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204667:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204713:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204720:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204726:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204731:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204737:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759818.204740:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204747:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204767:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759818.204775:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759818.204804:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212061312:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759818.204809:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1782759818.204910:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212061312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759818.205232:0:158603:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.205241:0:158603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.205245:0:158603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74c00/0xdd99f5c4777e0bc7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759818.220895:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759819.017559:0:158651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1d8a22f0 20000000:00000080:1.0:1782759819.017585:0:158651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917183838800 uarg=0000000000000000 00010000:00010000:1.0:1782759819.017965:0:158651:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759819.017985:0:158651:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759819.018003:0:158651:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759819.018030:0:158651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018053:0:158651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018067:0:158651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018075:0:158651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018090:0:158651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018099:0:158651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018105:0:158651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759819.018110:0:158651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018119:0:158651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018137:0:158651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018146:0:158651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.018162:0:158651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031800/0xdd99f5c4777e0bce lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759819.248128:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759819.563983:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759819.564021:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759819.564028:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759819.564100:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759819.564115:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759819.564129:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759819.564180:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212061440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759819.564282:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759819.564383:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061440 00000100:00100000:0.0:1782759819.564383:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7c09180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759819.564394:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061440 00000100:00100000:3.0:1782759819.564490:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033 00000100:00100000:3.0:1782759819.564502:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212061440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759819.564520:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759819.564537:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0bd5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759819.564567:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759819.564579:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759819.564590:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759819.564655:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212061440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759819.564663:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033 00000100:00100000:1.0:1782759819.564763:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212061440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759819.564782:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.564802:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759819.564869:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759819.564875:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759819.564882:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759820.205045:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212061824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759820.205129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759820.205202:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759820.205209:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212061952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759820.205236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759820.205287:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061824 00000100:00100000:1.0:1782759820.205295:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061824 00000100:00100000:1.0:1782759820.205353:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1782759820.205366:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212061824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759820.205420:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212061824:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759820.205427:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00080000:1.0:1782759820.205453:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759820.205486:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212061824:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.205501:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212061568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.205539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759820.205578:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212062080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.205600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759820.205623:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759820.205630:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212061696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.205648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759820.205665:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212062208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.205686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759820.205711:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061952 00000100:00100000:0.0:1782759820.205717:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061952 00000100:00100000:3.0:1782759820.205720:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062208 00000100:00100000:3.0:1782759820.205725:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062208 00000100:00100000:0.0:1782759820.205757:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:0.0:1782759820.205767:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212061952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759820.205803:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061568 00000100:00100000:1.0:1782759820.205807:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061568 00000100:00100000:3.0:1782759820.205856:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:3.0:1782759820.205866:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212062208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759820.205888:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034 00000100:00100000:1.0:1782759820.205898:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212061568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.205911:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212062208:12345-0@lo:400:kworker.0 Request processed in 46us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759820.205919:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:3.0:1782759820.205943:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062080 00000100:00100000:3.0:1782759820.205947:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062080 00000100:00100000:1.0:1782759820.205951:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212061568:12345-0@lo:400:kworker.0 Request processed in 54us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759820.205958:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034 00000100:00100000:3.0:1782759820.205972:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212061696 00000100:00100000:3.0:1782759820.205976:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212061696 00000100:00100000:3.0:1782759820.205998:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00080000:1.0:1782759820.205999:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759820.206005:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759820.206006:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212062080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759820.206009:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759820.206055:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212062080:12345-0@lo:400:kworker.0 Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759820.206062:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:3.0:1782759820.206075:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:3.0:1782759820.206081:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212061696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.206109:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3305:x1869355212061696:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759820.206115:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:3.0:1782759820.206162:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212061696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.206171:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212062208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.206178:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212061568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759820.206187:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212062080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759820.206666:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212061952:12345-0@lo:400:kworker.0 Request processed in 892us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759820.206674:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00100000:0.0:1782759820.206787:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212061952:0@lo:400:kworker.0 00010000:00010000:3.0:1782759820.269599:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759820.716106:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759820.716137:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212062336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759820.716212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759820.716316:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062336 00000100:00100000:3.0:1782759820.716328:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062336 00000100:00100000:3.0:1782759820.716378:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1782759820.716388:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212062336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759820.716432:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759820.716490:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212062336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759820.716497:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1782759820.716709:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212062336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759821.293049:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759822.316136:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759822.520026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759822.520076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759822.520117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759822.520141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759822.520168:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356544 00000100:00100000:1.0:1782759822.520177:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356544 00000100:00100000:1.0:1782759822.520239:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356416 00000100:00100000:1.0:1782759822.520242:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356416 00000100:00100000:1.0:1782759822.520267:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2250 00000100:00100000:1.0:1782759822.520277:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197356544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759822.520342:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197356544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759822.520350:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2250 00000100:00100000:1.0:1782759822.520384:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2251 00000100:00100000:1.0:1782759822.520392:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197356416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759822.520428:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197356416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759822.520452:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2251 00000100:00100000:1.0:1782759822.520474:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356160 00000100:00100000:1.0:1782759822.520478:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356160 00000100:00100000:1.0:1782759822.520501:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3035 00000100:00100000:1.0:1782759822.520507:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197356160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759822.520532:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197356160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759822.520537:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3035 00000100:00080000:1.0:1782759822.520565:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759822.520568:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759822.522046:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356288 00000100:00100000:3.0:1782759822.522057:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356288 00000100:00100000:3.0:1782759822.522136:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2804 00000100:00100000:3.0:1782759822.522146:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197356288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759822.522202:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197356288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 57us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.522209:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2804 00000100:00080000:0.0:1782759822.524808:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759822.617340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759822.617391:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356672 00000100:00100000:1.0:1782759822.617401:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356672 00000100:00100000:1.0:1782759822.617469:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2249 00000100:00100000:1.0:1782759822.617481:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108566:x1869355197356672:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:1.0:1782759822.617503:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759822.617527:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0be3 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67229 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617592:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617607:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617619:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617647:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617655:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617661:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617967:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617976:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617982:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.617988:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759822.617993:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618003:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618017:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759822.618021:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759822.618026:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618031:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0bea lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618051:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618057:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618063:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618069:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759822.618072:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618078:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618099:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171889c5400) 00010000:00010000:1.0:1782759822.618103:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759822.618106:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618112:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0bf1 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618148:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0be3 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67229 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.618158:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5300) 00010000:00010000:1.0:1782759822.618161:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759822.618172:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0be3 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67229 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759822.619806:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030a00, rc 0) 00000100:00100000:2.0:1782759822.620080:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108566:x1869355197356672:12345-192.168.204.31@tcp:101:rm.0 Request processed in 2596us (2743us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759822.620103:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2249 00000100:00100000:0.0:1782759822.631400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759822.631715:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356800 00000100:00100000:3.0:1782759822.632023:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356800 00000100:00100000:3.0:1782759822.632095:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2250 00000100:00100000:3.0:1782759822.632106:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108566:x1869355197356800:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782759822.632128:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759822.632154:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bf8 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67230 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.632227:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.632253:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.632265:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.632281:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.632288:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.632295:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634669:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634688:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634695:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634701:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759822.634706:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634713:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634742:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1000) 00010000:00010000:3.0:1782759822.634753:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759822.634916:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634925:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0bff lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634941:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634948:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634954:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634960:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759822.634963:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634969:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634978:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1400) 00010000:00010000:3.0:1782759822.634981:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759822.634985:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.634991:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c06 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.635044:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bf8 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67230 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.635062:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1000) 00010000:00010000:3.0:1782759822.635064:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759822.635069:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0bf8 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67230 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759822.635092:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcce00, rc 0) 00000100:00100000:3.0:1782759822.635184:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108566:x1869355197356800:12345-192.168.204.31@tcp:101:rm.0 Request processed in 3078us (3792us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759822.635194:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2250 00000100:00100000:0.0:1782759823.278597:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212062464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759823.278660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759823.278763:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062464 00000100:00100000:2.0:1782759823.278770:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062464 00000100:00100000:2.0:1782759823.278843:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1782759823.278852:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212062464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759823.278885:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759823.278929:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212062464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759823.278935:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1782759823.278976:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212062464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759823.279037:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759823.340026:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759824.364217:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759825.324135:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759825.329716:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212062720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759825.329798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.329986:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212062592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759825.330018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.330087:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062592 00000100:00100000:2.0:1782759825.330095:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062592 00000100:00100000:2.0:1782759825.330150:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1782759825.330159:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212062592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759825.330217:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212062592:12345-0@lo:400:kworker.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.330225:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1782759825.330270:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212062592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759825.335088:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212062848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759825.335158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.335223:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212063104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759825.335224:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212063232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759825.335256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.335275:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212062976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759825.335298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.335331:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062976 00000100:00100000:0.0:1782759825.335331:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063232 00000100:00100000:2.0:1782759825.335337:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062976 00000100:00100000:0.0:1782759825.335337:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063232 00000100:00100000:2.0:1782759825.335399:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:2.0:1782759825.335408:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212062976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759825.335471:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212062976:12345-0@lo:400:kworker.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.335479:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00080000:2.0:1782759825.338994:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759825.339004:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759825.339082:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062720 00000100:00100000:3.0:1782759825.339093:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062720 00000100:00100000:3.0:1782759825.339140:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212062848 00000100:00100000:3.0:1782759825.339143:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212062848 00000100:00100000:3.0:1782759825.339174:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:3.0:1782759825.339183:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212062720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759825.342086:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:0.0:1782759825.342109:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212063232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759825.349103:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212062976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759825.349153:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212062720:12345-0@lo:400:kworker.0 Request processed in 9970us (19354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.349160:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1782759825.349173:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212062848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759825.349198:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212063232:12345-0@lo:400:kworker.0 Request processed in 7099us (13939us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.349207:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00100000:2.0:1782759825.349222:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212062848:12345-0@lo:400:kworker.0 Request processed in 55us (14065us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759825.349284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.349529:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063104 00000100:00100000:0.0:1782759825.349539:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063104 00000100:00100000:1.0:1782759825.349682:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212062848:0@lo:400:kworker.0 00000100:00080000:1.0:1782759825.349802:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759825.349855:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212063232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759825.349868:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212062720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759825.356729:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1782759825.361547:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:0.0:1782759825.361815:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:0.0:1782759825.361854:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212063104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759825.362000:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212063104:12345-0@lo:400:kworker.0 Request processed in 158us (12716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.362007:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:1.0:1782759825.362097:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212063104:0@lo:400:kworker.0 00010000:00010000:0.0:1782759825.390906:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759825.837475:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212063360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759825.837548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.837867:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063360 00000100:00100000:2.0:1782759825.837875:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063360 00000100:00100000:2.0:1782759825.837930:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1782759825.837939:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212063360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759825.837973:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759825.838039:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212063360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.838047:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1782759825.838136:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212063360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759826.414638:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759827.437021:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759827.636689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759827.636758:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759827.636802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759827.636892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759827.637149:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357056 00000100:00100000:2.0:1782759827.637161:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357056 00000100:00100000:2.0:1782759827.637230:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2808 00000100:00100000:2.0:1782759827.637244:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197357056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759827.637323:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2362:x1869355197357056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 84us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759827.637330:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2808 00000100:00100000:2.0:1782759827.637387:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357312 00000100:00100000:2.0:1782759827.637391:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357312 00000100:00100000:2.0:1782759827.637415:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357184 00000100:00100000:2.0:1782759827.637418:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357184 00000100:00100000:2.0:1782759827.637436:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2254 00000100:00100000:2.0:1782759827.637442:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197357312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759827.637469:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197357312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759827.637476:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2254 00000100:00100000:2.0:1782759827.637487:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2255 00000100:00100000:2.0:1782759827.637493:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917191920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197357184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759827.637529:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917191920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197357184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759827.637534:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2255 00000100:00080000:1.0:1782759827.638162:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759827.638168:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759827.638170:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759827.638236:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197356928 00000100:00100000:0.0:1782759827.638241:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197356928 00000100:00100000:0.0:1782759827.638279:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3037 00000100:00100000:0.0:1782759827.638287:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197356928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759827.638315:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197356928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 30us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759827.638331:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3037 00000100:00100000:0.0:1782759828.396629:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212063488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759828.396709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759828.397126:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063488 00000100:00100000:2.0:1782759828.397138:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063488 00000100:00100000:2.0:1782759828.397225:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1782759828.397236:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212063488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759828.397277:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759828.397350:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212063488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759828.397357:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1782759828.397550:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212063488:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759828.397678:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759828.460069:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759829.487057:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759830.444156:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212063872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759830.444240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759830.444320:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759830.444327:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212064000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759830.444354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759830.444385:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063872 00000100:00100000:3.0:1782759830.444392:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063872 00000100:00100000:3.0:1782759830.444446:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:3.0:1782759830.444455:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212063872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759830.444507:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212063872:12345-0@lo:400:kworker.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759830.444515:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00080000:3.0:1782759830.444536:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759830.444568:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212063872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.444767:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212063744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.444797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759830.444951:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212064256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.444977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759830.444998:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759830.445004:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212063616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759830.445053:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212064128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759830.445096:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064000 00000100:00100000:0.0:1782759830.445099:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064000 00000100:00100000:0.0:1782759830.445125:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064256 00000100:00100000:0.0:1782759830.445127:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064256 00000100:00100000:0.0:1782759830.445142:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:0.0:1782759830.445147:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212064000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445177:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212064000:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.445183:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00100000:0.0:1782759830.445193:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1782759830.445197:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212064256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445229:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212064256:12345-0@lo:400:kworker.0 Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.445236:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1782759830.445261:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063616 00000100:00100000:0.0:1782759830.445264:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063616 00000100:00100000:0.0:1782759830.445284:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:0.0:1782759830.445298:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212063616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445321:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212063616:12345-0@lo:400:kworker.0 Request processed in 24us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.445327:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:0.0:1782759830.445349:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212063744 00000100:00100000:0.0:1782759830.445352:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212063744 00000100:00100000:0.0:1782759830.445370:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064128 00000100:00100000:0.0:1782759830.445372:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064128 00000100:00100000:0.0:1782759830.445386:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1782759830.445391:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212063744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445414:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212063744:12345-0@lo:400:kworker.0 Request processed in 23us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.445419:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1782759830.445427:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1782759830.445432:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212064128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445449:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212064128:12345-0@lo:400:kworker.0 Request processed in 17us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.445454:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1782759830.445478:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212063616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445487:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212064128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445501:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212063744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759830.445508:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212064256:0@lo:400:kworker.0 00000100:00080000:3.0:1782759830.447563:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759830.447573:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759830.447577:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759830.447690:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212064000:0@lo:400:kworker.0 00010000:00010000:3.0:1782759830.508147:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759830.956381:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212064384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759830.956454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759830.956531:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064384 00000100:00100000:3.0:1782759830.956538:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064384 00000100:00100000:3.0:1782759830.956583:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1782759830.956592:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212064384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759830.956639:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759830.956684:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212064384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759830.956703:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1782759830.956749:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212064384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759831.542439:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759832.563486:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759832.780478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759832.781633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759832.781666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759832.781695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759832.781725:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357696 00000100:00100000:1.0:1782759832.781734:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357696 00000100:00100000:1.0:1782759832.781794:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357824 00000100:00100000:1.0:1782759832.781797:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357824 00000100:00100000:1.0:1782759832.781882:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2258 00000100:00100000:1.0:1782759832.781903:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197357696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759832.782127:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197357696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 226us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.782135:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2258 00000100:00100000:1.0:1782759832.782156:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2259 00000100:00100000:1.0:1782759832.782163:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197357824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759832.782188:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197357824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.782194:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2259 00000100:00100000:3.0:1782759832.782662:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357568 00000100:00100000:3.0:1782759832.782669:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357568 00000100:00100000:3.0:1782759832.782712:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2812 00000100:00100000:3.0:1782759832.782719:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197357568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759832.782754:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2361:x1869355197357568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.782761:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2812 00000100:00080000:3.0:1782759832.782779:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759832.782783:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759832.782786:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759832.785855:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357440 00000100:00100000:0.0:1782759832.785869:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357440 00000100:00100000:0.0:1782759832.785939:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3039 00000100:00100000:0.0:1782759832.785949:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197357440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759832.786025:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197357440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759832.786034:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3039 00000100:00100000:3.0:1782759833.516218:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759833.516241:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212064512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759833.516305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759833.516365:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064512 00000100:00100000:3.0:1782759833.516373:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064512 00000100:00100000:3.0:1782759833.516423:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1782759833.516434:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212064512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759833.516468:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759833.516511:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212064512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759833.516519:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00080000:3.0:1782759833.516539:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759833.516572:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212064512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759833.582486:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759833.793446:0:159048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8c84a880 20000000:00000080:1.0:1782759833.793465:0:159048:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917183839800 uarg=0000000000000000 00010000:00010000:1.0:1782759833.796667:0:159048:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759833.796691:0:159048:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759833.796709:0:159048:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759833.796796:0:159048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759833.796816:0:159048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759833.796893:0:159048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759833.796933:0:159048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759833.796960:0:159048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 18 pid: 5794 timeout: 4002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759833.796976:0:159048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159048:1869355212064640:0@lo:104: 00000100:00100000:1.0:1782759833.797037:0:159048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759833.797081:0:159048:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083696b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759833.797257:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064640 00000100:00100000:0.0:1782759833.797265:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064640 00000100:00100000:0.0:1782759833.797318:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1782759833.797328:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159048:x1869355212064640:12345-0@lo:104: 00010000:00010000:0.0:1782759833.797339:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.797394:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759833.797400:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159048:x1869355212064640:12345-0@lo:104: Request processed in 75us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759833.797407:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00010000:00010000:0.0:1782759833.797428:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759833.797434:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.797441:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759833.797451:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.797460:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759833.797467:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759833.797472:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759833.797499:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.797505:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759833.797524:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.797531:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75000/0xdd99f5c4777e0bd5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0bdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.797546:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759833.797547:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759833.797549:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759833.797565:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212064768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759833.797592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759833.797645:0:159048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159048:1869355212064640:0@lo:104: 00010000:00010000:0.0:1782759833.797662:0:159048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759833.798649:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064768 00000100:00100000:3.0:1782759833.798656:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064768 00010000:00010000:3.0:1782759833.798683:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 19 pid: 5794 timeout: 4002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759833.798730:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1782759833.798739:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212064768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759833.798753:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759833.798759:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 19 pid: 5794 timeout: 4002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798770:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 19 pid: 5794 timeout: 4002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798783:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e0bdc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0bd5 expref: 19 pid: 5794 timeout: 4002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798797:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798804:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798931:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798941:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798948:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798968:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798974:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759833.798979:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.798988:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.799001:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759833.799012:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759833.799074:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212064768:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759833.799082:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1782759833.799122:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212064768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759833.799429:0:159048:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.799444:0:159048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759833.799451:0:159048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030a00/0xdd99f5c4777e0c0d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759834.604459:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759835.179917:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759835.179928:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759835.179934:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759835.179985:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759835.179998:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759835.180009:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759835.180033:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cdb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212064896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759835.180104:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759835.180162:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaad240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759835.180267:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212064896 00000100:00100000:2.0:1782759835.180276:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212064896 00000100:00100000:2.0:1782759835.180332:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:2.0:1782759835.180343:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212064896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759835.180396:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759835.180409:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0c14 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759835.180723:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759835.180739:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759835.180750:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759835.180800:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212064896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 460us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759835.180808:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00100000:0.0:1782759835.181011:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cdb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212064896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759835.181027:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759835.181035:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759835.181055:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759835.181067:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759835.181076:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759835.564434:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212065024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759835.564501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759835.564634:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212065408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759835.564664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759835.564699:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212065152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759835.564720:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759835.564739:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759835.564745:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212065280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759835.564767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759835.564804:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212065024 00000100:00100000:3.0:1782759835.564812:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212065024 00000100:00100000:3.0:1782759835.564882:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212065408 00000100:00100000:3.0:1782759835.564886:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212065408 00000100:00100000:3.0:1782759835.564907:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212065152 00000100:00100000:3.0:1782759835.564910:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212065152 00000100:00100000:3.0:1782759835.564924:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:3.0:1782759835.564932:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212065024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759835.565595:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:1.0:1782759835.565608:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212065408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759835.565615:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:1.0:1782759835.565647:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212065408:12345-0@lo:400:kworker.0 Request processed in 43us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759835.565653:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:3.0:1782759835.565852:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3306:x1869355212065024:12345-0@lo:400:kworker.0 Request processed in 888us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759835.565860:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:3.0:1782759835.565880:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212065280 00000100:00100000:3.0:1782759835.565883:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212065280 00000100:00100000:3.0:1782759835.565913:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1782759835.565919:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212065280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759835.565952:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212065280:12345-0@lo:400:kworker.0 Request processed in 33us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759835.565957:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00080000:3.0:1782759835.565976:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759835.565980:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759835.566027:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212065408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759835.566043:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759835.566051:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212065536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759835.566081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759835.566118:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212065280:0@lo:400:kworker.0 00000100:00100000:1.0:1782759835.567232:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212065536 00000100:00100000:1.0:1782759835.567239:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212065536 00000100:00100000:1.0:1782759835.567287:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:1.0:1782759835.567295:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212065536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759835.567355:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212065536:12345-0@lo:400:kworker.0 Request processed in 61us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759835.567361:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00080000:3.0:1782759835.569236:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759835.569280:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212065536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759835.570306:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212065024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759835.570779:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212065152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759835.570893:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212065152:12345-0@lo:400:kworker.0 Request processed in 5268us (6171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759835.570904:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00100000:2.0:1782759835.570967:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212065152:0@lo:400:kworker.0 00010000:00010000:3.0:1782759835.630858:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759836.077251:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212065664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759836.077518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759836.077764:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212065664 00000100:00100000:3.0:1782759836.077773:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212065664 00000100:00100000:3.0:1782759836.077845:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1782759836.077854:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212065664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759836.077888:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759836.077932:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212065664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759836.077939:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:1.0:1782759836.078943:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212065664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759836.652108:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759836.976950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759836.978004:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197357952 00000100:00100000:0.0:1782759836.978017:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197357952 00000100:00100000:0.0:1782759836.978132:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2251 00000100:00100000:0.0:1782759836.978149:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108794:x1869355197357952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759836.978173:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759836.978203:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0c22 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67237 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.978277:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.978291:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.978302:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.978313:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.978333:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.978341:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979571:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979584:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979596:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979602:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759836.979607:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979615:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979631:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917182dd1100) 00010000:00010000:1.0:1782759836.979634:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759836.979639:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979644:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e0c29 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979656:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979661:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979665:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979669:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759836.979672:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979685:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979692:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff917182dd1a00) 00010000:00010000:1.0:1782759836.979694:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759836.979697:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979702:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e0c30 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979738:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0c22 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67237 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979749:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917182dd1100) 00010000:00010000:1.0:1782759836.979752:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759836.979755:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0c22 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67237 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759836.979767:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75000, rc 0) 00000100:00100000:1.0:1782759836.979868:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108794:x1869355197357952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1725us (2927us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759836.979877:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2251 00000100:00080000:3.0:1782759836.983905:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759836.984111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759836.984265:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197358208 00000100:00100000:3.0:1782759836.984274:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197358208 00000100:00100000:3.0:1782759836.984333:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2252 00000100:00100000:3.0:1782759836.984343:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:108794:x1869355197358208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759836.984362:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759836.984383:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c37 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6723e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.984772:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.984787:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.984798:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.984820:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.984862:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.984871:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991022:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991041:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991054:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759836.991067:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x27:0x0]: returning size 0 00010000:00010000:3.0:1782759836.991095:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991104:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991111:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991116:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759836.991121:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991128:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991151:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759836.991154:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759836.991160:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991166:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0c3e lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759836.991179:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f23238f reply state 00000000e5b4a927 transno 4294968156 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759836.991188:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759836.991223:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0c37 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991241:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.991249:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759836.991252:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759836.991254:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759836.991329:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:108794:x1869355197358208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6987us (7221us total) trans 4294968156 rc 0/0 00000100:00100000:3.0:1782759836.991338:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2252 00000100:00100000:2.0:1782759836.997087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782759836.997488:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997502:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997523:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997529:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcce00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759836.997534:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997542:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997559:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1700) 00010000:00010000:3.0:1782759836.997562:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759836.997567:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997573:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c45 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759836.997616:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197358464 00000100:00100000:3.0:1782759836.997625:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197358464 00000100:00100000:3.0:1782759836.997681:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2253 00000100:00100000:3.0:1782759836.997690:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:108794:x1869355197358464:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759836.997714:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759836.997730:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0c5a lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67245 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997856:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997880:0:146757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997890:0:146757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 4/0,1 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997927:0:146757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759836.997941:0:146757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 8 pid: 5803 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759836.997956:0:146757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:146757:1869355212065792:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759836.998040:0:146757:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7de40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759837.000607:0:146757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:146757:1869355212065792:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759837.000636:0:146757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759837.008096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.008213:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197358592 00000100:00100000:3.0:1782759837.008226:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197358592 00010000:00010000:3.0:1782759837.008269:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 9 pid: 5803 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759837.008319:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 710 00000100:00100000:3.0:1782759837.008330:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2362:x1869355197358592:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759837.008344:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759837.008382:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 9 pid: 5803 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.008395:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 9 pid: 5803 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.008419:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c4c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6723e expref: 9 pid: 5803 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.008436:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759837.008442:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.008451:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.008457:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 4/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.008488:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759837.008539:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197358592:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 210us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.008547:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 710 00010000:00010000:2.0:1782759837.011918:0:146757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.011939:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759837.011988:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x27:0x0]: returning size 0 00010000:00010000:3.0:1782759837.012455:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012464:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012473:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012488:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759837.012493:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012501:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012517:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759837.012520:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759837.012525:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012530:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c61 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012592:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0c5a lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67245 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012603:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1900) 00010000:00010000:3.0:1782759837.012606:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759837.012609:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0c5a lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67245 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.012623:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759837.012711:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:108794:x1869355197358464:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15020us (15631us total) trans 4294968157 rc 301/301 00000100:00100000:3.0:1782759837.012720:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2253 00000100:00100000:2.0:1782759837.018011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759837.018738:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197358848 00000100:00100000:1.0:1782759837.018751:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197358848 00000100:00100000:1.0:1782759837.018817:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 364 00000100:00100000:1.0:1782759837.018863:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:108794:x1869355197358848:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759837.019150:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:108794:x1869355197358848:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 289us (1147us total) trans 4294968158 rc 0/0 00000100:00100000:1.0:1782759837.019159:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 364 00000100:00100000:2.0:1782759837.022583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.022627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197359104 00000100:00100000:3.0:1782759837.022650:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197359104 00000100:00100000:3.0:1782759837.022705:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 365 00000100:00100000:3.0:1782759837.022726:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:108794:x1869355197359104:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759837.023014:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:108794:x1869355197359104:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 300us (440us total) trans 4294968159 rc 0/0 00000100:00100000:3.0:1782759837.023021:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 365 00000100:00100000:2.0:1782759837.070815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.071584:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197359360 00000100:00100000:3.0:1782759837.071594:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197359360 00000100:00100000:3.0:1782759837.071655:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2254 00000100:00100000:3.0:1782759837.071665:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:108795:x1869355197359360:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:3.0:1782759837.071691:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759837.071714:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0c6f lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6724c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.071915:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.071930:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.071941:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.071953:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.071960:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.071966:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.072059:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.072066:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.072074:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759837.073321:0:5802:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1782759837.073327:0:5802:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 0 -> 1782759836 00000004:00010000:3.0:1782759837.073330:0:5802:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 0 -> 1782759836 00000004:00010000:3.0:1782759837.073333:0:5802:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 0 -> 1782759836 00000004:00010000:3.0:1782759837.073335:0:5802:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 18427282363563114435 -> 1 00002000:00010000:3.0:1782759837.073339:0:5802:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1782759837.073347:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073355:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073362:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073368:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759837.073372:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073379:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073408:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1900) 00010000:00010000:3.0:1782759837.073411:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759837.073417:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073424:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0c76 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073437:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073443:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073448:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073452:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759837.073455:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073460:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073467:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1600) 00010000:00010000:3.0:1782759837.073469:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759837.073472:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073478:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0c7d lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073541:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0c6f lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073557:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.073565:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759837.073566:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1782759837.073568:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcce00, rc 0) 00000100:00100000:3.0:1782759837.073645:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:108795:x1869355197359360:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1980us (2858us total) trans 4294968160 rc 0/0 00000100:00100000:3.0:1782759837.073654:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2254 00000100:00100000:2.0:1782759837.093308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759837.093344:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197359616 00000100:00100000:2.0:1782759837.093354:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197359616 00000100:00100000:2.0:1782759837.093411:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2255 00000100:00100000:2.0:1782759837.093423:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:108795:x1869355197359616:12345-192.168.204.31@tcp:36:dd.0 00010000:00010000:2.0:1782759837.093546:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.093563:0:7487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.093573:0:7487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 4/0,1 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.093608:0:7487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.093622:0:7487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 11 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759837.093637:0:7487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355212065920:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759837.093721:0:7487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaada80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759837.104708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.104767:0:7487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7487:1869355212065920:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759837.104810:0:7487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759837.105667:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197359744 00000100:00100000:0.0:1782759837.105674:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197359744 00010000:00010000:0.0:1782759837.105712:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 12 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759837.105752:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 711 00000100:00100000:0.0:1782759837.105762:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2361:x1869355197359744:12345-192.168.204.31@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1782759837.105779:0:5785:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 12 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.105789:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 12 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.105819:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 12 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.105848:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:0.0:1782759837.105851:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1782759837.105854:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.105877:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.105884:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.105915:0:5785:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 12 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759837.105967:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2361:x1869355197359744:12345-192.168.204.31@tcp:102:ldlm_bl.0 Request processed in 206us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759837.105974:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 711 00010000:00010000:0.0:1782759837.105996:0:7487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.106003:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759837.106290:0:7487:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1782759837.106294:0:7487:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759837.106297:0:7487:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759837.106299:0:7487:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759837.106301:0:7487:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00010000:0.0:1782759837.106308:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a0cf539 reply state 00000000647cf1c8 transno 4294968161 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759837.106316:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759837.106385:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:108795:x1869355197359616:12345-192.168.204.31@tcp:36:dd.0 Request processed in 12965us (13087us total) trans 4294968161 rc 0/0 00000100:00100000:0.0:1782759837.106399:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2255 00000100:00100000:3.0:1782759837.112263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1782759837.112315:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.112384:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.112392:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.112399:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759837.112417:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.112426:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.112444:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759837.112447:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759837.112452:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.112459:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90200/0xdd99f5c4777e0c92 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759837.114194:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197359872 00000100:00100000:1.0:1782759837.114211:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197359872 00002000:00010000:1.0:1782759837.114257:0:5814:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x200000418:0x27:0x0] 00002000:00100000:1.0:1782759837.114263:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170832d5500 with x1869355197359872 00000100:00100000:1.0:1782759837.114307:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:1.0:1782759837.114317:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2363:x1869355197359872:12345-192.168.204.31@tcp:10:dd.0 00000004:00010000:1.0:1782759837.114550:0:5814:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1782759837.114554:0:5814:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759836 00000004:00010000:1.0:1782759837.114556:0:5814:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:1.0:1782759837.114559:0:5814:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759836 00000004:00010000:1.0:1782759837.114561:0:5814:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782759837.114634:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2363:x1869355197359872:12345-192.168.204.31@tcp:10:dd.0 Request processed in 318us (2380us total) trans 4294968162 rc 0/0 00000100:00100000:1.0:1782759837.114642:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00002000:00010000:1.0:1782759837.114646:0:5814:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x200000418:0x27:0x0] 00002000:00100000:1.0:1782759837.114648:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170832d5500 with x1869355197359872 00000100:00100000:0.0:1782759837.200417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759837.201163:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360000 00000100:00100000:1.0:1782759837.201174:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360000 00002000:00100000:1.0:1782759837.201235:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917088cdad80 x1869355197360000/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/0 e 0 to 0 dl 1782759848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759837.201245:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917088cdad80 with x1869355197360000 00000100:00100000:1.0:1782759837.201288:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1782759837.201312:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2363:x1869355197360000:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759837.232720:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.232747:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759837.232778:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066048:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1782759837.233061:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759837.233125:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaadd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759837.233269:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066048 00000100:00100000:1.0:1782759837.233277:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066048 00000100:00100000:1.0:1782759837.233335:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1782759837.233345:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:5816:x1869355212066048:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1782759837.233366:0:154820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759837.233381:0:154820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0c99 expref: -99 pid: 154820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759837.237250:0:154820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759837.237269:0:154820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759837.237286:0:154820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030a00, rc 0) 00000100:00100000:1.0:1782759837.238172:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066048:12345-0@lo:101:mdt_io00_002.0 Request processed in 4825us (5108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.238182:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1782759837.238489:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066048:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1782759837.238512:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.238523:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.238557:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759837.238566:0:5816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000004:00010000:2.0:1782759837.250762:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 0 -> 1048576 00000004:00010000:2.0:1782759837.250771:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.250774:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.250776:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.250779:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759837.253674:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2363:x1869355197360000:12345-192.168.204.31@tcp:4:dd.0 Request processed in 52352us (53257us total) trans 4294968163 rc 0/0 00000100:00100000:2.0:1782759837.253713:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00002000:00100000:2.0:1782759837.253728:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917088cdad80 x1869355197360000/t4294968163(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/448 e 0 to 0 dl 1782759848 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.253738:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917088cdad80 with x1869355197360000 00000100:00100000:3.0:1782759837.269264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759837.271008:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360128 00000100:00100000:2.0:1782759837.271022:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360128 00000100:00100000:2.0:1782759837.271095:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2256 00000100:00100000:2.0:1782759837.271107:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:108795:x1869355197360128:12345-192.168.204.31@tcp:44:dd.0 00000001:00080000:2.0:1782759837.419591:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968161 is committed 00000001:00080000:2.0:1782759837.419610:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968162 is committed 00000001:00080000:2.0:1782759837.419630:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968163 is committed 00000100:00100000:3.0:1782759837.419914:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:108795:x1869355197360128:12345-192.168.204.31@tcp:44:dd.0 Request processed in 148803us (150654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.419926:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2256 00000100:00100000:3.0:1782759837.422137:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759837.422429:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360256 00000100:00100000:0.0:1782759837.422439:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360256 00000100:00100000:0.0:1782759837.422501:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2257 00000100:00100000:0.0:1782759837.422511:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197360256:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:0.0:1782759837.422614:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197360256:12345-192.168.204.31@tcp:16:dd.0 Request processed in 103us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759837.422622:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2257 00000100:00100000:3.0:1782759837.472260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759837.476386:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360384 00000100:00100000:2.0:1782759837.476400:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360384 00002000:00100000:2.0:1782759837.476463:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9170832d4e00 x1869355197360384/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/0 e 0 to 0 dl 1782759848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.476473:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170832d4e00 with x1869355197360384 00000100:00100000:2.0:1782759837.476574:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:2.0:1782759837.476584:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197360384:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759837.486267:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1782759837.486332:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212066176:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759837.486397:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759837.486458:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198b49540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759837.490310:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066176 00000100:00100000:1.0:1782759837.490333:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066176 00000100:00100000:1.0:1782759837.490410:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1782759837.490421:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198916450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212066176:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:1.0:1782759837.490461:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759837.491506:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198916450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212066176:12345-0@lo:601:mdt_io00_001.0 Request processed in 1084us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.491524:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1782759837.491954:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311c000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212066176:0@lo:601:mdt_io00_001.0 00010000:00010000:2.0:1782759837.491991:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782759837.492004:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000004:00010000:2.0:1782759837.492279:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 1048576 -> 2097152 00000004:00010000:2.0:1782759837.492283:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.492286:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.492288:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.492291:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 1 -> 2055 00000100:00100000:2.0:1782759837.493760:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197360384:12345-192.168.204.31@tcp:4:dd.0 Request processed in 17170us (21504us total) trans 4294968164 rc 0/0 00000100:00100000:2.0:1782759837.493781:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00002000:00100000:2.0:1782759837.493803:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9170832d4e00 x1869355197360384/t4294968164(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/448 e 0 to 0 dl 1782759848 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.493812:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170832d4e00 with x1869355197360384 00000100:00100000:1.0:1782759837.501137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.501294:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360512 00000100:00100000:3.0:1782759837.501306:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360512 00000100:00100000:3.0:1782759837.501474:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2258 00000100:00100000:3.0:1782759837.501484:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197360512:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:2.0:1782759837.639567:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968164 is committed 00000100:00100000:3.0:1782759837.639776:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197360512:12345-192.168.204.31@tcp:16:dd.0 Request processed in 138287us (138643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.639789:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2258 00010000:00010000:3.0:1782759837.676844:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759837.686282:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759837.686563:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360640 00000100:00100000:2.0:1782759837.686573:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360640 00002000:00100000:2.0:1782759837.686629:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9170832d5880 x1869355197360640/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/0 e 0 to 0 dl 1782759848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.686640:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170832d5880 with x1869355197360640 00000100:00100000:2.0:1782759837.686684:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1782759837.686695:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197360640:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:0.0:1782759837.710305:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000100:00100000:0.0:1782759837.710361:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066304:0@lo:601:mdt_io00_002.0 00000100:00100000:0.0:1782759837.710418:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759837.710543:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759837.718168:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066304 00000100:00100000:1.0:1782759837.718183:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066304 00000100:00100000:1.0:1782759837.718240:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1782759837.718250:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066304:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:1.0:1782759837.718289:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759837.730871:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066304:12345-0@lo:601:mdt_io00_002.0 Request processed in 12611us (20441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759837.730888:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1782759837.731441:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066304:0@lo:601:mdt_io00_002.0 00010000:00010000:2.0:1782759837.731500:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00010000:00010000:2.0:1782759837.731515:0:5816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000004:00010000:2.0:1782759837.731977:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 2097152 -> 3145728 00000004:00010000:2.0:1782759837.731982:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.731986:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.731988:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.731991:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 2055 -> 4105 00000100:00100000:2.0:1782759837.732221:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197360640:12345-192.168.204.31@tcp:4:dd.0 Request processed in 45524us (45947us total) trans 4294968165 rc 0/0 00000100:00100000:2.0:1782759837.732232:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00002000:00100000:2.0:1782759837.732243:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9170832d5880 x1869355197360640/t4294968165(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/448 e 0 to 0 dl 1782759848 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.732252:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170832d5880 with x1869355197360640 00000100:00100000:2.0:1782759837.744489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.744573:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360768 00000100:00100000:3.0:1782759837.744584:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360768 00000100:00100000:3.0:1782759837.744642:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2259 00000100:00100000:3.0:1782759837.744651:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197360768:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:3.0:1782759837.803236:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197360768:12345-192.168.204.31@tcp:16:dd.0 Request processed in 58573us (58742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.803252:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2259 00000001:00080000:2.0:1782759837.807088:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968165 is committed 00000100:00100000:3.0:1782759837.880457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.880502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759837.880580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759837.881460:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361152 00000100:00100000:1.0:1782759837.881471:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361152 00000100:00100000:2.0:1782759837.881508:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361024 00000100:00100000:2.0:1782759837.881512:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361024 00000100:00100000:1.0:1782759837.881534:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2262 00000100:00100000:2.0:1782759837.881540:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2263 00000100:00100000:1.0:1782759837.881544:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197361152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759837.881546:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197361024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759837.881619:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197361152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.881626:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2262 00000100:00080000:3.0:1782759837.881673:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759837.881677:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759837.881783:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197360896 00000100:00100000:0.0:1782759837.881797:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197360896 00000100:00100000:0.0:1782759837.881862:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3041 00000100:00100000:0.0:1782759837.881870:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197360896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759837.890971:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197361024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 9412us (10377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.890988:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2263 00000100:00100000:1.0:1782759837.903927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759837.904537:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361280 00000100:00100000:2.0:1782759837.904548:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361280 00002000:00100000:2.0:1782759837.904612:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082263480 x1869355197361280/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/0 e 0 to 0 dl 1782759848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.904639:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082263480 with x1869355197361280 00000100:00100000:2.0:1782759837.904755:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:2.0:1782759837.904766:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197361280:12345-192.168.204.31@tcp:4:dd.0 00000100:00100000:0.0:1782759837.906260:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197360896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24382us (25805us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759837.906274:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3041 00010000:00010000:2.0:1782759837.918817:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:2.0:1782759837.918934:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212066432:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759837.918986:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759837.919083:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066432 00000100:00100000:1.0:1782759837.919090:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066432 00000100:00100000:1.0:1782759837.919149:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1782759837.919158:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212066432:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:1.0:1782759837.919184:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759837.919432:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759837.920761:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212066432:12345-0@lo:601:mdt_io00_001.0 Request processed in 1599us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.920781:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1782759837.922072:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311c700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212066432:0@lo:601:mdt_io00_001.0 00010000:00010000:2.0:1782759837.922612:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:2.0:1782759837.922625:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000004:00010000:2.0:1782759837.923891:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 3145728 -> 4194304 00000004:00010000:2.0:1782759837.923898:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.923901:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.923904:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759837.923906:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 4105 -> 6155 00000100:00100000:2.0:1782759837.924042:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197361280:12345-192.168.204.31@tcp:4:dd.0 Request processed in 19274us (20122us total) trans 4294968166 rc 0/0 00000100:00100000:2.0:1782759837.924054:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00002000:00100000:2.0:1782759837.924076:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082263480 x1869355197361280/t4294968166(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:243/0 lens 488/448 e 0 to 0 dl 1782759848 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759837.924086:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082263480 with x1869355197361280 00000100:00100000:3.0:1782759837.928199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759837.928403:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361408 00000100:00100000:0.0:1782759837.928414:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361408 00000100:00100000:0.0:1782759837.928474:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2260 00000100:00100000:0.0:1782759837.928484:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197361408:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:1.0:1782759838.022416:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968166 is committed 00000100:00100000:3.0:1782759838.022582:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197361408:12345-192.168.204.31@tcp:16:dd.0 Request processed in 94091us (94385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759838.022594:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2260 00000100:00100000:3.0:1782759838.112583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759838.117415:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361536 00000100:00100000:2.0:1782759838.117433:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361536 00002000:00100000:2.0:1782759838.117527:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082b4df80 x1869355197361536/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/0 e 0 to 0 dl 1782759849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759838.117544:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082b4df80 with x1869355197361536 00000100:00100000:2.0:1782759838.117593:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:2.0:1782759838.117603:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197361536:12345-192.168.204.31@tcp:4:dd.0 00000100:00080000:3.0:1782759838.118221:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759838.136560:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:3.0:1782759838.136610:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066560:0@lo:601:mdt_io00_002.0 00000100:00100000:3.0:1782759838.136670:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759838.136734:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759838.137177:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066560 00000100:00100000:0.0:1782759838.137185:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066560 00000100:00100000:0.0:1782759838.137234:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782759838.137243:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066560:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:0.0:1782759838.137270:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759838.138228:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066560:12345-0@lo:601:mdt_io00_002.0 Request processed in 983us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759838.138237:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1782759838.142151:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082b4d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066560:0@lo:601:mdt_io00_002.0 00010000:00010000:2.0:1782759838.142198:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1782759838.142220:0:5816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000004:00010000:2.0:1782759838.142534:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 4194304 -> 5242880 00000004:00010000:2.0:1782759838.142538:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759836 -> 1782759837 00000004:00010000:2.0:1782759838.142540:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759838.142543:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759836 -> 1782759837 00000004:00010000:2.0:1782759838.142545:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 6155 -> 8203 00000100:00100000:2.0:1782759838.142619:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197361536:12345-192.168.204.31@tcp:4:dd.0 Request processed in 25016us (30045us total) trans 4294968167 rc 0/0 00000100:00100000:2.0:1782759838.142629:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00002000:00100000:2.0:1782759838.142648:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082b4df80 x1869355197361536/t4294968167(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/448 e 0 to 0 dl 1782759849 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759838.142657:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082b4df80 with x1869355197361536 00000100:00100000:2.0:1782759838.158322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759838.158421:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361664 00000100:00100000:0.0:1782759838.158432:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361664 00000100:00100000:0.0:1782759838.158495:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2261 00000100:00100000:0.0:1782759838.158505:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197361664:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:0.0:1782759838.232337:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197361664:12345-192.168.204.31@tcp:16:dd.0 Request processed in 73822us (74013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759838.232353:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2261 00000001:00080000:1.0:1782759838.232565:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968167 is committed 00000100:00100000:1.0:1782759838.356011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759838.356170:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361792 00000100:00100000:2.0:1782759838.356179:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361792 00002000:00100000:2.0:1782759838.356230:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082260000 x1869355197361792/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/0 e 0 to 0 dl 1782759849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759838.356241:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082260000 with x1869355197361792 00000100:00100000:2.0:1782759838.356276:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:2.0:1782759838.356286:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197361792:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759838.378578:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:2.0:1782759838.378627:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212066688:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759838.378705:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759838.378786:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759838.378871:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066688 00000100:00100000:0.0:1782759838.378878:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066688 00000100:00100000:0.0:1782759838.378930:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1782759838.378940:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212066688:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:0.0:1782759838.378969:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759838.379973:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212066688:12345-0@lo:601:mdt_io00_001.0 Request processed in 1031us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759838.379983:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782759838.379997:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212066688:0@lo:601:mdt_io00_001.0 00010000:00010000:3.0:1782759838.380024:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1782759838.380035:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000004:00010000:0.0:1782759838.380819:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 5242880 -> 6291456 00000004:00010000:0.0:1782759838.380858:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759837 -> 1782759837 00000004:00010000:0.0:1782759838.380861:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759838.380863:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759837 -> 1782759837 00000004:00010000:0.0:1782759838.380865:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 8203 -> 10253 00000100:00100000:0.0:1782759838.380939:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197361792:12345-192.168.204.31@tcp:4:dd.0 Request processed in 24652us (24935us total) trans 4294968168 rc 0/0 00000100:00100000:0.0:1782759838.380953:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00002000:00100000:0.0:1782759838.380965:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082260000 x1869355197361792/t4294968168(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/448 e 0 to 0 dl 1782759849 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759838.380975:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082260000 with x1869355197361792 00000100:00100000:1.0:1782759838.388952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759838.391411:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197361920 00000100:00100000:2.0:1782759838.391426:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197361920 00000100:00100000:2.0:1782759838.391559:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2262 00000100:00100000:2.0:1782759838.391571:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197361920:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:1.0:1782759838.489578:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968168 is committed 00000100:00100000:0.0:1782759838.493605:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197361920:12345-192.168.204.31@tcp:16:dd.0 Request processed in 102025us (104650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759838.493620:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2262 00000100:00100000:3.0:1782759838.565898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759838.566304:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362048 00000100:00100000:2.0:1782759838.566315:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362048 00002000:00100000:2.0:1782759838.566371:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171bbe33480 x1869355197362048/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/0 e 0 to 0 dl 1782759849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759838.566382:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171bbe33480 with x1869355197362048 00000100:00100000:2.0:1782759838.566434:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1782759838.566444:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197362048:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759838.584898:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:2.0:1782759838.585022:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066816:0@lo:601:mdt_io00_002.0 00000100:00100000:2.0:1782759838.585082:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759838.585197:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759838.591532:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066816 00000100:00100000:0.0:1782759838.591546:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066816 00000100:00100000:0.0:1782759838.591607:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1782759838.591618:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066816:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:0.0:1782759838.591659:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759838.598481:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212066816:12345-0@lo:601:mdt_io00_002.0 Request processed in 6854us (13388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759838.598502:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1782759838.598748:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212066816:0@lo:601:mdt_io00_002.0 00010000:00010000:2.0:1782759838.598794:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782759838.598806:0:5816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000004:00010000:2.0:1782759838.599120:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 6291456 -> 7340032 00000004:00010000:2.0:1782759838.599124:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759837 -> 1782759837 00000004:00010000:2.0:1782759838.599126:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759838.599128:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759837 -> 1782759837 00000004:00010000:2.0:1782759838.599131:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 10253 -> 12301 00000100:00100000:2.0:1782759838.599200:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197362048:12345-192.168.204.31@tcp:4:dd.0 Request processed in 32753us (33309us total) trans 4294968169 rc 0/0 00000100:00100000:2.0:1782759838.599210:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00002000:00100000:2.0:1782759838.599221:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171bbe33480 x1869355197362048/t4294968169(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/448 e 0 to 0 dl 1782759849 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759838.599252:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171bbe33480 with x1869355197362048 00000100:00100000:2.0:1782759838.607997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759838.608089:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362176 00000100:00100000:1.0:1782759838.608111:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362176 00000100:00100000:1.0:1782759838.608178:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2263 00000100:00100000:1.0:1782759838.608189:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197362176:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:1.0:1782759838.641007:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212066944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759838.641090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759838.641217:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212066944 00000100:00100000:2.0:1782759838.641229:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212066944 00000100:00100000:2.0:1782759838.641312:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1782759838.641323:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212066944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759838.641367:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759838.641420:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212066944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759838.641428:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:1.0:1782759838.645393:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212066944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759838.647152:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759838.685320:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197362176:12345-192.168.204.31@tcp:16:dd.0 Request processed in 77123us (77327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.685336:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2263 00000001:00080000:3.0:1782759838.685467:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968169 is committed 00010000:00010000:3.0:1782759838.700060:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759838.739757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759838.740647:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362304 00000100:00100000:0.0:1782759838.740658:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362304 00002000:00100000:0.0:1782759838.740713:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff91708182aa00 x1869355197362304/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/0 e 0 to 0 dl 1782759849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759838.740724:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff91708182aa00 with x1869355197362304 00000100:00100000:0.0:1782759838.740767:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1782759838.740788:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197362304:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:0.0:1782759838.749735:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:0.0:1782759838.749796:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212067072:0@lo:601:mdt_io00_001.0 00000100:00100000:0.0:1782759838.749889:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759838.749950:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759838.750164:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067072 00000100:00100000:1.0:1782759838.750171:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067072 00000100:00100000:1.0:1782759838.750216:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1782759838.750225:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212067072:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:1.0:1782759838.750251:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759838.751186:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212067072:12345-0@lo:601:mdt_io00_001.0 Request processed in 959us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.751194:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1782759838.751896:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212067072:0@lo:601:mdt_io00_001.0 00010000:00010000:3.0:1782759838.751929:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:3.0:1782759838.751941:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000004:00010000:3.0:1782759838.752229:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 7340032 -> 8388608 00000004:00010000:3.0:1782759838.752233:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759837 -> 1782759837 00000004:00010000:3.0:1782759838.752236:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:3.0:1782759838.752238:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759837 -> 1782759837 00000004:00010000:3.0:1782759838.752241:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 12301 -> 14351 00000100:00100000:3.0:1782759838.752416:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197362304:12345-192.168.204.31@tcp:4:dd.0 Request processed in 11626us (12667us total) trans 4294968170 rc 0/0 00000100:00100000:3.0:1782759838.752429:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00002000:00100000:3.0:1782759838.752445:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff91708182aa00 x1869355197362304/t4294968170(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/448 e 0 to 0 dl 1782759849 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759838.752455:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff91708182aa00 with x1869355197362304 00010000:00010000:1.0:1782759838.752560:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:1.0:1782759838.753067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759838.753081:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212067200:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759838.753126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759838.753168:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067200 00000100:00100000:1.0:1782759838.753173:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067200 00000100:00100000:1.0:1782759838.753203:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1782759838.753210:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198917050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212067200:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:1.0:1782759838.753237:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759838.758503:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198917050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212067200:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 5285us (5367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.758515:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:0.0:1782759838.758919:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1782759838.758935:0:3306:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:0.0:1782759838.758954:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212067200:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759838.772045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759838.772209:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362432 00000100:00100000:3.0:1782759838.772219:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362432 00000100:00100000:3.0:1782759838.772275:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2264 00000100:00100000:3.0:1782759838.772285:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197362432:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:3.0:1782759838.841779:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968170 is committed 00000100:00100000:2.0:1782759838.841981:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197362432:12345-192.168.204.31@tcp:16:dd.0 Request processed in 69691us (69943us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759838.841994:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2264 00000100:00100000:2.0:1782759838.917012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759838.917208:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362560 00000100:00100000:3.0:1782759838.917219:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362560 00002000:00100000:3.0:1782759838.917270:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311ce00 x1869355197362560/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/0 e 0 to 0 dl 1782759849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759838.917290:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311ce00 with x1869355197362560 00000100:00100000:3.0:1782759838.917337:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:3.0:1782759838.917347:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197362560:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:0.0:1782759838.939920:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:0.0:1782759838.939974:0:5816:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212067328:0@lo:601:mdt_io00_002.0 00000100:00100000:0.0:1782759838.940053:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759838.940107:0:5816:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759838.940442:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067328 00000100:00100000:1.0:1782759838.940450:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067328 00000100:00100000:1.0:1782759838.940508:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1782759838.940518:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212067328:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:1.0:1782759838.940548:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759838.941718:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5816:x1869355212067328:12345-0@lo:601:mdt_io00_002.0 Request processed in 1197us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.941728:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1782759838.941802:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212067456:0@lo:106: 00000100:00100000:1.0:1782759838.941849:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759838.941881:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759838.941911:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759838.941921:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067456 00000100:00100000:1.0:1782759838.941925:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067456 00000100:00100000:1.0:1782759838.941953:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1782759838.941959:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:5826:x1869355212067456:12345-0@lo:106: 00010000:00010000:1.0:1782759838.941970:0:5784:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759838.941981:0:5784:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759838.942020:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:5826:x1869355212067456:12345-0@lo:106: Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.942025:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1782759838.943240:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212067456:0@lo:106: 00000100:00100000:1.0:1782759838.943486:0:5816:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0000_UUID:5816:1869355212067328:0@lo:601:mdt_io00_002.0 00010000:00010000:1.0:1782759838.943513:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759838.943523:0:5816:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000004:00010000:1.0:1782759838.943811:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 8388608 -> 9437184 00000004:00010000:1.0:1782759838.945216:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759837 -> 1782759837 00000004:00010000:1.0:1782759838.945219:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:1.0:1782759838.945221:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759837 -> 1782759837 00000004:00010000:1.0:1782759838.945224:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 14351 -> 16401 00000100:00100000:1.0:1782759838.945848:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197362560:12345-192.168.204.31@tcp:4:dd.0 Request processed in 28497us (28841us total) trans 4294968171 rc 0/0 00000100:00100000:1.0:1782759838.945859:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00002000:00100000:1.0:1782759838.945871:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311ce00 x1869355197362560/t4294968171(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:244/0 lens 488/448 e 0 to 0 dl 1782759849 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759838.945882:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311ce00 with x1869355197362560 00000100:00100000:3.0:1782759838.951595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759838.951686:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362688 00000100:00100000:0.0:1782759838.951695:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362688 00000100:00100000:0.0:1782759838.951755:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2265 00000100:00100000:0.0:1782759838.951774:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197362688:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:3.0:1782759839.056720:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197362688:12345-192.168.204.31@tcp:16:dd.0 Request processed in 104946us (105123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759839.056733:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2265 00000001:00080000:0.0:1782759839.065490:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968171 is committed 00000100:00100000:2.0:1782759839.160964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759839.161639:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362816 00000100:00100000:3.0:1782759839.161651:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362816 00002000:00100000:3.0:1782759839.161708:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311d880 x1869355197362816/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/0 e 0 to 0 dl 1782759850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759839.161719:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311d880 with x1869355197362816 00000100:00100000:3.0:1782759839.161771:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:3.0:1782759839.161781:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197362816:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:0.0:1782759839.183559:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 9437184 -> 10485760 00000004:00010000:0.0:1782759839.183568:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759837 -> 1782759838 00000004:00010000:0.0:1782759839.183571:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759839.183574:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759837 -> 1782759838 00000004:00010000:0.0:1782759839.183576:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 16401 -> 18449 00000100:00100000:0.0:1782759839.183732:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197362816:12345-192.168.204.31@tcp:4:dd.0 Request processed in 21947us (22773us total) trans 4294968172 rc 0/0 00000100:00100000:0.0:1782759839.183744:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00002000:00100000:0.0:1782759839.183757:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311d880 x1869355197362816/t4294968172(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/448 e 0 to 0 dl 1782759850 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759839.183777:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311d880 with x1869355197362816 00000100:00100000:0.0:1782759839.203714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759839.203859:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197362944 00000100:00100000:3.0:1782759839.203871:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197362944 00000100:00100000:3.0:1782759839.203933:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2266 00000100:00100000:3.0:1782759839.203943:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197362944:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:1.0:1782759839.313223:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968172 is committed 00000100:00100000:1.0:1782759839.313381:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759839.313400:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212067584:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759839.313466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759839.313518:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067584 00000100:00100000:0.0:1782759839.313526:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067584 00000100:00100000:0.0:1782759839.313577:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1782759839.313586:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212067584:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759839.314513:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197362944:12345-192.168.204.31@tcp:16:dd.0 Request processed in 110568us (110806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759839.314525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2266 00000100:00100000:1.0:1782759839.315058:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212067584:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1472us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.315067:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1782759839.324452:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212067584:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759839.382261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759839.382417:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363072 00000100:00100000:1.0:1782759839.382430:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363072 00002000:00100000:1.0:1782759839.382484:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311ea00 x1869355197363072/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/0 e 0 to 0 dl 1782759850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759839.382495:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311ea00 with x1869355197363072 00000100:00100000:1.0:1782759839.382532:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:1.0:1782759839.382541:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197363072:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:1.0:1782759839.406715:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 10485760 -> 11534336 00000004:00010000:1.0:1782759839.406725:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759838 -> 1782759838 00000004:00010000:1.0:1782759839.406728:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:1.0:1782759839.406730:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759838 -> 1782759838 00000004:00010000:1.0:1782759839.406733:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 18449 -> 20499 00000100:00100000:1.0:1782759839.406861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197363072:12345-192.168.204.31@tcp:4:dd.0 Request processed in 24315us (24604us total) trans 4294968173 rc 0/0 00000100:00100000:1.0:1782759839.406872:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00002000:00100000:1.0:1782759839.406884:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311ea00 x1869355197363072/t4294968173(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/448 e 0 to 0 dl 1782759850 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759839.406895:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311ea00 with x1869355197363072 00000100:00100000:0.0:1782759839.419299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759839.419382:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363200 00000100:00100000:3.0:1782759839.419392:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363200 00000100:00100000:3.0:1782759839.419455:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2267 00000100:00100000:3.0:1782759839.419465:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197363200:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:1.0:1782759839.488882:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197363200:12345-192.168.204.31@tcp:16:dd.0 Request processed in 69406us (69588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.488896:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2267 00000001:00080000:1.0:1782759839.488940:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968173 is committed 00000100:00100000:2.0:1782759839.491690:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759839.505631:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212067712:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759839.505710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759839.506376:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067712 00000100:00100000:1.0:1782759839.506385:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067712 00000100:00100000:1.0:1782759839.516089:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1782759839.516111:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212067712:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759839.522886:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212067712:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 6772us (17164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.522901:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1782759839.523333:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212067712:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759839.568585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759839.569204:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363328 00000100:00100000:0.0:1782759839.569226:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363328 00002000:00100000:0.0:1782759839.569276:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311dc00 x1869355197363328/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/0 e 0 to 0 dl 1782759850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759839.569297:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311dc00 with x1869355197363328 00000100:00100000:0.0:1782759839.569329:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:0.0:1782759839.569338:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197363328:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:0.0:1782759839.600235:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 11534336 -> 12582912 00000004:00010000:0.0:1782759839.600399:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759838 -> 1782759838 00000004:00010000:0.0:1782759839.600403:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759839.600405:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759838 -> 1782759838 00000004:00010000:0.0:1782759839.600408:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 20499 -> 22549 00000100:00100000:0.0:1782759839.600576:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197363328:12345-192.168.204.31@tcp:4:dd.0 Request processed in 31234us (31995us total) trans 4294968174 rc 0/0 00000100:00100000:0.0:1782759839.600597:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00002000:00100000:0.0:1782759839.600611:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9171b311dc00 x1869355197363328/t4294968174(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/448 e 0 to 0 dl 1782759850 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759839.600621:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311dc00 with x1869355197363328 00000100:00100000:1.0:1782759839.610047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759839.615419:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363456 00000100:00100000:2.0:1782759839.615435:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363456 00000100:00100000:2.0:1782759839.615579:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2268 00000100:00100000:2.0:1782759839.616730:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197363456:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:2.0:1782759839.721543:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197363456:12345-192.168.204.31@tcp:16:dd.0 Request processed in 104810us (111494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759839.721558:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2268 00000001:00080000:1.0:1782759839.722775:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968174 is committed 00000100:00100000:2.0:1782759839.724081:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212067840:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759839.724149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759839.724556:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759839.726317:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067840 00000100:00100000:3.0:1782759839.726328:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067840 00000100:00100000:3.0:1782759839.726392:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1782759839.726402:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212067840:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759839.730744:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212067840:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 4334us (6585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759839.730770:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1782759839.731695:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212067840:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759839.804404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759839.804516:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363584 00000100:00100000:1.0:1782759839.804527:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363584 00002000:00100000:1.0:1782759839.804583:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082b4d880 x1869355197363584/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/0 e 0 to 0 dl 1782759850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759839.804594:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082b4d880 with x1869355197363584 00000100:00100000:1.0:1782759839.804635:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1782759839.804647:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197363584:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:0.0:1782759839.835242:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 12582912 -> 13631488 00000004:00010000:0.0:1782759839.835250:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759838 -> 1782759838 00000004:00010000:0.0:1782759839.835253:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759839.835255:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759838 -> 1782759838 00000004:00010000:0.0:1782759839.835258:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 22549 -> 24597 00000100:00100000:0.0:1782759839.837146:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197363584:12345-192.168.204.31@tcp:4:dd.0 Request processed in 32490us (32743us total) trans 4294968175 rc 0/0 00000100:00100000:0.0:1782759839.837160:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00002000:00100000:0.0:1782759839.837192:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082b4d880 x1869355197363584/t4294968175(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:245/0 lens 488/448 e 0 to 0 dl 1782759850 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759839.837203:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082b4d880 with x1869355197363584 00000100:00100000:1.0:1782759839.843553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759839.843700:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363712 00000100:00100000:2.0:1782759839.843710:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363712 00000100:00100000:2.0:1782759839.843811:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2269 00000100:00100000:2.0:1782759839.843851:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197363712:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:0.0:1782759839.946372:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968175 is committed 00000100:00100000:0.0:1782759839.946511:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212067968:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759839.946574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759839.946651:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212067968 00000100:00100000:0.0:1782759839.946658:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212067968 00000100:00100000:0.0:1782759839.946694:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782759839.946701:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212067968:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759839.948054:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212067968:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1347us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759839.948330:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212067968:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759839.950018:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fe5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197363712:12345-192.168.204.31@tcp:16:dd.0 Request processed in 106191us (106466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759839.950033:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2269 00000100:00100000:0.0:1782759839.952564:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1782759840.062777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759840.062897:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363840 00000100:00100000:0.0:1782759840.062908:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363840 00002000:00100000:0.0:1782759840.062990:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082d60700 x1869355197363840/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:246/0 lens 488/0 e 0 to 0 dl 1782759851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759840.063002:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082d60700 with x1869355197363840 00000100:00100000:0.0:1782759840.063055:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:0.0:1782759840.063070:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197363840:12345-192.168.204.31@tcp:4:dd.0 00000100:00080000:3.0:1782759840.063487:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1782759840.088738:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 13631488 -> 14680064 00000004:00010000:0.0:1782759840.088760:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759838 -> 1782759839 00000004:00010000:0.0:1782759840.088763:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:0.0:1782759840.088765:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759838 -> 1782759839 00000004:00010000:0.0:1782759840.088768:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 24597 -> 26647 00000100:00100000:0.0:1782759840.088881:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197363840:12345-192.168.204.31@tcp:4:dd.0 Request processed in 25811us (26109us total) trans 4294968176 rc 0/0 00000100:00100000:0.0:1782759840.088892:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00002000:00100000:0.0:1782759840.088906:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x27:0x0] req@ffff917082d60700 x1869355197363840/t4294968176(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:246/0 lens 488/448 e 0 to 0 dl 1782759851 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759840.088916:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917082d60700 with x1869355197363840 00000100:00100000:3.0:1782759840.101589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759840.101696:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197363968 00000100:00100000:2.0:1782759840.101706:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197363968 00000100:00100000:2.0:1782759840.101861:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2270 00000100:00100000:2.0:1782759840.101872:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197363968:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:3.0:1782759840.140189:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968176 is committed 00000100:00100000:1.0:1782759840.140645:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759840.140662:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212068096:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759840.140720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759840.140788:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068096 00000100:00100000:1.0:1782759840.140795:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068096 00000100:00100000:1.0:1782759840.140854:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1782759840.140862:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212068096:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759840.140990:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197363968:12345-192.168.204.31@tcp:16:dd.0 Request processed in 39117us (39412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759840.141000:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2270 00000100:00100000:3.0:1782759840.144305:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bb961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212068096:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759840.144769:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212068096:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 3905us (4045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759840.144781:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1782759840.170593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759840.170702:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197364096 00000100:00100000:0.0:1782759840.170713:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197364096 00002000:00100000:0.0:1782759840.170772:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9170818cfb80 x1869355197364096/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:246/0 lens 488/0 e 0 to 0 dl 1782759851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759840.170784:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170818cfb80 with x1869355197364096 00000100:00100000:0.0:1782759840.170820:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:1.0:1782759840.171057:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197364096:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:2.0:1782759840.182162:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb size from disk: 14680064 -> 15728640 00000004:00010000:2.0:1782759840.182171:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb mtime from disk: 1782759839 -> 1782759839 00000004:00010000:2.0:1782759840.182174:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb atime from disk: 1782759836 -> 1782759836 00000004:00010000:2.0:1782759840.182177:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb ctime from disk: 1782759839 -> 1782759839 00000004:00010000:2.0:1782759840.182179:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x27:0x0] updating lvb blocks from disk: 26647 -> 28697 00000100:00100000:2.0:1782759840.182263:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197364096:12345-192.168.204.31@tcp:4:dd.0 Request processed in 11296us (11674us total) trans 4294968177 rc 0/0 00000100:00100000:2.0:1782759840.182284:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00002000:00100000:2.0:1782759840.182295:0:5816:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x200000418:0x27:0x0] req@ffff9170818cfb80 x1869355197364096/t4294968177(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:246/0 lens 488/448 e 0 to 0 dl 1782759851 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759840.182305:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170818cfb80 with x1869355197364096 00000100:00100000:2.0:1782759840.186435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759840.186514:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197364224 00000100:00100000:3.0:1782759840.186525:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197364224 00000100:00100000:3.0:1782759840.186581:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2271 00000100:00100000:3.0:1782759840.186591:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197364224:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:0.0:1782759840.292677:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968177 is committed 00000100:00100000:0.0:1782759840.292879:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212068224:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759840.292953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759840.293041:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068224 00000100:00100000:0.0:1782759840.293049:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068224 00000100:00100000:0.0:1782759840.298233:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1782759840.298260:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198917c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212068224:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759840.299565:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197364224:12345-192.168.204.31@tcp:16:dd.0 Request processed in 112969us (113133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759840.299577:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2271 00000100:00100000:0.0:1782759840.302643:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198917c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212068224:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 4380us (9674us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759840.302656:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1782759840.304867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759840.305235:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197364480 00000100:00100000:3.0:1782759840.305247:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197364480 00000100:00100000:3.0:1782759840.305295:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 382 00000100:00100000:3.0:1782759840.305304:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:108795:x1869355197364480:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:3.0:1782759840.305562:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:108795:x1869355197364480:12345-192.168.204.31@tcp:35:dd.0 Request processed in 257us (700us total) trans 4294968178 rc 0/0 00000100:00100000:3.0:1782759840.305569:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 382 00000100:00100000:1.0:1782759840.306535:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212068224:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759840.345190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759840.345265:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197364608 00000100:00100000:3.0:1782759840.345275:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197364608 00000100:00100000:3.0:1782759840.345331:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2272 00000100:00100000:3.0:1782759840.345340:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:108796:x1869355197364608:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782759840.345366:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759840.345391:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0ca7 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67253 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.345460:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.345474:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 8 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.345515:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 4/1,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.345552:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 8 pid: 5802 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.345565:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 8 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759840.345580:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5802:1869355212068352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759840.345689:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171a04df000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759840.348321:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5802:1869355212068352:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759840.348349:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759840.348782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759840.348894:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197364736 00000100:00100000:0.0:1782759840.348916:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197364736 00010000:00010000:0.0:1782759840.348956:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 9 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759840.348997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:0.0:1782759840.349005:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2362:x1869355197364736:12345-192.168.204.31@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1782759840.349020:0:5787:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 9 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.349030:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 9 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.349040:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x48/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 9 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.349048:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:0.0:1782759840.349051:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 59 00010000:00010000:0.0:1782759840.349054:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.349067:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.349073:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 4/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.349104:0:5787:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x48/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 9 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759840.349159:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2362:x1869355197364736:12345-192.168.204.31@tcp:102:ldlm_bl.0 Request processed in 154us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759840.349173:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 712 00010000:00010000:1.0:1782759840.349623:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.349641:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759840.349686:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759840.349709:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.349957:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e0ca7 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67253 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.349995:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67253 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.350002:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:1.0:1782759840.350005:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759840.350008:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:1.0:1782759840.350054:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:108796:x1869355197364608:12345-192.168.204.31@tcp:101:rm.0 Request processed in 4715us (4873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759840.350070:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2272 00000100:00100000:1.0:1782759840.355585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759840.355675:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197364864 00000100:00100000:3.0:1782759840.355685:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197364864 00000100:00100000:3.0:1782759840.355787:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2273 00000100:00100000:3.0:1782759840.355798:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:108796:x1869355197364864:12345-192.168.204.31@tcp:101:rm.0 00010000:00010000:3.0:1782759840.355856:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759840.355881:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0cb5 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6725a expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.355947:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.355979:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.355990:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356003:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356010:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356015:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356519:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0cca lrc: 3/1,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356528:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0cca lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356536:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0cca lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759840.356572:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759840.356593:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0cca lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356606:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356611:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356624:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356630:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759840.356634:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356641:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356654:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759840.356657:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759840.356662:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356668:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0cbc lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356682:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356688:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356693:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356698:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759840.356700:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356717:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356726:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1c00) 00010000:00010000:3.0:1782759840.356728:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759840.356731:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356748:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0cc3 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356794:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0cb5 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6725a expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356809:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0cca lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6725a expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.356817:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759840.356819:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759840.356860:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759840.356918:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:108796:x1869355197364864:12345-192.168.204.31@tcp:101:rm.0 Request processed in 1121us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759840.356926:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2273 00000100:00100000:2.0:1782759840.395766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759840.395939:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365120 00000100:00100000:0.0:1782759840.395951:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365120 00000100:00100000:0.0:1782759840.396006:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2274 00000100:00100000:0.0:1782759840.396016:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:108796:x1869355197365120:12345-192.168.204.31@tcp:36:rm.0 00010000:00010000:0.0:1782759840.396161:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782759840.396191:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0cca lrc: 0/0,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6725a expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396213:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0cae lrc: 0/0,0 mode: --/PR res: [0x200000418:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67253 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396225:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcce00/0xdd99f5c4777e0c84 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x48/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6724c expref: 7 pid: 5802 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396235:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff9171908a1700) 00010000:00010000:0.0:1782759840.396247:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759840.396273:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396286:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396295:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396308:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396331:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396339:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396808:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 3/0,1 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396819:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.396909:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398441:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398459:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398470:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398479:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398485:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398491:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398541:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759840.398567:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398573:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398579:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398585:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759840.398589:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398596:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398608:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff917182dd1400) 00010000:00010000:0.0:1782759840.398611:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759840.398615:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 2/0,0 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398621:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0cdf lrc: 0/0,0 mode: --/EX res: [0x200000418:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398640:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398646:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398662:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398667:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759840.398670:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398676:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398684:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:0.0:1782759840.398687:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759840.398689:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.398695:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0cd1 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759840.398710:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd1164de reply state 000000001fe28aed transno 4294968179 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.399616:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759840.399624:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.399633:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759840.399647:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.399654:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.399664:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x27:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782759840.399667:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782759840.399670:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 1/0,0 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.399676:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74000/0xdd99f5c4777e0ce6 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.399693:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759840.399695:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759840.399697:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759840.399918:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759840.400072:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:108796:x1869355197365120:12345-192.168.204.31@tcp:36:rm.0 Request processed in 4055us (4313us total) trans 4294968179 rc 0/0 00000100:00100000:0.0:1782759840.400081:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2274 00010000:00010000:3.0:1782759840.411181:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.411200:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.411207:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.411213:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759840.411217:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.411225:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.411262:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff917182dd1600) 00010000:00010000:3.0:1782759840.411265:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759840.411269:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.411275:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74800/0xdd99f5c4777e0cd8 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759840.687105:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212068736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759840.687181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759840.687247:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782759840.687254:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212068608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759840.687277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759840.687299:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212069120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759840.687324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759840.687356:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069120 00000100:00100000:3.0:1782759840.687363:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069120 00000100:00100000:3.0:1782759840.687419:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:3.0:1782759840.687428:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212069120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759840.687479:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212069120:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759840.687487:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:0.0:1782759840.687652:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212068480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759840.687688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759840.687730:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212068992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759840.687763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759840.687805:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759840.687811:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212068864:0@lo:400:kworker.0 00000100:00080000:2.0:1782759840.687856:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759840.687860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759840.687869:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068736 00000100:00100000:2.0:1782759840.687873:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068736 00000100:00100000:0.0:1782759840.687885:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068480 00000100:00100000:0.0:1782759840.687888:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068480 00000100:00100000:2.0:1782759840.687904:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068608 00000100:00100000:2.0:1782759840.687907:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068608 00000100:00100000:0.0:1782759840.687912:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1782759840.687918:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212068480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759840.687920:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068992 00000100:00100000:2.0:1782759840.687922:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068992 00000100:00100000:2.0:1782759840.687939:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:2.0:1782759840.687945:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212068736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759840.687950:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212068480:12345-0@lo:400:kworker.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759840.687956:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:2.0:1782759840.687976:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212068736:12345-0@lo:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759840.687983:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:0.0:1782759840.687986:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212068864 00000100:00100000:0.0:1782759840.687989:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212068864 00000100:00100000:2.0:1782759840.687994:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:2.0:1782759840.687998:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212068608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759840.688010:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:0.0:1782759840.688016:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212068864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759840.688022:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212068608:12345-0@lo:400:kworker.0 Request processed in 24us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759840.688037:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1782759840.688040:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212068864:12345-0@lo:400:kworker.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759840.688048:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:2.0:1782759840.688053:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212068992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759840.688058:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:2.0:1782759840.688091:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212068992:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759840.688095:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212068864:0@lo:400:kworker.0 00000100:00100000:2.0:1782759840.688097:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1782759840.688105:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212068480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759840.688113:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212068992:0@lo:400:kworker.0 00000100:00080000:2.0:1782759840.688118:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759840.688121:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759840.688151:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212068608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759840.688161:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212069120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759840.688169:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212068736:0@lo:400:kworker.0 00010000:00010000:3.0:1782759840.748098:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759841.205081:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759841.205103:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212069248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759841.205170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759841.205310:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069248 00000100:00100000:3.0:1782759841.205318:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069248 00000100:00100000:3.0:1782759841.205372:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1782759841.205381:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212069248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759841.205426:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759841.205481:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212069248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759841.205488:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1782759841.205566:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212069248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759841.772409:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759842.801069:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759842.996350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759842.996394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759842.996428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759842.996453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759842.996481:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365248 00000100:00100000:2.0:1782759842.996490:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365248 00000100:00100000:2.0:1782759842.996536:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3043 00000100:00100000:2.0:1782759842.996545:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197365248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759842.996618:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197365248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759842.996626:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3043 00000100:00100000:1.0:1782759842.996854:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365376 00000100:00100000:1.0:1782759842.996859:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365376 00000100:00100000:1.0:1782759842.996905:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2819 00000100:00100000:1.0:1782759842.996912:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197365376:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759842.996956:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2362:x1869355197365376:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 45us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.996963:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2819 00000100:00100000:3.0:1782759842.997110:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365632 00000100:00100000:3.0:1782759842.997116:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365632 00000100:00100000:3.0:1782759842.997177:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365504 00000100:00100000:3.0:1782759842.997180:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365504 00000100:00100000:3.0:1782759842.997206:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2266 00000100:00100000:3.0:1782759842.997225:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197365632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759842.997260:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197365632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759842.997267:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2266 00000100:00100000:3.0:1782759842.997280:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2267 00000100:00100000:3.0:1782759842.997286:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197365504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759842.997310:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197365504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759842.997316:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2267 00000100:00080000:2.0:1782759842.997769:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759842.997785:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759842.997788:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759843.758251:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212069376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759843.758345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759843.758605:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069376 00000100:00100000:3.0:1782759843.758613:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069376 00000100:00100000:3.0:1782759843.758688:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1782759843.758699:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212069376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759843.758733:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782759843.758838:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759843.768177:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212069376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9468us (9820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759843.768215:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1782759843.769219:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212069376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759843.820190:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759844.268199:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759844.268224:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212069504:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759844.268366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759844.269227:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069504 00000100:00100000:3.0:1782759844.269237:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069504 00000100:00100000:3.0:1782759844.269585:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1782759844.269596:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212069504:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759844.269699:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212069504:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 105us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.269706:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1782759844.269751:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212069504:0@lo:601:lquota_wb_lustr.0 00000100:00080000:2.0:1782759844.269905:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759844.844005:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759845.360369:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968179 is committed 00000100:00100000:1.0:1782759845.362869:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212069632:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759845.362953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759845.363703:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069632 00000100:00100000:3.0:1782759845.363713:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069632 00000100:00100000:3.0:1782759845.363809:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1782759845.363819:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212069632:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759845.365701:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212069632:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1878us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759845.365714:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1782759845.365855:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212069760:0@lo:106: 00000100:00100000:2.0:1782759845.365893:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759845.365931:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198924780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759845.365967:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069760 00000100:00100000:2.0:1782759845.365973:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069760 00000100:00100000:2.0:1782759845.366019:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1782759845.366028:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5826:x1869355212069760:12345-0@lo:106: 00010000:00010000:2.0:1782759845.366041:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1782759845.366052:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:2.0:1782759845.366091:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5826:x1869355212069760:12345-0@lo:106: Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759845.366097:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1782759845.366147:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212069760:0@lo:106: 00000100:00100000:3.0:1782759845.366314:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212069632:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759845.804140:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212070144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759845.804210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759845.804283:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782759845.804304:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212070016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759845.804328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759845.804351:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212070528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759845.804376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759845.804415:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070144 00000100:00100000:2.0:1782759845.804422:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070144 00000100:00100000:2.0:1782759845.804473:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070016 00000100:00100000:2.0:1782759845.804477:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070016 00000100:00100000:2.0:1782759845.804498:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:2.0:1782759845.804517:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212070144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759845.804568:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212070144:12345-0@lo:400:kworker.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759845.804576:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:2.0:1782759845.804593:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:2.0:1782759845.804599:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759845.804627:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212070016:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759845.804648:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00080000:2.0:1782759845.804668:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759845.804702:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212070016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759845.804714:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212070144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759845.804856:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212069888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759845.804888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759845.804921:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212070400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759845.804943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759845.804970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759845.804976:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212070272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759845.805000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759845.805024:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212069888 00000100:00100000:0.0:1782759845.805027:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212069888 00000100:00100000:0.0:1782759845.805052:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1782759845.805059:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212069888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759845.805093:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212069888:12345-0@lo:400:kworker.0 Request processed in 35us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759845.805100:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1782759845.805134:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212069888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759845.805597:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070528 00000100:00100000:3.0:1782759845.805603:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070528 00000100:00100000:3.0:1782759845.805658:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070272 00000100:00100000:3.0:1782759845.805661:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070272 00000100:00100000:3.0:1782759845.805685:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:3.0:1782759845.805692:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212070528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759845.805733:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212070528:12345-0@lo:400:kworker.0 Request processed in 42us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759845.805739:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00100000:3.0:1782759845.805751:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:3.0:1782759845.805766:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212070272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759845.805799:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212070272:12345-0@lo:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759845.805804:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:3.0:1782759845.805862:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212070272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759845.805889:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212070528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759845.806093:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070400 00000100:00100000:1.0:1782759845.806097:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070400 00000100:00100000:1.0:1782759845.806144:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1782759845.806150:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212070400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759845.806188:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212070400:12345-0@lo:400:kworker.0 Request processed in 38us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759845.806193:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1782759845.806218:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b3180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212070400:0@lo:400:kworker.0 00000100:00080000:2.0:1782759845.806368:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759845.806372:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759845.868089:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759846.316539:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212070656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759846.316605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759846.316771:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070656 00000100:00100000:0.0:1782759846.316780:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070656 00000100:00100000:0.0:1782759846.316861:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1782759846.316871:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212070656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759846.316906:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759846.316970:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212070656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759846.316977:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:2.0:1782759846.317383:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212070656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759846.892224:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759847.916331:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759848.121166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759848.121204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759848.121233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759848.121260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759848.121289:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366144 00000100:00100000:2.0:1782759848.121298:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366144 00000100:00100000:2.0:1782759848.121351:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2270 00000100:00100000:2.0:1782759848.121362:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197366144:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759848.121434:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197366144:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759848.121441:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2270 00000100:00100000:2.0:1782759848.121457:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366016 00000100:00100000:2.0:1782759848.121460:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366016 00000100:00100000:2.0:1782759848.121482:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2271 00000100:00100000:2.0:1782759848.121488:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197366016:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759848.121513:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197366016:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759848.121519:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2271 00000100:00100000:2.0:1782759848.121537:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365760 00000100:00100000:2.0:1782759848.121540:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365760 00000100:00100000:2.0:1782759848.121564:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3045 00000100:00100000:2.0:1782759848.121570:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197365760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759848.121608:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197365760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759848.121626:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3045 00000100:00080000:2.0:1782759848.121656:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759848.121660:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759848.127290:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197365888 00000100:00100000:3.0:1782759848.127306:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197365888 00000100:00100000:3.0:1782759848.127465:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2823 00000100:00100000:3.0:1782759848.127476:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197365888:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759848.127564:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197365888:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 90us (6408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759848.127573:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2823 00000100:00080000:1.0:1782759848.129485:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759848.878842:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212070784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759848.878938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759848.879024:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070784 00000100:00100000:3.0:1782759848.879032:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070784 00000100:00100000:3.0:1782759848.879087:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1782759848.879095:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212070784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759848.879129:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759848.879174:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212070784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759848.879182:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00080000:3.0:1782759848.879212:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759848.879254:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212070784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759848.943028:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759849.966630:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759850.531704:0:159443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedd6aa0f0 20000000:00000080:0.0:1782759850.531724:0:159443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170826b1800 uarg=0000000000000000 00010000:00010000:0.0:1782759850.532602:0:159443:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759850.532618:0:159443:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759850.532631:0:159443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759850.532648:0:159443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759850.532677:0:159443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759850.532686:0:159443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759850.532725:0:159443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759850.532740:0:159443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 18 pid: 5793 timeout: 4018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759850.532755:0:159443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159443:1869355212070912:0@lo:104: 00000100:00100000:0.0:1782759850.532818:0:159443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759850.532891:0:159443:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7771840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759850.534532:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212070912 00000100:00100000:1.0:1782759850.534557:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212070912 00000100:00100000:1.0:1782759850.534634:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1782759850.534644:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159443:x1869355212070912:12345-0@lo:104: 00010000:00010000:1.0:1782759850.534661:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759850.534749:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1782759850.534848:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759850.534856:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.534865:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759850.534869:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.534879:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759850.534886:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759850.534892:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759850.534940:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.534948:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759850.534968:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.534976:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75800/0xdd99f5c4777e0c14 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0c1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.534995:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759850.534998:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759850.535000:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159443:x1869355212070912:12345-0@lo:104: Request processed in 355us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759850.535009:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00010000:00010000:2.0:1782759850.535014:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759850.535030:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212071040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759850.535074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759850.535127:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071040 00000100:00100000:2.0:1782759850.535131:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071040 00010000:00010000:2.0:1782759850.535151:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 19 pid: 5793 timeout: 4018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759850.535341:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1782759850.535352:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212071040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759850.535364:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759850.535370:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 19 pid: 5793 timeout: 4018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535383:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 19 pid: 5793 timeout: 4018 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535401:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535410:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535456:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535466:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535473:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535492:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535498:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759850.535502:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535511:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535520:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.535531:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759850.535652:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212071040:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759850.535659:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1782759850.536480:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212071040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759850.537139:0:159443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0c1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0c14 expref: 18 pid: 5793 timeout: 4018 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759850.537157:0:159443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159443:1869355212070912:0@lo:104: 00010000:00010000:2.0:1782759850.537179:0:159443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.537189:0:159443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.537466:0:159443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759850.537490:0:159443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0ced lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759850.928988:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212071168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.929149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759850.929198:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212071680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.929303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759850.929489:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212071296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759850.929521:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759850.929554:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212071808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759850.929579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759850.929613:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071680 00000100:00100000:2.0:1782759850.929621:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071680 00000100:00100000:2.0:1782759850.929674:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071296 00000100:00100000:2.0:1782759850.929677:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071296 00000100:00100000:2.0:1782759850.929699:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:2.0:1782759850.929707:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212071680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759850.929755:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212071680:12345-0@lo:400:kworker.0 Request processed in 49us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759850.929763:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:2.0:1782759850.929779:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1782759850.929785:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212071296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759850.929814:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212071296:12345-0@lo:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759850.929841:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1782759850.929875:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212071296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.931460:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212071680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759850.931500:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071168 00000100:00100000:3.0:1782759850.931507:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212071424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759850.931511:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071168 00000100:00100000:0.0:1782759850.931571:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:3.0:1782759850.931577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759850.931583:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212071168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.931609:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759850.931618:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212071552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.931644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759850.931676:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071424 00000100:00100000:3.0:1782759850.931680:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071424 00000100:00100000:3.0:1782759850.931710:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:3.0:1782759850.931717:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212071424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.931752:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212071424:12345-0@lo:400:kworker.0 Request processed in 36us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759850.931759:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00080000:3.0:1782759850.931778:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759850.931796:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071808 00000100:00100000:3.0:1782759850.931799:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071808 00000100:00100000:3.0:1782759850.931867:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071552 00000100:00100000:3.0:1782759850.931871:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071552 00000100:00100000:3.0:1782759850.931889:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:3.0:1782759850.931896:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212071808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.931932:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212071808:12345-0@lo:400:kworker.0 Request processed in 37us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759850.931939:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:3.0:1782759850.931949:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:3.0:1782759850.931955:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212071552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.931981:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212071552:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759850.931987:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:3.0:1782759850.932014:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212071552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759850.932023:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212071424:0@lo:400:kworker.0 00000100:00080000:3.0:1782759850.932046:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759850.932049:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759850.932067:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212071808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759850.932093:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212071168:12345-0@lo:400:kworker.0 Request processed in 511us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759850.932102:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1782759850.932692:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212071168:0@lo:400:kworker.0 00010000:00010000:3.0:1782759850.998416:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759851.437111:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212071936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759851.437204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759851.437364:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212071936 00000100:00100000:2.0:1782759851.437372:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212071936 00000100:00100000:2.0:1782759851.437437:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1782759851.437461:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212071936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759851.437495:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759851.437562:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212071936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759851.437570:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1782759851.437621:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212071936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759852.012767:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759852.332310:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759852.332319:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759852.332325:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759852.332366:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.332378:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.332398:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759852.332428:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212072064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759852.332491:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759852.332545:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759852.333332:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212072064 00000100:00100000:0.0:1782759852.333341:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212072064 00000100:00100000:0.0:1782759852.333401:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1782759852.333410:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212072064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759852.333961:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759852.333981:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0cf4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.334011:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.334024:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.334033:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74e00, rc 0) 00000100:00100000:0.0:1782759852.334105:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212072064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 696us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.334113:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:3.0:1782759852.337868:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212072064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759852.337902:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.337915:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759852.337940:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759852.337945:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.337952:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.038803:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759853.240990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759853.241044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759853.241052:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366400 00000100:00100000:2.0:1782759853.241063:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366400 00000100:00100000:1.0:1782759853.241080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759853.241105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759853.241124:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2827 00000100:00100000:1.0:1782759853.241125:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366272 00000100:00100000:1.0:1782759853.241128:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366272 00000100:00100000:2.0:1782759853.241135:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197366400:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759853.241153:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3048 00000100:00100000:1.0:1782759853.241159:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197366272:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759853.241206:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2363:x1869355197366400:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759853.241208:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366656 00000100:00100000:3.0:1782759853.241212:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366656 00000100:00100000:2.0:1782759853.241213:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2827 00000100:00080000:2.0:1782759853.241231:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759853.241235:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759853.241236:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366528 00000100:00100000:3.0:1782759853.241239:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366528 00000100:00100000:3.0:1782759853.241259:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2274 00000100:00100000:3.0:1782759853.241265:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197366656:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759853.247954:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2363:x1869355197366272:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 6782us (6860us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759853.247971:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3048 00000100:00100000:1.0:1782759853.248035:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2275 00000100:00100000:1.0:1782759853.248050:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197366528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759853.248105:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197366528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 61us (6999us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759853.248112:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2275 00000100:00100000:3.0:1782759853.256688:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197366656:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 15407us (15628us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759853.256723:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2274 00000100:00080000:2.0:1782759853.260529:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759853.905240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759853.909724:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197366784 00000100:00100000:3.0:1782759853.909745:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197366784 00000100:00100000:3.0:1782759853.909849:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2275 00000100:00100000:3.0:1782759853.909862:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:109025:x1869355197366784:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759853.909882:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759853.909905:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0d02 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67261 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.909970:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.909984:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.909997:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910011:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910019:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910027:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910670:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910691:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910699:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910705:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759853.910710:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910718:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910731:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759853.910734:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759853.910739:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910746:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd800/0xdd99f5c4777e0d09 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910757:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910763:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910769:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.910775:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759853.910785:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.911620:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.911634:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171908a1500) 00010000:00010000:3.0:1782759853.911638:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759853.911641:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.911647:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d10 lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.911700:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0d02 lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67261 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.911713:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759853.911715:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759853.911719:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0d02 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67261 expref: 6 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.911733:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759853.913005:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:109025:x1869355197366784:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3139us (7765us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759853.913016:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2275 00000100:00100000:2.0:1782759853.932503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759853.936277:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197367040 00000100:00100000:1.0:1782759853.936292:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197367040 00000100:00100000:1.0:1782759853.936367:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2276 00000100:00100000:1.0:1782759853.936378:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:109025:x1869355197367040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759853.936411:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759853.936434:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0d17 lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67268 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.936745:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 3/0,1 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.936771:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.936782:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.936795:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.936802:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.936809:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937863:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 3/1,0 mode: --/PR res: [0x200000418:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937877:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937887:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759853.937900:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x29:0x0]: returning size 0 00010000:00010000:1.0:1782759853.937925:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 3/0,1 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937932:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 2/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937939:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937950:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759853.937955:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 3/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937963:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 4/0,0 mode: CW/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937976:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171889c5600) 00010000:00010000:1.0:1782759853.937979:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759853.937983:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.937989:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030200/0xdd99f5c4777e0d1e lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759853.938000:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046a18a2d reply state 00000000214f49f9 transno 4294968180 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759853.938009:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759853.938041:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e0d17 lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.938061:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759853.938068:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:1.0:1782759853.938070:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759853.938072:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030600, rc 0) 00000100:00100000:1.0:1782759853.938152:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:109025:x1869355197367040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1776us (5659us total) trans 4294968180 rc 0/0 00000100:00100000:1.0:1782759853.938167:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2276 00010000:00010000:3.0:1782759853.943202:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.943229:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.943261:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.943270:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759853.943278:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.943288:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.943311:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff9171889c5500) 00010000:00010000:3.0:1782759853.943315:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759853.943320:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.943327:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031000/0xdd99f5c4777e0d25 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759853.953780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759853.962796:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197367296 00000100:00100000:0.0:1782759853.962812:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197367296 00000100:00100000:3.0:1782759853.964311:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2277 00000100:00100000:3.0:1782759853.964331:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:109025:x1869355197367296:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759853.964371:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759853.964406:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0d3a lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6726f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.964572:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.964591:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.964627:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 4/0,1 mode: --/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.964679:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759853.964697:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 8 pid: 146757 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759853.964716:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5802:1869355212072192:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759853.964893:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759853.970652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759853.970746:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197367424 00000100:00100000:0.0:1782759853.970762:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197367424 00000100:00100000:2.0:1782759853.970784:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5802:1869355212072192:192.168.204.31@tcp:104: 00010000:00010000:0.0:1782759853.970811:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 9 pid: 146757 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.970846:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759853.970893:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 714 00000100:00100000:0.0:1782759853.970907:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:2361:x1869355197367424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759853.970922:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759853.970930:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 9 pid: 146757 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759853.970962:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 9 pid: 146757 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759853.970985:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e0d2c lrc: 0/0,0 mode: --/PR res: [0x200000418:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67268 expref: 9 pid: 146757 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759853.971001:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:0.0:1782759853.971006:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: --/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759853.971014:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759853.971021:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 4/0,1 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759853.971051:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759853.971113:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197367424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 211us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759853.971121:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 714 00010000:00010000:2.0:1782759853.971366:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.971388:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759853.971416:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000418:0x29:0x0]: returning size 0 00010000:00010000:2.0:1782759853.971985:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,1 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.971996:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 2/0,0 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972004:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972010:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759853.972014:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 3/0,0 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972022:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 4/0,0 mode: EX/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972037:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff9171889c5a00) 00010000:00010000:2.0:1782759853.972041:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759853.972044:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 2/0,0 mode: --/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972051:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcca00/0xdd99f5c4777e0d41 lrc: 0/0,0 mode: --/EX res: [0x200000418:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972113:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0d3a lrc: 1/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6726f expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972123:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff9171908a1700) 00010000:00010000:2.0:1782759853.972125:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759853.972136:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0d3a lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6726f expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759853.972150:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:2.0:1782759853.972201:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:109025:x1869355197367296:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7876us (18433us total) trans 4294968181 rc 301/301 00000100:00100000:2.0:1782759853.972332:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2277 00000100:00100000:3.0:1782759853.980192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759853.980264:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197367680 00000100:00100000:1.0:1782759853.980276:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197367680 00000100:00100000:1.0:1782759853.980502:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00100000:1.0:1782759853.980513:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:109025:x1869355197367680:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759853.980778:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:109025:x1869355197367680:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 266us (594us total) trans 4294968182 rc 0/0 00000100:00100000:1.0:1782759853.980786:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 385 00000100:00100000:3.0:1782759853.986911:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759854.000930:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759854.000957:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212072320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759854.001026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759854.001067:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212072320 00000100:00100000:3.0:1782759854.001075:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212072320 00000100:00100000:3.0:1782759854.001133:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1782759854.001142:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212072320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759854.001179:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759854.001238:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212072320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759854.001246:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00080000:3.0:1782759854.001264:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759854.001311:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212072320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759854.002237:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197367936 00000100:00100000:0.0:1782759854.002245:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197367936 00000100:00100000:3.0:1782759854.004974:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 386 00000100:00100000:3.0:1782759854.004987:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:109025:x1869355197367936:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759854.005262:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:109025:x1869355197367936:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 276us (18361us total) trans 4294968183 rc 0/0 00000100:00100000:3.0:1782759854.005270:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 386 00010000:00010000:3.0:1782759854.060102:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759854.084946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759854.085066:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197368192 00000100:00100000:0.0:1782759854.085083:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197368192 00000100:00100000:0.0:1782759854.085153:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2278 00000100:00100000:0.0:1782759854.085165:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+9:109027:x1869355197368192:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1782759854.085194:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759854.085234:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0d4f lrc: 2/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67276 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085412:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 3/1,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085428:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085439:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085453:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 3/1,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085459:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085465:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085632:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085641:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085648:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759854.085768:0:7487:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1782759854.085773:0:7487:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 0 -> 1782759853 00000004:00010000:0.0:1782759854.085776:0:7487:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 0 -> 1782759853 00000004:00010000:0.0:1782759854.085784:0:7487:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 0 -> 1782759853 00000004:00010000:0.0:1782759854.085787:0:7487:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 18427282363563114435 -> 1 00002000:00010000:0.0:1782759854.085790:0:7487:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1782759854.085797:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 3/1,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085805:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 2/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085812:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.085818:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759854.086628:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 3/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086643:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 4/0,0 mode: CR/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086659:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x0 (ffff917182dd1100) 00010000:00010000:0.0:1782759854.086662:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759854.086667:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 2/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086674:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75200/0xdd99f5c4777e0d56 lrc: 0/0,0 mode: --/CR res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086693:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 3/1,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086699:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 2/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086720:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086725:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759854.086728:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 3/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086735:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 4/0,0 mode: PR/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086743:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x20:0x0].0x1143c7b5 (ffff917182dd1600) 00010000:00010000:0.0:1782759854.086746:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759854.086749:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 2/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.086755:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e0d5d lrc: 0/0,0 mode: --/PR res: [0x200000418:0x20:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759854.086961:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75e00/0xdd99f5c4777e0d4f lrc: 0/0,0 mode: --/CW res: [0x200000418:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759854.086982:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759854.086990:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:2.0:1782759854.086993:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1782759854.086995:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75000, rc 0) 00000100:00100000:2.0:1782759854.087074:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:109027:x1869355197368192:12345-192.168.204.31@tcp:101:dd.0 Request processed in 1910us (2138us total) trans 4294968184 rc 0/0 00000100:00100000:2.0:1782759854.087083:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2278 00000100:00100000:1.0:1782759854.100806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759854.100948:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197368448 00000100:00100000:3.0:1782759854.100962:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197368448 00000100:00100000:3.0:1782759854.101043:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2279 00000100:00100000:3.0:1782759854.101055:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+11:109027:x1869355197368448:12345-192.168.204.31@tcp:36:dd.0 00010000:00010000:3.0:1782759854.101186:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759854.101203:0:146757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759854.101212:0:146757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 4/0,1 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759854.101244:0:146757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759854.101258:0:146757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 11 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759854.101295:0:146757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b2dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:146757:1869355212072448:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759854.101730:0:146757:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759854.114259:0:146757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b2dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:146757:1869355212072448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1782759854.114293:0:146757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759854.115351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759854.117707:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197368576 00000100:00100000:0.0:1782759854.117721:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197368576 00010000:00010000:1.0:1782759854.117923:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 12 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759854.118033:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 715 00000100:00100000:1.0:1782759854.118044:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2362:x1869355197368576:12345-192.168.204.31@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1782759854.118060:0:7497:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 12 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759854.118083:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 12 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759854.118096:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 12 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759854.118105:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:1.0:1782759854.118119:0:7497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1782759854.118123:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759854.118133:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759854.118139:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 4/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759854.118178:0:7497:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 12 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759854.118248:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2362:x1869355197368576:12345-192.168.204.31@tcp:102:ldlm_bl.0 Request processed in 206us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.118255:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 715 00010000:00010000:3.0:1782759854.118322:0:146757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759854.118330:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759854.118514:0:146757:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1782759854.118527:0:146757:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:3.0:1782759854.118530:0:146757:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:3.0:1782759854.118533:0:146757:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:3.0:1782759854.118535:0:146757:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00010000:3.0:1782759854.118544:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0581985 reply state 00000000f784040c transno 4294968185 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759854.118553:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759854.118619:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:109027:x1869355197368448:12345-192.168.204.31@tcp:36:dd.0 Request processed in 17566us (17824us total) trans 4294968185 rc 0/0 00000100:00100000:3.0:1782759854.118626:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2279 00010000:00010000:0.0:1782759854.121194:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,1 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.121211:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 2/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.121219:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.121226:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759854.121231:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 3/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.121252:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 4/0,0 mode: PW/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.121270:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:0.0:1782759854.121273:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759854.121278:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 2/0,0 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759854.121284:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e0d72 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759854.125306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759854.125700:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197368704 00000100:00100000:3.0:1782759854.125714:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197368704 00002000:00010000:3.0:1782759854.125774:0:5814:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x200000418:0x29:0x0] 00002000:00100000:3.0:1782759854.125779:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b7dd2a00 with x1869355197368704 00000100:00100000:2.0:1782759854.125931:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1782759854.125952:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+12:2364:x1869355197368704:12345-192.168.204.31@tcp:10:dd.0 00000004:00010000:2.0:1782759854.126178:0:5816:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1782759854.126181:0:5816:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.126184:0:5816:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.126186:0:5816:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.126194:0:5816:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759854.126350:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2364:x1869355197368704:12345-192.168.204.31@tcp:10:dd.0 Request processed in 409us (1054us total) trans 4294968186 rc 0/0 00000100:00100000:2.0:1782759854.126359:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00002000:00010000:2.0:1782759854.126362:0:5816:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x200000418:0x29:0x0] 00002000:00100000:2.0:1782759854.126365:0:5816:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b7dd2a00 with x1869355197368704 00000100:00100000:3.0:1782759854.267971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759854.268210:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197368832 00000100:00100000:0.0:1782759854.268221:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197368832 00002000:00100000:0.0:1782759854.268276:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b2dff800 x1869355197368832/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/0 e 0 to 0 dl 1782759865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759854.268288:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b2dff800 with x1869355197368832 00000100:00100000:0.0:1782759854.268327:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1782759854.268336:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+13:2363:x1869355197368832:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:0.0:1782759854.321019:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 0 -> 1048576 00000004:00010000:0.0:1782759854.321031:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759854.321033:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759854.321035:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759854.321038:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782759854.326560:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:2363:x1869355197368832:12345-192.168.204.31@tcp:4:dd.0 Request processed in 58211us (58587us total) trans 4294968187 rc 0/0 00000100:00100000:0.0:1782759854.326576:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00002000:00100000:0.0:1782759854.326606:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b2dff800 x1869355197368832/t4294968187(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/448 e 0 to 0 dl 1782759865 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759854.326616:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b2dff800 with x1869355197368832 00000100:00100000:3.0:1782759854.345812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759854.346666:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197368960 00000100:00100000:2.0:1782759854.346679:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197368960 00000100:00100000:2.0:1782759854.346746:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2280 00000100:00100000:2.0:1782759854.346757:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+15:109027:x1869355197368960:12345-192.168.204.31@tcp:44:dd.0 00000001:00080000:0.0:1782759854.411796:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968187 is committed 00010000:00010000:2.0:1782759854.412064:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:0.0:1782759854.412307:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212072576:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759854.412372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759854.412488:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212072576 00000100:00100000:1.0:1782759854.412495:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212072576 00000100:00100000:1.0:1782759854.412539:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1782759854.412547:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198915c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212072576:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:1.0:1782759854.412575:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759854.413016:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:109027:x1869355197368960:12345-192.168.204.31@tcp:44:dd.0 Request processed in 66258us (67212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759854.413031:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2280 00000100:00100000:1.0:1782759854.415685:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198915c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212072576:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 3130us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.415699:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1782759854.416535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759854.418007:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369088 00000100:00100000:0.0:1782759854.418029:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369088 00000100:00100000:0.0:1782759854.418097:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2281 00000100:00100000:0.0:1782759854.418108:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197369088:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:0.0:1782759854.418237:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197369088:12345-192.168.204.31@tcp:16:dd.0 Request processed in 129us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759854.418244:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2281 00010000:00010000:1.0:1782759854.418590:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1782759854.418604:0:3307:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:1.0:1782759854.418632:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212072576:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759854.458932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759854.459187:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369216 00000100:00100000:2.0:1782759854.459197:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369216 00002000:00100000:2.0:1782759854.459250:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917083551c00 x1869355197369216/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/0 e 0 to 0 dl 1782759865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759854.459262:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917083551c00 with x1869355197369216 00000100:00100000:2.0:1782759854.459301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:2.0:1782759854.459311:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197369216:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:0.0:1782759854.480534:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:0.0:1782759854.480592:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212072704:0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759854.480652:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759854.480706:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759854.481009:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212072704 00000100:00100000:3.0:1782759854.481017:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212072704 00000100:00100000:3.0:1782759854.481081:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1782759854.481090:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212072704:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:3.0:1782759854.481120:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759854.481559:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212072704:12345-0@lo:601:mdt_io00_000.0 Request processed in 468us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759854.481567:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782759854.481870:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b33c3100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212072704:0@lo:601:mdt_io00_000.0 00010000:00010000:0.0:1782759854.481906:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1782759854.481916:0:5814:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 12 lru_type: 1 00000004:00010000:0.0:1782759854.518625:0:5814:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 1048576 -> 2097152 00000004:00010000:0.0:1782759854.518635:0:5814:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759854.518638:0:5814:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759854.518640:0:5814:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759854.518643:0:5814:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 1 -> 4105 00000100:00100000:0.0:1782759854.518737:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197369216:12345-192.168.204.31@tcp:4:dd.0 Request processed in 59421us (59810us total) trans 4294968188 rc 0/0 00000100:00100000:0.0:1782759854.518748:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00002000:00100000:0.0:1782759854.518784:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917083551c00 x1869355197369216/t4294968188(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/448 e 0 to 0 dl 1782759865 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759854.518795:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917083551c00 with x1869355197369216 00000001:00080000:0.0:1782759854.518863:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968188 is committed 00000100:00100000:3.0:1782759854.522805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759854.522928:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369344 00000100:00100000:1.0:1782759854.522939:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369344 00000100:00100000:1.0:1782759854.523000:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2282 00000100:00100000:1.0:1782759854.523010:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197369344:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:1.0:1782759854.523139:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197369344:12345-192.168.204.31@tcp:16:dd.0 Request processed in 130us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.523148:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2282 00000100:00100000:3.0:1782759854.557184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759854.557300:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369472 00000100:00100000:0.0:1782759854.557312:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369472 00002000:00100000:0.0:1782759854.557361:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917083553800 x1869355197369472/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/0 e 0 to 0 dl 1782759865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759854.557371:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917083553800 with x1869355197369472 00000100:00100000:0.0:1782759854.557409:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:0.0:1782759854.557419:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197369472:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:1.0:1782759854.569562:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 12 lru_type: 1 00000100:00100000:1.0:1782759854.569611:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7d08380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212072832:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759854.569667:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759854.569718:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2bc0300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759854.569901:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212072832 00000100:00100000:2.0:1782759854.569908:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212072832 00000100:00100000:2.0:1782759854.569956:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1782759854.569965:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212072832:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:2.0:1782759854.569993:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759854.570771:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212072832:12345-0@lo:601:mdt_io00_001.0 Request processed in 805us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759854.570791:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1782759854.570856:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7d08380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212072832:0@lo:601:mdt_io00_001.0 00010000:00010000:2.0:1782759854.570882:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 12 lru_type: 1 00010000:00010000:2.0:1782759854.570893:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 13 lru_type: 1 00000004:00010000:2.0:1782759854.571108:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 2097152 -> 3145728 00000004:00010000:2.0:1782759854.571111:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.571114:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.571116:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.571118:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 4105 -> 4105 00000100:00100000:2.0:1782759854.572633:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197369472:12345-192.168.204.31@tcp:4:dd.0 Request processed in 15211us (15453us total) trans 4294968189 rc 0/0 00000100:00100000:2.0:1782759854.572644:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00002000:00100000:2.0:1782759854.572655:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917083553800 x1869355197369472/t4294968189(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/448 e 0 to 0 dl 1782759865 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759854.572664:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917083553800 with x1869355197369472 00000100:00100000:3.0:1782759854.575630:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759854.575715:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369600 00000100:00100000:2.0:1782759854.575725:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369600 00000100:00100000:2.0:1782759854.576027:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2283 00000100:00100000:2.0:1782759854.576039:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197369600:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:2.0:1782759854.643948:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197369600:12345-192.168.204.31@tcp:16:dd.0 Request processed in 67898us (68312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759854.643964:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2283 00000001:00080000:1.0:1782759854.645957:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968189 is committed 00000100:00100000:0.0:1782759854.721503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759854.721870:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369728 00000100:00100000:2.0:1782759854.721880:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369728 00002000:00100000:2.0:1782759854.721935:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b33c3100 x1869355197369728/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/0 e 0 to 0 dl 1782759865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759854.721946:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b33c3100 with x1869355197369728 00000100:00100000:2.0:1782759854.721988:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1782759854.721999:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197369728:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:3.0:1782759854.743712:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 13 lru_type: 1 00000100:00100000:3.0:1782759854.743768:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212072960:0@lo:601:mdt_io00_000.0 00000100:00100000:3.0:1782759854.743989:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759854.744058:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759854.744374:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212072960 00000100:00100000:1.0:1782759854.744383:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212072960 00000100:00100000:1.0:1782759854.744440:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1782759854.744450:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212072960:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:1.0:1782759854.744493:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759854.748287:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212072960:12345-0@lo:601:mdt_io00_000.0 Request processed in 3828us (4287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.748301:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1782759854.755868:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212072960:0@lo:601:mdt_io00_000.0 00010000:00010000:3.0:1782759854.755923:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1782759854.755938:0:5814:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 14 lru_type: 1 00000004:00010000:3.0:1782759854.756304:0:5814:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 3145728 -> 4194304 00000004:00010000:3.0:1782759854.756308:0:5814:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:3.0:1782759854.756311:0:5814:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:3.0:1782759854.756313:0:5814:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:3.0:1782759854.756315:0:5814:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 4105 -> 6155 00000100:00100000:3.0:1782759854.756398:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197369728:12345-192.168.204.31@tcp:4:dd.0 Request processed in 34398us (34902us total) trans 4294968190 rc 0/0 00000100:00100000:3.0:1782759854.756407:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00002000:00100000:3.0:1782759854.756418:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b33c3100 x1869355197369728/t4294968190(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/448 e 0 to 0 dl 1782759865 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759854.756427:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b33c3100 with x1869355197369728 00000100:00100000:2.0:1782759854.761081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759854.761172:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369856 00000100:00100000:0.0:1782759854.761184:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369856 00000100:00100000:0.0:1782759854.761244:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2284 00000100:00100000:0.0:1782759854.761254:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197369856:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:2.0:1782759854.830496:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968190 is committed 00000100:00100000:3.0:1782759854.830726:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197369856:12345-192.168.204.31@tcp:16:dd.0 Request processed in 69468us (69650us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759854.830739:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2284 00000100:00100000:0.0:1782759854.897349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759854.897856:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197369984 00000100:00100000:2.0:1782759854.897867:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197369984 00002000:00100000:2.0:1782759854.897918:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b33c2680 x1869355197369984/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/0 e 0 to 0 dl 1782759865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759854.897930:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b33c2680 with x1869355197369984 00000100:00100000:2.0:1782759854.897967:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:2.0:1782759854.897977:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197369984:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759854.919665:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 14 lru_type: 1 00000100:00100000:2.0:1782759854.920033:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212073088:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759854.920103:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759854.920312:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171919cbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759854.920405:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073088 00000100:00100000:1.0:1782759854.920413:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073088 00000100:00100000:1.0:1782759854.920476:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782759854.920487:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212073088:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:1.0:1782759854.920522:0:5805:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759854.921907:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212073088:12345-0@lo:601:mdt_io00_001.0 Request processed in 1418us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.921918:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1782759854.922114:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212073088:0@lo:601:mdt_io00_001.0 00010000:00010000:2.0:1782759854.922204:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 14 lru_type: 1 00010000:00010000:2.0:1782759854.922217:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 15 lru_type: 1 00000004:00010000:2.0:1782759854.923611:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 4194304 -> 5242880 00000004:00010000:2.0:1782759854.923620:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.923622:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.923625:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759854.923627:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 6155 -> 8203 00000100:00100000:2.0:1782759854.923763:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197369984:12345-192.168.204.31@tcp:4:dd.0 Request processed in 25782us (26419us total) trans 4294968191 rc 0/0 00000100:00100000:2.0:1782759854.923907:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00002000:00100000:2.0:1782759854.923922:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b33c2680 x1869355197369984/t4294968191(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:260/0 lens 488/448 e 0 to 0 dl 1782759865 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759854.923932:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b33c2680 with x1869355197369984 00000100:00100000:0.0:1782759854.936730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759854.936861:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370112 00000100:00100000:1.0:1782759854.936870:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370112 00000100:00100000:1.0:1782759854.937043:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2285 00000100:00100000:1.0:1782759854.937054:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197370112:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:2.0:1782759855.030635:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968191 is committed 00000100:00100000:1.0:1782759855.031102:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197370112:12345-192.168.204.31@tcp:16:dd.0 Request processed in 94039us (94371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.031119:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2285 00000100:00100000:3.0:1782759855.066351:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759855.066478:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370240 00000100:00100000:2.0:1782759855.066490:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370240 00002000:00100000:2.0:1782759855.066562:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917083550700 x1869355197370240/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782759866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759855.066573:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917083550700 with x1869355197370240 00000100:00100000:2.0:1782759855.066613:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:2.0:1782759855.066623:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197370240:12345-192.168.204.31@tcp:4:dd.0 00000100:00080000:3.0:1782759855.067026:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759855.082282:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 15 lru_type: 1 00000100:00100000:3.0:1782759855.082335:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212073216:0@lo:601:mdt_io00_000.0 00000100:00100000:3.0:1782759855.082399:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759855.082509:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62240 going to sleep for 11 seconds 00010000:00010000:3.0:1782759855.084950:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759855.087969:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073216 00000100:00100000:1.0:1782759855.087983:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073216 00000100:00100000:1.0:1782759855.088557:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1782759855.088569:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212073216:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:1.0:1782759855.088610:0:121722:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759855.090651:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212073216:12345-0@lo:601:mdt_io00_000.0 Request processed in 2077us (8244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.090665:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1782759855.093348:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212073216:0@lo:601:mdt_io00_000.0 00010000:00010000:2.0:1782759855.093466:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 15 lru_type: 1 00010000:00010000:2.0:1782759855.093481:0:5814:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 16 lru_type: 1 00000004:00010000:2.0:1782759855.094647:0:5814:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 5242880 -> 6291456 00000004:00010000:2.0:1782759855.094654:0:5814:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759853 -> 1782759854 00000004:00010000:2.0:1782759855.094657:0:5814:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759855.094659:0:5814:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759853 -> 1782759854 00000004:00010000:2.0:1782759855.094662:0:5814:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 8203 -> 10253 00000100:00100000:2.0:1782759855.094948:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197370240:12345-192.168.204.31@tcp:4:dd.0 Request processed in 28320us (28603us total) trans 4294968192 rc 0/0 00000100:00100000:2.0:1782759855.094959:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00002000:00100000:2.0:1782759855.094971:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917083550700 x1869355197370240/t4294968192(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782759866 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759855.094980:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917083550700 with x1869355197370240 00000100:00100000:2.0:1782759855.098874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759855.098975:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370368 00000100:00100000:3.0:1782759855.098985:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370368 00000100:00100000:3.0:1782759855.099051:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2286 00000100:00100000:3.0:1782759855.099063:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197370368:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:0.0:1782759855.151353:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968192 is committed 00000100:00100000:3.0:1782759855.151687:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197370368:12345-192.168.204.31@tcp:16:dd.0 Request processed in 52620us (52819us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759855.151700:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2286 00000100:00100000:0.0:1782759855.183015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759855.183119:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370496 00000100:00100000:2.0:1782759855.183139:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370496 00002000:00100000:2.0:1782759855.183189:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171bbe30000 x1869355197370496/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782759866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759855.183200:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171bbe30000 with x1869355197370496 00000100:00100000:2.0:1782759855.183236:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:2.0:1782759855.183259:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197370496:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759855.193958:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 16 lru_type: 1 00000100:00100000:2.0:1782759855.194014:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212073344:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759855.194082:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759855.194140:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759855.194911:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073344 00000100:00100000:3.0:1782759855.194920:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073344 00000100:00100000:3.0:1782759855.194977:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1782759855.194986:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212073344:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:3.0:1782759855.195018:0:5804:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759855.201262:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212073344:12345-0@lo:601:mdt_io00_001.0 Request processed in 6266us (7169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759855.201279:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1782759855.201481:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7767100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212073344:0@lo:601:mdt_io00_001.0 00010000:00010000:1.0:1782759855.201534:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 16 lru_type: 1 00010000:00010000:1.0:1782759855.201997:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00000004:00010000:1.0:1782759855.203098:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 6291456 -> 7340032 00000004:00010000:1.0:1782759855.203106:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759854 -> 1782759854 00000004:00010000:1.0:1782759855.203108:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:1.0:1782759855.203110:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759854 -> 1782759854 00000004:00010000:1.0:1782759855.203113:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 10253 -> 12301 00000100:00100000:1.0:1782759855.203634:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197370496:12345-192.168.204.31@tcp:4:dd.0 Request processed in 20366us (20617us total) trans 4294968193 rc 0/0 00000100:00100000:1.0:1782759855.203650:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00002000:00100000:1.0:1782759855.203669:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171bbe30000 x1869355197370496/t4294968193(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782759866 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759855.203682:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171bbe30000 with x1869355197370496 00000100:00100000:1.0:1782759855.208045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759855.208436:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370624 00000100:00100000:2.0:1782759855.208458:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370624 00000100:00100000:2.0:1782759855.208650:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2287 00000100:00100000:2.0:1782759855.208662:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197370624:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:2.0:1782759855.257218:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197370624:12345-192.168.204.31@tcp:16:dd.0 Request processed in 48547us (49174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759855.257235:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2287 00000001:00080000:2.0:1782759855.257278:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968193 is committed 00000100:00100000:2.0:1782759855.288390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759855.289618:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370752 00000100:00100000:3.0:1782759855.289631:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370752 00002000:00100000:2.0:1782759855.289923:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917088cdaa00 x1869355197370752/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782759866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759855.289934:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917088cdaa00 with x1869355197370752 00000100:00100000:2.0:1782759855.290025:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:2.0:1782759855.290037:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197370752:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:0.0:1782759855.297161:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00000100:00100000:0.0:1782759855.297211:0:5814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212073472:0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759855.297264:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759855.297321:0:5814:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759855.297817:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073472 00000100:00100000:2.0:1782759855.297861:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073472 00000100:00100000:2.0:1782759855.297981:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1782759855.297990:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198915850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212073472:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:2.0:1782759855.298021:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759855.299011:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198915850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5814:x1869355212073472:12345-0@lo:601:mdt_io00_000.0 Request processed in 1018us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759855.299022:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1782759855.299150:0:5814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0000_UUID:5814:1869355212073472:0@lo:601:mdt_io00_000.0 00010000:00010000:0.0:1782759855.299187:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00010000:00010000:0.0:1782759855.299200:0:5814:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 18 lru_type: 1 00000004:00010000:0.0:1782759855.299480:0:5814:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 7340032 -> 8388608 00000004:00010000:0.0:1782759855.299484:0:5814:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759854 -> 1782759854 00000004:00010000:0.0:1782759855.299486:0:5814:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759855.299489:0:5814:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759854 -> 1782759854 00000004:00010000:0.0:1782759855.299491:0:5814:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 12301 -> 14351 00000100:00100000:0.0:1782759855.299548:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197370752:12345-192.168.204.31@tcp:4:dd.0 Request processed in 9511us (11240us total) trans 4294968194 rc 0/0 00000100:00100000:0.0:1782759855.299556:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00002000:00100000:0.0:1782759855.299565:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff917088cdaa00 x1869355197370752/t4294968194(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782759866 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759855.299582:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff917088cdaa00 with x1869355197370752 00010000:00010000:0.0:1782759855.300247:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 18 lru_type: 1 00000100:00100000:1.0:1782759855.301443:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212073600:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759855.301519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759855.304575:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073600 00000100:00100000:2.0:1782759855.304587:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073600 00000100:00100000:2.0:1782759855.304640:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1782759855.304650:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212073600:12345-0@lo:601:lquota_wb_lustr.0 00040000:00010000:2.0:1782759855.304685:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### preacquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759855.305208:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212073600:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 558us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759855.305216:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:1.0:1782759855.305393:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 18 lru_type: 1 00010000:00010000:1.0:1782759855.305405:0:3308:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 19 lru_type: 1 00000100:00100000:1.0:1782759855.305431:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212073600:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759855.305753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759855.305944:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197370880 00000100:00100000:3.0:1782759855.305951:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197370880 00000100:00100000:3.0:1782759855.306156:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2288 00000100:00100000:3.0:1782759855.306166:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197370880:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:2.0:1782759855.345174:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968194 is committed 00000100:00100000:1.0:1782759855.345503:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197370880:12345-192.168.204.31@tcp:16:dd.0 Request processed in 39331us (39746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.345516:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2288 00000100:00100000:0.0:1782759855.374576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759855.374691:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371008 00000100:00100000:1.0:1782759855.374703:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371008 00002000:00100000:1.0:1782759855.374772:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b311ed80 x1869355197371008/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782759866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782759855.374788:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311ed80 with x1869355197371008 00000100:00100000:1.0:1782759855.374876:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1782759855.374886:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197371008:12345-192.168.204.31@tcp:4:dd.0 00010000:00010000:2.0:1782759855.386286:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 19 lru_type: 1 00000100:00100000:2.0:1782759855.386339:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917088cd8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212073728:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759855.386395:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759855.386456:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7a8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759855.386539:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073728 00000100:00100000:0.0:1782759855.386546:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073728 00000100:00100000:0.0:1782759855.386601:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1782759855.386611:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212073728:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:0.0:1782759855.386640:0:154820:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff917180030a00/0xdd99f5c4777e0ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0c99 expref: 8 pid: 154820 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759855.387646:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:5815:x1869355212073728:12345-0@lo:601:mdt_io00_001.0 Request processed in 1032us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759855.387657:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1782759855.388273:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212073856:0@lo:106: 00000100:00100000:2.0:1782759855.388312:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759855.388367:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719834d540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759855.388404:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917088cd8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0000_UUID:5815:1869355212073728:0@lo:601:mdt_io00_001.0 00010000:00010000:2.0:1782759855.388438:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 19 lru_type: 1 00010000:00010000:2.0:1782759855.388463:0:5815:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 20 lru_type: 1 00000004:00010000:2.0:1782759855.388757:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 8388608 -> 9437184 00000004:00010000:2.0:1782759855.388779:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759854 -> 1782759854 00000004:00010000:2.0:1782759855.388781:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759855.388784:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759854 -> 1782759854 00000004:00010000:2.0:1782759855.388786:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 14351 -> 16401 00000100:00100000:2.0:1782759855.388877:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2363:x1869355197371008:12345-192.168.204.31@tcp:4:dd.0 Request processed in 13990us (14309us total) trans 4294968195 rc 0/0 00000100:00100000:2.0:1782759855.388885:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00002000:00100000:2.0:1782759855.388897:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b311ed80 x1869355197371008/t4294968195(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782759866 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759855.388905:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b311ed80 with x1869355197371008 00000100:00100000:0.0:1782759855.389474:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073856 00000100:00100000:0.0:1782759855.389481:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073856 00000100:00100000:0.0:1782759855.389525:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1782759855.389533:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5826:x1869355212073856:12345-0@lo:106: 00010000:00010000:0.0:1782759855.389544:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 20 lru_type: 1 00010000:00010000:0.0:1782759855.389552:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90200/0xdd99f5c4777e0c99 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd99f5c4777e0ca0 expref: -99 pid: 5816 timeout: 0 lvb_type: 2 lru_score: 20 lru_type: 1 00000100:00100000:0.0:1782759855.389623:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5826:x1869355212073856:12345-0@lo:106: Request processed in 90us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759855.389642:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1782759855.390055:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7dd1880 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:5826:1869355212073856:0@lo:106: 00000100:00100000:1.0:1782759855.394105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759855.394212:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371136 00000100:00100000:2.0:1782759855.394222:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371136 00000100:00100000:2.0:1782759855.394320:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2289 00000100:00100000:2.0:1782759855.394330:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197371136:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:0.0:1782759855.428669:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968195 is committed 00000100:00100000:1.0:1782759855.429088:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197371136:12345-192.168.204.31@tcp:16:dd.0 Request processed in 34753us (34987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.429101:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2289 00000100:00100000:2.0:1782759855.470276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759855.470376:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371264 00000100:00100000:0.0:1782759855.470387:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371264 00002000:00100000:0.0:1782759855.470456:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b7dd1880 x1869355197371264/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782759866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759855.470466:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b7dd1880 with x1869355197371264 00000100:00100000:0.0:1782759855.470507:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:0.0:1782759855.470516:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197371264:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:0.0:1782759855.482374:0:5814:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 9437184 -> 10485760 00000004:00010000:0.0:1782759855.482382:0:5814:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759854 -> 1782759854 00000004:00010000:0.0:1782759855.482385:0:5814:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:0.0:1782759855.482388:0:5814:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759854 -> 1782759854 00000004:00010000:0.0:1782759855.482390:0:5814:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 16401 -> 18449 00000100:00100000:0.0:1782759855.482535:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2362:x1869355197371264:12345-192.168.204.31@tcp:4:dd.0 Request processed in 12013us (12263us total) trans 4294968196 rc 0/0 00000100:00100000:0.0:1782759855.482546:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00002000:00100000:0.0:1782759855.482559:0:5814:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9171b7dd1880 x1869355197371264/t4294968196(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782759866 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759855.482569:0:5814:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9171b7dd1880 with x1869355197371264 00000100:00100000:2.0:1782759855.485706:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759855.485916:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371392 00000100:00100000:0.0:1782759855.485926:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371392 00000100:00100000:0.0:1782759855.485982:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2290 00000100:00100000:0.0:1782759855.485992:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917088cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197371392:12345-192.168.204.31@tcp:16:dd.0 00000001:00080000:1.0:1782759855.512174:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968196 is committed 00000100:00100000:1.0:1782759855.512325:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212073984:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759855.512395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759855.512476:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212073984 00000100:00100000:1.0:1782759855.512483:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212073984 00000100:00100000:1.0:1782759855.512521:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1782759855.512528:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212073984:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759855.513046:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917088cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197371392:12345-192.168.204.31@tcp:16:dd.0 Request processed in 27051us (27344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759855.513057:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2290 00000100:00100000:1.0:1782759855.519852:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212073984:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 7286us (7420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.519881:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1782759855.521072:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212073984:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759855.546726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759855.546944:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371520 00000100:00100000:0.0:1782759855.546954:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371520 00002000:00100000:0.0:1782759855.547007:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9170810b9500 x1869355197371520/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/0 e 0 to 0 dl 1782759866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759855.547019:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170810b9500 with x1869355197371520 00000100:00100000:0.0:1782759855.547059:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:0.0:1782759855.547070:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197371520:12345-192.168.204.31@tcp:4:dd.0 00000004:00010000:2.0:1782759855.574153:0:5815:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb size from disk: 10485760 -> 10485760 00000004:00010000:2.0:1782759855.574160:0:5815:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb mtime from disk: 1782759854 -> 1782759854 00000004:00010000:2.0:1782759855.574163:0:5815:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb atime from disk: 1782759853 -> 1782759853 00000004:00010000:2.0:1782759855.574165:0:5815:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb ctime from disk: 1782759854 -> 1782759854 00000004:00010000:2.0:1782759855.574167:0:5815:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x200000418:0x29:0x0] updating lvb blocks from disk: 18449 -> 20499 00000100:00100000:2.0:1782759855.574254:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2363:x1869355197371520:12345-192.168.204.31@tcp:4:dd.0 Request processed in 27181us (27533us total) trans 0 rc -122/-122 00000100:00100000:2.0:1782759855.574266:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00002000:00100000:2.0:1782759855.574280:0:5815:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x200000418:0x29:0x0] req@ffff9170810b9500 x1869355197371520/t0(0) o4->c5e146cd-50db-4b42-b3c2-9b1f84b4ef37@192.168.204.31@tcp:261/0 lens 488/448 e 0 to 0 dl 1782759866 ref 1 fl Complete:/600/0 rc -122/-122 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759855.574290:0:5815:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9170810b9500 with x1869355197371520 00000100:00100000:3.0:1782759855.581325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759855.581434:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371648 00000100:00100000:1.0:1782759855.581452:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371648 00000100:00100000:1.0:1782759855.581556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2291 00000100:00100000:1.0:1782759855.581565:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197371648:12345-192.168.204.31@tcp:16:dd.0 00000100:00100000:1.0:1782759855.581690:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197371648:12345-192.168.204.31@tcp:16:dd.0 Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.581698:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2291 00000100:00100000:2.0:1782759855.585341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759855.585455:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197371904 00000100:00100000:0.0:1782759855.585465:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197371904 00000100:00100000:0.0:1782759855.585552:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 398 00000100:00100000:0.0:1782759855.585563:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:109027:x1869355197371904:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:0.0:1782759855.586100:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:109027:x1869355197371904:12345-192.168.204.31@tcp:35:dd.0 Request processed in 537us (766us total) trans 4294968197 rc 0/0 00000100:00100000:0.0:1782759855.586110:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 398 00000100:00100000:3.0:1782759856.044572:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212074496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.044660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759856.044721:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759856.044727:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212074112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.044756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759856.044778:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212074624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.044802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759856.044850:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074496 00000100:00100000:3.0:1782759856.044858:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074496 00000100:00100000:3.0:1782759856.044909:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:3.0:1782759856.044917:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212074496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.044968:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212074496:12345-0@lo:400:kworker.0 Request processed in 51us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759856.044975:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:3.0:1782759856.045001:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074112 00000100:00100000:3.0:1782759856.045005:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074112 00000100:00100000:3.0:1782759856.045026:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1782759856.045032:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212074112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045061:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212074112:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759856.045068:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1782759856.045096:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074624 00000100:00100000:3.0:1782759856.045099:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074624 00000100:00100000:3.0:1782759856.045123:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1782759856.045130:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212074624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045161:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212074624:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759856.045176:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00080000:3.0:1782759856.045199:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759856.045204:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759856.045229:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212074112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045242:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212074624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045250:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212074496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045293:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212074240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759856.045338:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212074752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759856.045374:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759856.045380:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212074368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759856.045427:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074240 00000100:00100000:3.0:1782759856.045443:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074240 00000100:00100000:3.0:1782759856.045467:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074368 00000100:00100000:3.0:1782759856.045469:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074368 00000100:00100000:3.0:1782759856.045488:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1782759856.045493:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212074240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045527:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212074240:12345-0@lo:400:kworker.0 Request processed in 34us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759856.045532:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1782759856.045542:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:3.0:1782759856.045547:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212074368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045586:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212074368:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759856.045592:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:3.0:1782759856.045607:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074752 00000100:00100000:3.0:1782759856.045610:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074752 00000100:00100000:3.0:1782759856.045633:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:3.0:1782759856.045639:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212074752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045668:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212074752:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759856.045673:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00080000:3.0:1782759856.045692:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759856.045695:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759856.045709:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212074368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045718:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212074240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759856.045727:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212074752:0@lo:400:kworker.0 00010000:00010000:2.0:1782759856.108020:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759856.556054:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759856.556078:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212074880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759856.556151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759856.556234:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212074880 00000100:00100000:2.0:1782759856.556244:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212074880 00000100:00100000:2.0:1782759856.556303:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1782759856.556314:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212074880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759856.556357:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759856.556409:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212074880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759856.556416:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1782759856.556481:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212074880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759857.145582:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759858.156842:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759858.358265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759858.358308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759858.358353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759858.358383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759858.358424:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372416 00000100:00100000:0.0:1782759858.358433:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372416 00000100:00100000:0.0:1782759858.358489:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2278 00000100:00100000:0.0:1782759858.358499:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197372416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759858.358591:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197372416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759858.358600:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2278 00000100:00100000:0.0:1782759858.358616:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372288 00000100:00100000:0.0:1782759858.358619:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372288 00000100:00100000:0.0:1782759858.358646:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2279 00000100:00100000:0.0:1782759858.358652:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197372288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759858.358680:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197372288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759858.358686:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2279 00000100:00080000:0.0:1782759858.358702:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759858.358705:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759858.358737:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372032 00000100:00100000:0.0:1782759858.358741:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372032 00000100:00100000:0.0:1782759858.358762:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3050 00000100:00100000:0.0:1782759858.358769:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197372032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759858.358810:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197372032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759858.358816:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3050 00000100:00100000:3.0:1782759858.359072:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372160 00000100:00100000:3.0:1782759858.359077:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372160 00000100:00100000:3.0:1782759858.359119:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2831 00000100:00100000:3.0:1782759858.359125:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197372160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759858.359177:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:2361:x1869355197372160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759858.359184:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2831 00000100:00080000:0.0:1782759858.359880:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759859.119232:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212075008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759859.119321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759859.119532:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075008 00000100:00100000:0.0:1782759859.119541:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075008 00000100:00100000:0.0:1782759859.119605:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:0.0:1782759859.119616:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212075008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759859.119650:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759859.119698:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212075008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759859.119718:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00080000:1.0:1782759859.119775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759859.119819:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212075008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759859.186674:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759860.209742:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759860.698578:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968197 is committed 00000100:00100000:1.0:1782759861.167396:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759861.167419:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212075136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.167490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759861.167550:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075136 00000100:00100000:1.0:1782759861.167558:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075136 00000100:00100000:1.0:1782759861.167608:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:1.0:1782759861.167618:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212075136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.167872:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212075136:12345-0@lo:400:kworker.0 Request processed in 253us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759861.167881:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00000100:00100000:1.0:1782759861.167936:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212075136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.167978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759861.168000:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212075264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.168030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759861.169422:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075264 00000100:00100000:1.0:1782759861.169431:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075264 00000100:00100000:1.0:1782759861.169479:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:1.0:1782759861.169488:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212075264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.169553:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212075264:12345-0@lo:400:kworker.0 Request processed in 65us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759861.169560:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:1.0:1782759861.169601:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212075264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.169642:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212075392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.172896:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759861.172995:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212075520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759861.173061:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075520 00000100:00100000:1.0:1782759861.173069:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075520 00000100:00100000:1.0:1782759861.173122:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1782759861.173130:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212075520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173179:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212075520:12345-0@lo:400:kworker.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759861.173186:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00080000:1.0:1782759861.173208:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759861.173239:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212075520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173277:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212075648:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759861.173382:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075392 00000100:00100000:1.0:1782759861.173387:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075392 00000100:00100000:1.0:1782759861.173416:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075648 00000100:00100000:1.0:1782759861.173419:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075648 00000100:00100000:1.0:1782759861.173440:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:1.0:1782759861.173446:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212075392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173481:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212075392:12345-0@lo:400:kworker.0 Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759861.173487:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:1.0:1782759861.173500:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1782759861.173506:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212075648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173537:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212075648:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759861.173543:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00080000:1.0:1782759861.173566:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759861.173583:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212075648:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173607:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212075392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173642:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212075776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759861.173714:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075776 00000100:00100000:1.0:1782759861.173717:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075776 00000100:00100000:1.0:1782759861.173748:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:1.0:1782759861.173754:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212075776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759861.173790:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212075776:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759861.173796:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00080000:1.0:1782759861.173844:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759861.173865:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212075776:0@lo:400:kworker.0 00010000:00010000:0.0:1782759861.228241:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759861.676311:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759861.676349:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212075904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759861.676442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759861.676516:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212075904 00000100:00100000:0.0:1782759861.676524:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212075904 00000100:00100000:0.0:1782759861.676570:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:0.0:1782759861.676578:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212075904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759861.676614:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759861.676677:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212075904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759861.676685:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:0.0:1782759861.676741:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212075904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759862.258419:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759863.275999:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759863.500557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759863.500607:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372544 00000100:00100000:3.0:1782759863.500617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372544 00000100:00100000:3.0:1782759863.501513:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3052 00000100:00100000:3.0:1782759863.501529:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197372544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759863.501619:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197372544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759863.501628:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3052 00000100:00100000:3.0:1782759863.501689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759863.501850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759863.501880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759863.501902:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372672 00000100:00100000:3.0:1782759863.501906:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372672 00000100:00100000:3.0:1782759863.501951:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2835 00000100:00100000:3.0:1782759863.501958:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197372672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759863.502327:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197372672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 368us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759863.502335:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2835 00000100:00100000:3.0:1782759863.502358:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372928 00000100:00100000:3.0:1782759863.502362:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372928 00000100:00100000:3.0:1782759863.502391:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197372800 00000100:00100000:3.0:1782759863.502395:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197372800 00000100:00100000:3.0:1782759863.502419:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2282 00000100:00100000:3.0:1782759863.502502:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197372928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759863.502531:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197372928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759863.502544:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2282 00000100:00100000:3.0:1782759863.502557:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2283 00000100:00100000:3.0:1782759863.502563:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197372800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759863.502589:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2362:x1869355197372800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759863.502596:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2283 00000100:00080000:3.0:1782759863.502612:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759863.502614:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759863.502616:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759864.236059:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212076032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759864.236196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759864.236283:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076032 00000100:00100000:3.0:1782759864.236301:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076032 00000100:00080000:1.0:1782759864.236389:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759864.236417:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1782759864.236434:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212076032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759864.236491:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759864.236608:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212076032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759864.236618:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1782759864.236657:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212076032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759864.300346:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759864.458293:0:159836:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7749c960 20000000:00000080:1.0:1782759864.458314:0:159836:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9171b77a0c00 uarg=0000000000000000 20000000:01000000:1.0:1782759864.458357:0:159836:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1782759864.458359:0:159836:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1782759864.458361:0:159836:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.mdt=none' 20000000:01000000:1.0:1782759864.458367:0:159836:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.mdt=none' 20000000:01000000:1.0:1782759864.458371:0:159836:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.mdt=none' 20000000:01000000:1.0:1782759864.458388:0:159836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782759864.458390:0:159836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1782759864.458969:0:159836:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782759864.459158:0:159836:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.mdt fl=4 20000000:01000000:0.0:1782759864.464418:0:159837:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 14 marker 39 1->4: lustre quota.mdt 20000000:01000000:0.0:1782759864.464570:0:159837:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 39 2->4: lustre quota.mdt 00000040:00080000:0.0:1782759864.464802:0:159837:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 17 count 17 00000040:00080000:1.0:1782759864.465505:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11272 00000040:00080000:1.0:1782759864.465566:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 88 off11360 00000040:00080000:1.0:1782759864.465802:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11584 20000000:01000000:1.0:1782759864.465819:0:159836:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782759864.465942:0:159836:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.mdt fl=4 20000000:01000000:3.0:1782759864.468487:0:159838:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 53 marker 40 1->4: lustre quota.mdt 20000000:01000000:3.0:1782759864.468792:0:159838:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 55 marker 40 2->4: lustre quota.mdt 00000040:00080000:3.0:1782759864.468965:0:159838:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:1.0:1782759864.470185:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18240 00000040:00080000:1.0:1782759864.470245:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 88 off18328 00000040:00080000:1.0:1782759864.470318:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18552 20000000:01000000:1.0:1782759864.470335:0:159836:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782759864.470337:0:159836:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.mdt fl=4 20000000:01000000:3.0:1782759864.471964:0:159839:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 17 marker 41 1->4: lustre quota.mdt 20000000:01000000:3.0:1782759864.472186:0:159839:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 19 marker 41 2->4: lustre quota.mdt 00000040:00080000:3.0:1782759864.472223:0:159839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 20 00000040:00080000:1.0:1782759864.472946:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 224 off11800 00000040:00080000:1.0:1782759864.473110:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 88 off11888 00000040:00080000:1.0:1782759864.473142:0:159836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12112 10000000:01000000:1.0:1782759864.473160:0:159836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782759864.473189:0:159836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473217:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473227:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473236:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473244:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473251:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473258:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473265:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473285:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473292:0:159836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473300:0:159836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473351:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473369:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 18 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.473386:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076160:0@lo:104: 00000100:00100000:1.0:1782759864.473468:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759864.473610:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.473618:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 18 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.473626:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076288:0@lo:104: 00000100:00100000:1.0:1782759864.473649:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759864.474203:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.474212:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 18 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.474221:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076416:0@lo:104: 00000100:00100000:1.0:1782759864.474251:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759864.474338:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076160 00000100:00100000:2.0:1782759864.474348:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076160 00000100:00100000:2.0:1782759864.474403:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076288 00000100:00100000:2.0:1782759864.474407:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076288 00000100:00100000:2.0:1782759864.474430:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1782759864.474442:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159836:x1869355212076160:12345-0@lo:104: 00010000:00010000:2.0:1782759864.474461:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474525:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759864.474531:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159836:x1869355212076160:12345-0@lo:104: Request processed in 92us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.474538:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1782759864.474556:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1782759864.474562:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159836:x1869355212076288:12345-0@lo:104: 00010000:00010000:2.0:1782759864.474570:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474615:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759864.474620:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159836:x1869355212076288:12345-0@lo:104: Request processed in 59us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.474625:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00010000:00010000:2.0:1782759864.474646:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759864.474651:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474670:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.474684:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474693:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759864.474701:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759864.474707:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.474748:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474754:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759864.474778:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474784:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99000/0xdd99f5c4777e056f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0576 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474800:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759864.474803:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474809:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.474812:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474819:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759864.474877:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759864.474882:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.474898:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474904:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759864.474921:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474927:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99600/0xdd99f5c4777e0561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0568 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.474939:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.474940:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.474942:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.474947:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759864.474969:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212076544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.475014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759864.475080:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212076672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.475104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759864.475136:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076544 00000100:00100000:2.0:1782759864.475140:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076544 00010000:00010000:2.0:1782759864.475158:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 19 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.475177:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076672 00000100:00100000:2.0:1782759864.475187:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076672 00010000:00010000:2.0:1782759864.475203:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 20 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.475222:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1782759864.475228:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355212076544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.475238:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.475243:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 20 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475253:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 20 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475277:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.475306:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3306:x1869355212076544:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.475312:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1782759864.475324:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1782759864.475329:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212076672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.475337:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.475342:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 19 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475349:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 19 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475358:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.475382:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212076672:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.475398:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1782759864.475452:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212076672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.475482:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212076544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.475515:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1782759864.475519:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.475526:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076416 00000100:00100000:2.0:1782759864.475531:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076416 00010000:00010000:1.0:1782759864.475533:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 18 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.475557:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1782759864.475560:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076800:0@lo:104: 00000100:00100000:2.0:1782759864.475568:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b2b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159836:x1869355212076416:12345-0@lo:104: 00010000:00010000:2.0:1782759864.475577:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475611:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759864.475616:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b2b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159836:x1869355212076416:12345-0@lo:104: Request processed in 52us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.475623:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1782759864.475663:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759864.475670:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759864.475677:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475685:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.475689:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.475694:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475702:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.475708:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 18 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759864.475711:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.475721:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076928:0@lo:104: 10000000:01000000:2.0:1782759864.475731:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.475754:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475760:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759864.475771:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475777:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90c00/0xdd99f5c4777e0553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e055a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.475787:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.475789:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.475791:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759864.475799:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212077056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759864.475818:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759864.475856:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759864.475861:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.475872:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 18 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.475883:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077184:0@lo:104: 00000100:00100000:2.0:1782759864.475895:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212077056 00000100:00100000:2.0:1782759864.475901:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212077056 00000100:00100000:1.0:1782759864.475908:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759864.475921:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 19 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759864.475942:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076800 00000100:00100000:0.0:1782759864.475949:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076800 00000100:00100000:2.0:1782759864.475950:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1782759864.475961:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212077056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.475970:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.475975:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 19 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759864.475978:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212076928 00000100:00100000:0.0:1782759864.475983:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212076928 00000100:00100000:0.0:1782759864.475994:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212077184 00000100:00100000:0.0:1782759864.475996:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212077184 00000100:00100000:0.0:1782759864.476005:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1782759864.476011:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:159836:x1869355212076800:12345-0@lo:104: 00010000:00010000:1.0:1782759864.476013:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759864.476021:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.476027:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 19 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.476050:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077312:0@lo:104: 00000100:00100000:1.0:1782759864.476075:0:159836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759864.476117:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759864.476122:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:159836:x1869355212076800:12345-0@lo:104: Request processed in 112us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759864.476129:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1782759864.476149:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212077312 00000100:00100000:0.0:1782759864.476152:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212077312 00000100:00100000:0.0:1782759864.476163:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1782759864.476167:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:159836:x1869355212076928:12345-0@lo:104: 00010000:00010000:0.0:1782759864.476173:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759864.476207:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782759864.476212:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:159836:x1869355212076928:12345-0@lo:104: Request processed in 45us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759864.476217:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1782759864.476230:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1782759864.476245:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159836:x1869355212077184:12345-0@lo:104: 00010000:00010000:0.0:1782759864.476252:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759864.476285:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1782759864.476297:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159836:x1869355212077312:12345-0@lo:104: 00010000:00010000:0.0:1782759864.476301:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1782759864.476306:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759864.476308:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159836:x1869355212077184:12345-0@lo:104: Request processed in 72us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759864.476315:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00010000:00010000:3.0:1782759864.476354:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782759864.476360:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159836:x1869355212077312:12345-0@lo:104: Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759864.476366:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00010000:00010000:2.0:1782759864.476568:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 19 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.476644:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759864.476649:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.476669:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 9 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.476680:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077440:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759864.476809:0:159836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.476819:0:159836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.476850:0:159836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077568:192.168.204.31@tcp:104: 00000100:00100000:1.0:1782759864.476879:0:159836:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718637f300 going to sleep for 11 seconds 00010000:00010000:1.0:1782759864.476898:0:159836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bcee00/0xdd99f5c4777e0576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e056f expref: 19 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.476909:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076160:0@lo:104: 00010000:00010000:1.0:1782759864.476921:0:159836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c5c00/0xdd99f5c4777e0568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0561 expref: 18 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.476929:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076288:0@lo:104: 00010000:00010000:1.0:1782759864.476938:0:159836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e055a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0553 expref: 17 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.477015:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076416:0@lo:104: 00000100:00100000:1.0:1782759864.477028:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076800:0@lo:104: 00000100:00100000:1.0:1782759864.477035:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212076928:0@lo:104: 00000100:00100000:1.0:1782759864.477051:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077184:0@lo:104: 00000100:00100000:1.0:1782759864.477057:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077312:0@lo:104: 00000100:00100000:2.0:1782759864.477801:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3308:x1869355212077056:12345-0@lo:103:ldlm_bl.0 Request processed in 1838us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.477811:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1782759864.477849:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212077056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.477892:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782759864.477900:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.477908:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.477912:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.477923:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759864.477931:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759864.477937:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.477964:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.477971:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759864.478010:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478019:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99c00/0xdd99f5c4777e0545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e054c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.478023:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212077696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.478050:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782759864.478055:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478065:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.478068:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478075:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.478076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1782759864.478085:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759864.478091:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.478108:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478114:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759864.478120:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1782759864.478122:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478133:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99200/0xdd99f5c4777e0537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e053e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.478137:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212077824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.478143:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759864.478147:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.478166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759864.478167:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082f99e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.478172:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478185:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759864.478192:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759864.478198:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.478211:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478217:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759864.478235:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478243:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917082f99e00/0xdd99f5c4777e051b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0522 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478252:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759864.478255:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478260:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759864.478263:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478298:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759864.478305:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759864.478310:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759864.478323:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478328:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759864.478334:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478340:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90600/0xdd99f5c4777e050d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0514 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478352:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.478354:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759864.478355:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759864.478367:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212077696 00000100:00100000:2.0:1782759864.478371:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212077696 00010000:00010000:2.0:1782759864.478391:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 16 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.478411:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212077824 00000100:00100000:2.0:1782759864.478413:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212077824 00010000:00010000:2.0:1782759864.478423:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 17 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.478433:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212078080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.478444:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1782759864.478455:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759864.478461:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3305:x1869355212077696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759864.478467:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759864.478472:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212077952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.478474:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.478481:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 17 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478492:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 17 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.478500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759864.478508:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bcf000/0xdd99f5c4777e054c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0545 expref: 17 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478519:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.478555:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3305:x1869355212077696:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.478562:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1782759864.478576:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212077696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.478588:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078080 00000100:00100000:2.0:1782759864.478592:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078080 00010000:00010000:2.0:1782759864.478605:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 16 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.478616:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212077952 00000100:00100000:2.0:1782759864.478618:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212077952 00010000:00010000:2.0:1782759864.478627:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 17 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.478637:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1782759864.478642:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3305:x1869355212077824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.478649:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.478652:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 17 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478670:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 17 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478679:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4000/0xdd99f5c4777e053e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0537 expref: 17 pid: 5796 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478687:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.478722:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3305:x1869355212077824:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.478729:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1782759864.478764:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1782759864.478769:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3308:x1869355212078080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.478776:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.478780:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 15 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478789:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 15 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478799:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082f98200/0xdd99f5c4777e0514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e050d expref: 15 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478808:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.478863:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3308:x1869355212078080:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.478868:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1782759864.478879:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1782759864.478885:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3308:x1869355212077952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.478897:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.478901:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 13 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478909:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 13 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478919:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917082bce200/0xdd99f5c4777e0522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e051b expref: 13 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.478927:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.478945:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:3308:x1869355212077952:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.478951:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00010000:00010000:2.0:1782759864.478994:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759864.479009:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212077952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759864.479016:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212078080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.479032:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759864.479408:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212077824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759864.482212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759864.483815:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1782759864.483852:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373056 00000100:00100000:2.0:1782759864.483860:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373056 00010000:00010000:2.0:1782759864.483997:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 10 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.484036:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:2.0:1782759864.484046:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197373056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.484070:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.484076:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 10 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.484102:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 10 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.484124:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e0506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d9 expref: 10 pid: 5793 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.484140:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.484218:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2362:x1869355197373056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 168us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.484226:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:2.0:1782759864.486282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759864.486308:0:159836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159836:1869355212077568:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759864.486380:0:159836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759864.487108:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373184 00000100:00100000:3.0:1782759864.487117:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373184 00010000:00010000:2.0:1782759864.487372:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759864.488219:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00100000:2.0:1782759864.488231:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2361:x1869355197373184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759864.488248:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759864.488256:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488296:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488316:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171a93c4400/0xdd99f5c4777e04ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670d2 expref: 9 pid: 5794 timeout: 4032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488332:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488355:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488373:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488380:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488387:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488395:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488400:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759864.488405:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.488413:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.490191:0:159836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759864.490208:0:159836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.496917:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.496943:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0d79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.497084:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759864.497164:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2361:x1869355197373184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8930us (10896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.497189:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 724 00010000:00010000:0.0:1782759865.331553:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759866.095038:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759866.095045:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 55 10000000:01000000:3.0:1782759866.095050:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759866.095102:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.095113:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.095125:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.095156:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.095226:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.095283:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.095796:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078208 00000100:00100000:3.0:1782759866.095807:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078208 00000100:00100000:3.0:1782759866.095875:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1782759866.095884:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355212078208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.095897:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.095910:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0d80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.095946:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.095956:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.095966:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759866.096007:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212078208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.096013:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1782759866.096061:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.096074:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.096082:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.096129:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.096154:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.096169:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.096181:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078336 00000100:00100000:3.0:1782759866.096184:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078336 00000100:00100000:3.0:1782759866.096205:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:3.0:1782759866.096211:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212078336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.096467:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212078336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.096483:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:3.0:1782759866.096514:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.096541:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.096578:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.096590:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.096601:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078464 00000100:00100000:3.0:1782759866.096604:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078464 00000100:00100000:3.0:1782759866.096632:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1782759866.096638:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212078464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.096912:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212078464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.096919:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1782759866.096955:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759866.100967:0:159905:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:3.0:1782759866.102529:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:3.0:1782759866.102555:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759866.102567:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.102580:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759866.102590:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759866.102592:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 17 10000000:01000000:3.0:1782759866.102595:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759866.102631:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.102656:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.102669:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.102700:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.104973:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.105020:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.105157:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078592 00000100:00100000:3.0:1782759866.105166:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078592 00000100:00100000:3.0:1782759866.105209:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:3.0:1782759866.105217:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212078592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.105234:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.105259:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0d8e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.105285:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.105296:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.105306:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd200, rc 0) 00000100:00100000:3.0:1782759866.105349:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212078592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.105356:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:3.0:1782759866.111005:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.111036:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.111049:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.111122:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.111180:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.111217:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.117725:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078720 00000100:00100000:1.0:1782759866.117744:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078720 00000100:00100000:1.0:1782759866.117840:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:1.0:1782759866.117851:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212078720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.118146:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212078720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (6965us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.118153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00100000:3.0:1782759866.118655:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.118709:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.118777:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.118807:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.118840:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078848 00000100:00100000:3.0:1782759866.118844:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078848 00000100:00100000:3.0:1782759866.118872:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:3.0:1782759866.118878:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212078848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.119027:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212078848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.119034:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:3.0:1782759866.119069:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212078848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.138035:0:159906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159906:1869355212078976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759866.138125:0:159906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.138171:0:159906:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759866.139403:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212078976 00000100:00100000:2.0:1782759866.139415:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212078976 00000100:00100000:2.0:1782759866.139471:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:2.0:1782759866.139481:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:159906:x1869355212078976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759866.139774:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:159906:x1869355212078976:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.139782:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00100000:2.0:1782759866.139881:0:159906:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159906:1869355212078976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759866.139915:0:159906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759866.139925:0:159906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759866.139927:0:159906:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre quota.mdt 00000020:00000080:2.0:1782759866.139932:0:159906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759866.139962:0:159906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082cba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159906:1869355212079104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759866.139998:0:159906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759866.140015:0:159906:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.140363:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079104 00000100:00100000:3.0:1782759866.140368:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079104 00000100:00100000:3.0:1782759866.140415:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:3.0:1782759866.140424:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:159906:x1869355212079104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759866.141650:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:159906:x1869355212079104:12345-0@lo:502:llog_process_th.0 Request processed in 1221us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.141660:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00100000:1.0:1782759866.146786:0:159906:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082cba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159906:1869355212079104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759866.146848:0:159906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759866.146859:0:159906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759866.146861:0:159906:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre quota.mdt 00000040:00080000:1.0:1782759866.146865:0:159906:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 20 count 20 00000020:01000000:3.0:1782759866.147135:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 17-19 (rc=0) 10000000:01000000:3.0:1782759866.147155:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782759866.147166:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.147178:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759866.147189:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759866.147191:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 55 10000000:01000000:3.0:1782759866.147194:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759866.147225:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.147243:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.147253:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.147273:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.147332:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.147366:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.147382:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079232 00000100:00100000:3.0:1782759866.147388:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079232 00000100:00100000:3.0:1782759866.147424:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:3.0:1782759866.147441:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212079232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.147454:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.147466:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0d9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.147490:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.147500:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.147509:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759866.147542:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212079232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.147549:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:1.0:1782759866.151514:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759866.151543:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.155533:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759866.155647:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.155715:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.155784:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.155918:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079360 00000100:00100000:1.0:1782759866.155927:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079360 00000100:00100000:1.0:1782759866.155963:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:1.0:1782759866.155971:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.159002:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.159076:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.159171:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.159210:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.159873:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079488 00000100:00100000:3.0:1782759866.159883:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079488 00000100:00100000:3.0:1782759866.159918:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:3.0:1782759866.159927:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.160147:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.160155:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00000100:00100000:3.0:1782759866.160259:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.160801:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212079360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4828us (5083us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.160811:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000040:00080000:1.0:1782759866.165818:0:159908:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:3.0:1782759866.166190:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:3.0:1782759866.166218:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759866.166230:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166265:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759866.166276:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782759866.166278:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 20 10000000:01000000:3.0:1782759866.166281:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759866.166314:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166323:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166335:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.166360:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.166426:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.166469:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.166581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759866.166605:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079616 00000100:00100000:3.0:1782759866.166610:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079616 00000100:00100000:3.0:1782759866.166641:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373312 00000100:00100000:3.0:1782759866.166643:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373312 00000100:00100000:3.0:1782759866.166658:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:3.0:1782759866.166666:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212079616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.166679:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.166691:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0daa expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166726:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166736:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166746:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd000, rc 0) 00000100:00100000:3.0:1782759866.166794:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.166801:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:3.0:1782759866.166847:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3065 00000100:00100000:3.0:1782759866.166854:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197373312:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.166860:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.166868:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6727d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166881:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166890:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166896:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759866.166933:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197373312:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.166939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3065 00000100:00100000:3.0:1782759866.166971:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.166990:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.166999:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.167041:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.167063:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.167075:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.167168:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079744 00000100:00100000:3.0:1782759866.167172:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079744 00000100:00100000:3.0:1782759866.167192:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:3.0:1782759866.167198:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.167454:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.167461:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:3.0:1782759866.167489:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.167515:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.167551:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.167564:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.167575:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212079872 00000100:00100000:3.0:1782759866.167578:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212079872 00000100:00100000:3.0:1782759866.167592:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:3.0:1782759866.167597:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.167737:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212079872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.167751:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00100000:3.0:1782759866.167785:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212079872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.172925:0:159909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159909:1869355212080000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759866.173011:0:159909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.173042:0:159909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.175305:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080000 00000100:00100000:3.0:1782759866.175315:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080000 00000100:00100000:3.0:1782759866.175442:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:3.0:1782759866.175452:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:159909:x1869355212080000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759866.175718:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:159909:x1869355212080000:12345-0@lo:502:llog_process_th.0 Request processed in 266us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.175726:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00100000:3.0:1782759866.175797:0:159909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159909:1869355212080000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759866.175852:0:159909:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759866.175862:0:159909:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759866.175864:0:159909:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre quota.mdt 00000020:00000080:3.0:1782759866.175871:0:159909:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759866.175909:0:159909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159909:1869355212080128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759866.175949:0:159909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.175972:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080128 00000100:00100000:3.0:1782759866.175975:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080128 00000100:00100000:3.0:1782759866.175993:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:3.0:1782759866.175998:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:159909:x1869355212080128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759866.176101:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:159909:x1869355212080128:12345-0@lo:502:llog_process_th.0 Request processed in 101us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.176107:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:3.0:1782759866.176142:0:159909:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.176154:0:159909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159909:1869355212080128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759866.176177:0:159909:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759866.176181:0:159909:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759866.176183:0:159909:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre quota.mdt 00000040:00080000:3.0:1782759866.176187:0:159909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 23 count 23 00000100:00100000:0.0:1782759866.179455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759866.179508:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373440 00000100:00100000:0.0:1782759866.179517:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373440 00000100:00100000:0.0:1782759866.179566:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3070 00000100:00100000:0.0:1782759866.179575:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197373440:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000020:01000000:3.0:1782759866.180009:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 20-22 (rc=0) 10000000:01000000:3.0:1782759866.180034:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759866.180046:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180057:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759866.180067:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759866.180069:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 55 10000000:01000000:3.0:1782759866.180072:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759866.180105:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180114:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180122:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.180155:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.180204:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.180248:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2f0e900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.180264:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080256 00000100:00100000:3.0:1782759866.180268:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080256 00000100:00100000:3.0:1782759866.180293:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:3.0:1782759866.180308:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212080256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.180317:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.180328:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0dbf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180351:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180362:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180371:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcce00, rc 0) 00000100:00100000:3.0:1782759866.180403:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212080256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.180410:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000100:00100000:3.0:1782759866.180452:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.180464:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.180473:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.180515:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.180535:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.180546:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b2f0e900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.180554:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080384 00000100:00100000:3.0:1782759866.180557:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080384 00000100:00100000:3.0:1782759866.180572:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:3.0:1782759866.180583:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212080384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.181367:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197373440:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 1788us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.181377:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3070 00000100:00100000:3.0:1782759866.181590:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212080384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1006us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.181597:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1782759866.182264:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.182312:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.182361:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.182392:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.183112:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080512 00000100:00100000:3.0:1782759866.183119:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080512 00000100:00100000:3.0:1782759866.183165:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:3.0:1782759866.183173:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212080512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.183346:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212080512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.183353:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00100000:3.0:1782759866.183394:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.185064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759866.185092:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373568 00000100:00100000:3.0:1782759866.185099:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373568 00000100:00100000:3.0:1782759866.185148:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3074 00000100:00100000:3.0:1782759866.185158:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197373568:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.185370:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197373568:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 213us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.185378:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3074 00000100:00100000:0.0:1782759866.200461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759866.214017:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373696 00000100:00100000:3.0:1782759866.214034:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373696 00000100:00100000:3.0:1782759866.217967:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3075 00000100:00100000:3.0:1782759866.217995:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197373696:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.218015:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.218051:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67284 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.218085:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.218097:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.218107:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:3.0:1782759866.218180:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197373696:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 200us (17733us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.218188:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3075 00000040:00080000:2.0:1782759866.218351:0:159911:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:3.0:1782759866.220507:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:3.0:1782759866.220545:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759866.220557:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.220569:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759866.220581:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759866.220584:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:3.0:1782759866.220586:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759866.220623:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.220633:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.220661:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.220687:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.221130:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.221202:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.222760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759866.229728:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080640 00000100:00100000:0.0:1782759866.229748:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080640 00000100:00100000:0.0:1782759866.233555:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373824 00000100:00100000:0.0:1782759866.233572:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373824 00000100:00100000:0.0:1782759866.233594:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1782759866.233603:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212080640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759866.233623:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759866.233659:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0dd4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.233698:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.233709:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.233719:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74600, rc 0) 00000100:00100000:0.0:1782759866.233839:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212080640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (12690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.233848:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1782759866.233882:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3077 00000100:00100000:0.0:1782759866.233889:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197373824:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.233974:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.234007:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.234018:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.234098:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.234149:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.234159:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197373824:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 269us (11404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759866.234168:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3077 00000100:00100000:3.0:1782759866.234185:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759866.234191:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080768 00000100:00100000:0.0:1782759866.234196:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080768 00000100:00100000:0.0:1782759866.234217:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1782759866.234225:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212080768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759866.234381:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212080768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.234387:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:3.0:1782759866.234533:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.234776:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.234819:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.234864:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.234875:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212080896 00000100:00100000:3.0:1782759866.234879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212080896 00000100:00100000:3.0:1782759866.234905:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079 00000100:00100000:3.0:1782759866.234912:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212080896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.237922:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212080896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2993us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.237943:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079 00000100:00100000:1.0:1782759866.238017:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212080896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.239000:0:159912:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159912:1869355212081024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759866.239068:0:159912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.239099:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081024 00000100:00100000:1.0:1782759866.239105:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081024 00000100:00100000:1.0:1782759866.239138:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:1.0:1782759866.239147:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:159912:x1869355212081024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759866.239412:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:159912:x1869355212081024:12345-0@lo:502:llog_process_th.0 Request processed in 265us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.239419:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00100000:1.0:1782759866.239472:0:159912:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.239488:0:159912:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159912:1869355212081024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759866.239514:0:159912:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759866.239528:0:159912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759866.239531:0:159912:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre quota.mdt 00000020:00000080:1.0:1782759866.239536:0:159912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782759866.239558:0:159912:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159912:1869355212081152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759866.239590:0:159912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.239609:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081152 00000100:00100000:1.0:1782759866.239612:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081152 00000100:00100000:1.0:1782759866.239628:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081 00000100:00100000:1.0:1782759866.239634:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:159912:x1869355212081152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759866.239753:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:159912:x1869355212081152:12345-0@lo:502:llog_process_th.0 Request processed in 118us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.239905:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081 00000100:00100000:1.0:1782759866.239935:0:159912:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.239947:0:159912:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:159912:1869355212081152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759866.239964:0:159912:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759866.239969:0:159912:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759866.239970:0:159912:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre quota.mdt 00000040:00080000:1.0:1782759866.239973:0:159912:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:3.0:1782759866.240168:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:3.0:1782759866.240187:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782759866.240199:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.240210:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759866.240220:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782759866.240223:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759866.240226:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782759866.240261:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.240269:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.240278:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.240293:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212081280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.240323:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.240478:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.241020:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081280 00000100:00100000:1.0:1782759866.241027:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081280 00000100:00100000:1.0:1782759866.241061:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:1.0:1782759866.241068:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212081280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759866.241081:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759866.241093:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0de2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.241115:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.241142:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.241151:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031a00, rc 0) 00000100:00100000:1.0:1782759866.241190:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212081280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.241197:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000100:00100000:3.0:1782759866.241972:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212081280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759866.241988:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.242006:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.242066:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212081408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759866.242103:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.242132:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.242877:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081408 00000100:00100000:1.0:1782759866.242886:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081408 00000100:00100000:1.0:1782759866.242936:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083 00000100:00100000:1.0:1782759866.242945:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212081408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759866.243193:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212081408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (1088us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759866.243201:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083 00000100:00100000:3.0:1782759866.243948:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212081408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759866.243979:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759866.243988:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.243999:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759866.284111:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212081536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.284170:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212081664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.284250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759866.284254:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212081920:0@lo:400:kworker.0 00000100:00100000:2.0:1782759866.284305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759866.284365:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759866.284374:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212081792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.284379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759866.284407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.285293:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081792 00000100:00100000:3.0:1782759866.285303:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081792 00000100:00100000:3.0:1782759866.285355:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:3.0:1782759866.285363:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212081792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759866.285425:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212081792:12345-0@lo:400:kworker.0 Request processed in 62us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.285433:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00080000:3.0:1782759866.285452:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759866.285658:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212081792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.293502:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212082048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.293575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.298316:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081664 00000100:00100000:1.0:1782759866.298333:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081664 00000100:00100000:2.0:1782759866.303664:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081920 00000100:00100000:2.0:1782759866.303682:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081920 00000100:00100000:0.0:1782759866.309528:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212081536 00000100:00100000:0.0:1782759866.309541:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212081536 00000100:00100000:0.0:1782759866.309573:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1782759866.309583:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212081664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.309690:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212081664:12345-0@lo:400:kworker.0 Request processed in 109us (25441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.309698:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1782759866.309717:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:0.0:1782759866.309723:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212081536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.309758:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91718796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212081536:12345-0@lo:400:kworker.0 Request processed in 35us (25381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.309764:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:0.0:1782759866.309809:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212081664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759866.309873:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212081536:0@lo:400:kworker.0 00000100:00100000:2.0:1782759866.313470:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212082048 00000100:00100000:2.0:1782759866.313486:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212082048 00000100:00100000:2.0:1782759866.313583:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1782759866.313595:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212082048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759866.313711:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212082048:12345-0@lo:400:kworker.0 Request processed in 117us (20134us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.313718:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1782759866.313797:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212082048:0@lo:400:kworker.0 00000100:00080000:1.0:1782759866.313925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759866.313930:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759866.314271:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759866.314304:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1782759866.314311:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212081920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759866.314415:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212081920:12345-0@lo:400:kworker.0 Request processed in 104us (30114us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.314422:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1782759866.314453:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212081920:0@lo:400:kworker.0 00010000:00010000:2.0:1782759866.351388:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759866.796178:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759866.796200:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212082176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759866.796286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.796359:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212082176 00000100:00100000:0.0:1782759866.796367:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212082176 00000100:00100000:0.0:1782759866.796412:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1782759866.796420:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212082176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759866.796460:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759866.796507:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212082176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.796532:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1782759866.796868:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212082176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759867.373889:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759868.198091:0:159990:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff20c23fd0 20000000:00000080:1.0:1782759868.198109:0:159990:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9171b347e400 uarg=0000000000000000 20000000:01000000:1.0:1782759868.198149:0:159990:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1782759868.198152:0:159990:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1782759868.198155:0:159990:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=none' 20000000:01000000:1.0:1782759868.198160:0:159990:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.ost=none' 20000000:01000000:1.0:1782759868.198166:0:159990:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.ost=none' 20000000:01000000:1.0:1782759868.198181:0:159990:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782759868.198189:0:159990:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1782759868.198388:0:159990:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782759868.198392:0:159990:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:3.0:1782759868.199422:0:159991:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 11 marker 36 1->4: lustre quota.ost 20000000:01000000:3.0:1782759868.199530:0:159991:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 36 2->4: lustre quota.ost 00000040:00080000:3.0:1782759868.199594:0:159991:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 20 count 20 00000040:00080000:1.0:1782759868.200287:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11808 00000040:00080000:1.0:1782759868.200336:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 88 off11896 00000040:00080000:1.0:1782759868.200375:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12120 20000000:01000000:1.0:1782759868.200388:0:159990:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782759868.200391:0:159990:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1782759868.201030:0:159992:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 37 1->4: lustre quota.ost 20000000:01000000:1.0:1782759868.201087:0:159992:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 37 2->4: lustre quota.ost 00000040:00080000:1.0:1782759868.201144:0:159992:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000040:00080000:0.0:1782759868.201634:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].59, 224 off18776 00000040:00080000:0.0:1782759868.201679:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].60, 88 off18864 00000040:00080000:0.0:1782759868.202345:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].61, 224 off19088 20000000:01000000:0.0:1782759868.202365:0:159990:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782759868.202368:0:159990:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:0.0:1782759868.203264:0:159993:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 14 marker 38 1->4: lustre quota.ost 20000000:01000000:0.0:1782759868.203335:0:159993:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 38 2->4: lustre quota.ost 00000040:00080000:0.0:1782759868.203396:0:159993:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 23 count 23 00000040:00080000:1.0:1782759868.204092:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 224 off12336 00000040:00080000:1.0:1782759868.204151:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 88 off12424 00000040:00080000:1.0:1782759868.204191:0:159990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12648 10000000:01000000:1.0:1782759868.204223:0:159990:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782759868.204245:0:159990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204265:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204274:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204281:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204288:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204297:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204319:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204326:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204334:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204341:0:159990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204351:0:159990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204395:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.204410:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 18 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.204426:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082304:0@lo:104: 00000100:00100000:1.0:1782759868.204746:0:159990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759868.204816:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.205003:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 18 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.205028:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082432:0@lo:104: 00000100:00100000:1.0:1782759868.205054:0:159990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759868.205133:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.205143:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 9 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.205153:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082560:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759868.205234:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.205244:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 18 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.205253:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082688:0@lo:104: 00000100:00100000:1.0:1782759868.205281:0:159990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759868.206070:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.206082:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 9 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.206093:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082816:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759868.206139:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.206160:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 18 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.206168:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082944:0@lo:104: 00010000:00010000:1.0:1782759868.206206:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.206214:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 18 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.206221:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212083072:0@lo:104: 00010000:00010000:1.0:1782759868.206247:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.206255:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 18 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.206263:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212083200:0@lo:104: 00010000:00010000:1.0:1782759868.206295:0:159990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.206303:0:159990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 18 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.206309:0:159990:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212083328:0@lo:104: 00000100:00100000:1.0:1782759868.206328:0:159990:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759868.206385:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759868.206407:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.206436:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.206444:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.206466:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.206479:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212082304 00000100:00100000:3.0:1782759868.206486:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212082304 00000100:00100000:3.0:1782759868.206523:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212082432 00000100:00100000:3.0:1782759868.206526:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212082432 00000100:00100000:3.0:1782759868.206537:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212082688 00000100:00100000:3.0:1782759868.206539:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212082688 00000100:00100000:3.0:1782759868.206548:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212082944 00000100:00100000:3.0:1782759868.206550:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212082944 00000100:00100000:3.0:1782759868.206558:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083072 00000100:00100000:3.0:1782759868.206560:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083072 00000100:00100000:3.0:1782759868.206569:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083200 00000100:00100000:3.0:1782759868.206571:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083200 00000100:00100000:3.0:1782759868.206581:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083328 00000100:00100000:3.0:1782759868.206583:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083328 00000100:00100000:3.0:1782759868.206597:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1782759868.206605:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+9:159990:x1869355212082304:12345-0@lo:104: 00010000:00010000:3.0:1782759868.206619:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.206688:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759868.206695:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+9:159990:x1869355212082304:12345-0@lo:104: Request processed in 91us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.206702:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1782759868.206720:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1782759868.206727:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+8:159990:x1869355212082432:12345-0@lo:104: 00010000:00010000:3.0:1782759868.206735:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.206769:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759868.206775:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+8:159990:x1869355212082432:12345-0@lo:104: Request processed in 49us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.206781:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1782759868.206793:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1782759868.206799:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917190484450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+7:159990:x1869355212082688:12345-0@lo:104: 00010000:00010000:3.0:1782759868.206807:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.206879:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782759868.206884:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917190484450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+7:159990:x1869355212082688:12345-0@lo:104: Request processed in 86us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.206890:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1782759868.206996:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1782759868.207008:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+6:159990:x1869355212082944:12345-0@lo:104: 00010000:00010000:0.0:1782759868.207017:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759868.207054:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782759868.207059:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+6:159990:x1869355212082944:12345-0@lo:104: Request processed in 56us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.207065:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1782759868.207080:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1782759868.207086:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:159990:x1869355212083072:12345-0@lo:104: 00010000:00010000:0.0:1782759868.207093:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759868.207118:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1782759868.207122:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+5:159990:x1869355212083072:12345-0@lo:104: Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.207128:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1782759868.207140:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1782759868.207155:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159990:x1869355212083200:12345-0@lo:104: 00010000:00010000:0.0:1782759868.207162:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759868.207206:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1782759868.207211:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+4:159990:x1869355212083200:12345-0@lo:104: Request processed in 58us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.207217:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1782759868.207230:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1782759868.207236:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159990:x1869355212083328:12345-0@lo:104: 00010000:00010000:0.0:1782759868.207243:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759868.207272:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1782759868.207277:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:159990:x1869355212083328:12345-0@lo:104: Request processed in 41us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.207282:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00010000:00010000:3.0:1782759868.207674:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782759868.207681:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207701:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759868.207706:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207715:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759868.207723:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759868.207730:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759868.207777:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207785:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759868.207809:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207817:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e0de2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0de9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207861:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782759868.207865:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207871:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759868.207874:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.207891:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759868.207897:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.208039:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082304:0@lo:104: 00000100:00100000:1.0:1782759868.208060:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082432:0@lo:104: 00000100:00100000:1.0:1782759868.208068:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082688:0@lo:104: 00000100:00100000:1.0:1782759868.208074:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082944:0@lo:104: 00000100:00100000:1.0:1782759868.208080:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212083072:0@lo:104: 00000100:00100000:1.0:1782759868.208086:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212083200:0@lo:104: 00000100:00100000:1.0:1782759868.208093:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212083328:0@lo:104: 10000000:01000000:3.0:1782759868.208177:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759868.208239:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208245:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759868.208251:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208257:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd600/0xdd99f5c4777e0dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0ddb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208266:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782759868.208269:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208273:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcca00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759868.208276:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208283:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759868.208289:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759868.208300:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759868.208353:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782759868.208360:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.208366:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759868.208368:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.208375:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759868.208382:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759868.208387:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759868.208446:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208452:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759868.208475:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208482:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcca00/0xdd99f5c4777e0dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0dc6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208491:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782759868.208494:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208499:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcda00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759868.208501:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208508:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759868.208513:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759868.208518:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759868.208540:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208545:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759868.208558:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208564:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcda00/0xdd99f5c4777e0d9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0da3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208573:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759868.208575:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208580:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759868.208583:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208589:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759868.208594:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759868.208599:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759868.208612:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208617:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759868.208621:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208627:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0d8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208634:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759868.208642:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208647:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759868.208650:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208656:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759868.208661:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759868.208666:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759868.208678:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208684:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759868.208688:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208694:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd800/0xdd99f5c4777e0d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0d87 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.208702:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759868.208703:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759868.208705:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759868.208719:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212083456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.208763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.208796:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212083968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.208851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.208878:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759868.208884:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212083584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.208909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.208925:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212084096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.208944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.208973:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212083840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.208994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.209010:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759868.209015:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212083712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.209034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.209055:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083456 00000100:00100000:3.0:1782759868.209060:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083456 00010000:00010000:3.0:1782759868.209088:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 19 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759868.209106:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083968 00000100:00100000:3.0:1782759868.209110:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083968 00010000:00010000:3.0:1782759868.209120:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 20 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759868.209131:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083584 00000100:00100000:3.0:1782759868.209133:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083584 00010000:00010000:3.0:1782759868.209142:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 21 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759868.209152:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084096 00000100:00100000:3.0:1782759868.209154:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084096 00010000:00010000:3.0:1782759868.209163:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 22 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759868.209181:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083840 00000100:00100000:3.0:1782759868.209184:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083840 00010000:00010000:3.0:1782759868.209209:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 23 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759868.209220:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212083712 00000100:00100000:3.0:1782759868.209223:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212083712 00010000:00010000:3.0:1782759868.209233:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 24 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759868.209246:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1782759868.209254:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+24:3307:x1869355212083456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759868.209266:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759868.209270:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 24 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209281:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 24 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209296:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031a00/0xdd99f5c4777e0de9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0de2 expref: 24 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209310:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759868.209343:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+23:3307:x1869355212083456:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.209350:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1782759868.209367:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1782759868.209373:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+22:3307:x1869355212083968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759868.209389:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759868.209393:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 22 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209400:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 22 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209410:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd200/0xdd99f5c4777e0d95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0d8e expref: 22 pid: 5796 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209418:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759868.209441:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+21:3307:x1869355212083968:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.209446:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1782759868.209459:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1782759868.209465:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+20:3307:x1869355212083584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759868.209473:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759868.209477:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 20 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209486:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 20 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209496:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e0ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0dd4 expref: 20 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209504:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759868.209525:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212083584:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.209540:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1782759868.209580:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1782759868.209586:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212084096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759868.209594:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759868.209598:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 18 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209606:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 18 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209614:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0d87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0d80 expref: 18 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209623:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759868.209644:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:3307:x1869355212084096:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.209650:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1782759868.209664:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1782759868.209670:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:3306:x1869355212083840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759868.209675:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759868.209679:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 16 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209685:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 16 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209694:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0da3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0d9c expref: 16 pid: 5793 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209711:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759868.209736:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:3306:x1869355212083840:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.209743:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1782759868.209755:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1782759868.209761:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:3306:x1869355212083712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759868.209768:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759868.209771:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 14 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209779:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 14 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209789:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcce00/0xdd99f5c4777e0dc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0dbf expref: 14 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759868.209797:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759868.209818:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3306:x1869355212083712:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.209848:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1782759868.209883:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212083712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.209891:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212083840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.209925:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212083584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.209932:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212084096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.209939:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212083456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759868.209956:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212083968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759868.210305:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.210313:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759868.210338:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.210352:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0db1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.210367:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759868.210369:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759868.210371:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759868.210378:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759868.210394:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759868.210403:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212084224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759868.210437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.210471:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084224 00000100:00100000:2.0:1782759868.210476:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084224 00010000:00010000:2.0:1782759868.210493:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 13 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759868.210527:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1782759868.210534:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:3306:x1869355212084224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759868.210542:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759868.210546:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 13 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.210553:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 13 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.210563:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0daa expref: 13 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.210572:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759868.210606:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:3306:x1869355212084224:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.210612:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1782759868.210637:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212084224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759868.214597:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082816:192.168.204.31@tcp:104: 00000100:00100000:3.0:1782759868.215872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759868.215898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759868.216058:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197373952 00000100:00100000:2.0:1782759868.216068:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197373952 00010000:00010000:2.0:1782759868.216109:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 10 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759868.216143:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374080 00000100:00100000:2.0:1782759868.216146:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374080 00010000:00010000:2.0:1782759868.216159:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 11 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759868.216180:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:2.0:1782759868.216190:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2362:x1869355197373952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759868.216219:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759868.216225:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 11 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216236:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 11 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216255:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6727d expref: 11 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216269:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759868.216324:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197373952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 135us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.216348:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:2.0:1782759868.216367:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00100000:2.0:1782759868.216373:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2362:x1869355197374080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759868.216382:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759868.216386:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 9 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216396:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 9 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216408:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216416:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216431:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216438:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216445:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216451:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216457:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759868.216481:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216490:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216499:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759868.216509:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759868.216539:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:2362:x1869355197374080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 166us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.216547:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 733 00010000:00010000:1.0:1782759868.217035:0:159990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e0dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67284 expref: 8 pid: 5794 timeout: 4036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759868.217049:0:159990:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159990:1869355212082560:192.168.204.31@tcp:104: 00010000:00010000:1.0:1782759868.217103:0:159990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.217112:0:159990:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.217117:0:159990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759868.217122:0:159990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031800/0xdd99f5c4777e0df0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759868.396985:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759868.597947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759868.597979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759868.598006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759868.598034:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374336 00000100:00100000:2.0:1782759868.598043:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374336 00000100:00100000:0.0:1782759868.598166:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374208 00000100:00100000:0.0:1782759868.598169:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374208 00000100:00100000:0.0:1782759868.598237:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2839 00000100:00100000:0.0:1782759868.598247:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197374208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759868.598322:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197374208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.598330:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2839 00000100:00080000:0.0:1782759868.598349:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759868.598488:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374464 00000100:00100000:2.0:1782759868.598492:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374464 00000100:00100000:2.0:1782759868.598510:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2286 00000100:00100000:2.0:1782759868.598516:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197374336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759868.598545:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2361:x1869355197374336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.598551:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2286 00000100:00100000:2.0:1782759868.598561:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2287 00000100:00100000:2.0:1782759868.598566:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197374464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759868.598583:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2361:x1869355197374464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 17us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.598595:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2287 00000100:00080000:0.0:1782759868.598680:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759868.598688:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759869.356550:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759869.356576:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212084352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759869.356650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759869.356860:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084352 00000100:00100000:0.0:1782759869.356868:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084352 00000100:00100000:0.0:1782759869.356934:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1782759869.356943:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212084352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759869.356980:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782759869.357274:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759869.357377:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212084352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 433us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.357384:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1782759869.357436:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212084352:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759869.422225:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759869.422232:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917183103000 from 55 10000000:01000000:3.0:1782759869.422237:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759869.422291:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.422303:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.422314:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.422339:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.422405:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.422460:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.422588:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084480 00000100:00100000:0.0:1782759869.422596:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084480 00000100:00100000:0.0:1782759869.422651:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1782759869.422661:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+12:5798:x1869355212084480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759869.422675:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759869.422690:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0df7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.422724:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0df7 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.422734:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75e00/0xdd99f5c4777e0dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0df7 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.422742:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75e00, rc 0) 00000100:00100000:0.0:1782759869.422781:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212084480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.422788:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:3.0:1782759869.423859:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.423879:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0dfe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.423890:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0dfe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.423958:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.424012:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.424057:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.424074:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084608 00000100:00100000:3.0:1782759869.424079:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084608 00000100:00100000:3.0:1782759869.424108:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:3.0:1782759869.424115:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212084608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.424370:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212084608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.424377:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:3.0:1782759869.424409:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.424434:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.424470:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.424483:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.424494:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084736 00000100:00100000:3.0:1782759869.424497:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084736 00000100:00100000:3.0:1782759869.424517:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086 00000100:00100000:3.0:1782759869.424523:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212084736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.424661:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212084736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.424667:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086 00010000:00010000:0.0:1782759869.426148:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759869.426844:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759869.428929:0:160046:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:3.0:1782759869.429934:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:3.0:1782759869.429971:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759869.429983:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0dfe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.430009:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc800/0xdd99f5c4777e0df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0dfe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759869.430026:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759869.430029:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 20 10000000:01000000:3.0:1782759869.430278:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759869.430317:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.430327:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.430339:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.430368:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.430437:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.430491:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.430585:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084864 00000100:00100000:0.0:1782759869.430593:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084864 00000100:00100000:0.0:1782759869.430647:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087 00000100:00100000:0.0:1782759869.430657:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+13:5798:x1869355212084864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759869.430672:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759869.432161:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d74800/0xdd99f5c4777e0e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.432210:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74800/0xdd99f5c4777e0e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e05 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.432221:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d74800/0xdd99f5c4777e0e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e05 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.432230:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74800, rc 0) 00000100:00100000:0.0:1782759869.432316:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212084864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1659us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.432324:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087 00000100:00100000:0.0:1782759869.432401:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759869.432421:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e0c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.432431:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e0c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759869.432504:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759869.432555:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759869.432576:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.432596:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212084992 00000100:00100000:0.0:1782759869.432601:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212084992 00000100:00100000:0.0:1782759869.432634:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:0.0:1782759869.432642:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212084992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759869.439266:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212084992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6615us (6701us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.439281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:1.0:1782759869.439689:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212084992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.439768:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.439852:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.439888:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c0990b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.441940:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085120 00000100:00100000:3.0:1782759869.441953:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085120 00000100:00100000:3.0:1782759869.442013:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:3.0:1782759869.442024:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212085120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.442278:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212085120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.442286:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:1.0:1782759869.442849:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.445504:0:160047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160047:1869355212085248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759869.445579:0:160047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.445624:0:160047:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.446203:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085248 00000100:00100000:0.0:1782759869.446211:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085248 00000100:00100000:0.0:1782759869.446265:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:0.0:1782759869.446273:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:160047:x1869355212085248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759869.446493:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:160047:x1869355212085248:12345-0@lo:502:llog_process_th.0 Request processed in 219us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.446501:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:1.0:1782759869.447289:0:160047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160047:1869355212085248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759869.447326:0:160047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759869.447336:0:160047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759869.447338:0:160047:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre quota.ost 00000020:00000080:1.0:1782759869.447344:0:160047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782759869.447373:0:160047:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160047:1869355212085376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759869.447421:0:160047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.447452:0:160047:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171c0990b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.448214:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085376 00000100:00100000:0.0:1782759869.448220:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085376 00000100:00100000:0.0:1782759869.448269:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1782759869.448277:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:160047:x1869355212085376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759869.448488:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:160047:x1869355212085376:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.448496:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:3.0:1782759869.448658:0:160047:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160047:1869355212085376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759869.448688:0:160047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759869.448695:0:160047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759869.448697:0:160047:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre quota.ost 00000040:00080000:3.0:1782759869.448704:0:160047:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 23 count 23 00000020:01000000:0.0:1782759869.450124:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 20-22 (rc=0) 10000000:01000000:0.0:1782759869.450150:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782759869.450163:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e0c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.450196:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcce00/0xdd99f5c4777e0e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e0c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759869.450205:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782759869.450208:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff917184fef000 from 55 10000000:01000000:0.0:1782759869.450211:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782759869.450248:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.450256:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759869.450266:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759869.450287:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759869.450343:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759869.450381:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.451328:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085504 00000100:00100000:3.0:1782759869.451340:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085504 00000100:00100000:3.0:1782759869.451388:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092 00000100:00100000:3.0:1782759869.451396:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+14:5798:x1869355212085504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.451411:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759869.451426:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e13 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.451451:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e13 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.451461:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dccc00/0xdd99f5c4777e0e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e13 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.451469:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dccc00, rc 0) 00000100:00100000:3.0:1782759869.451515:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212085504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.451522:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092 00000100:00100000:1.0:1782759869.451615:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759869.451630:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e1a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.451640:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e1a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759869.451698:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.451728:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.451761:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.451897:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085632 00000100:00100000:3.0:1782759869.451902:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085632 00000100:00100000:3.0:1782759869.451922:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093 00000100:00100000:3.0:1782759869.451928:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212085632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.452218:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212085632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.452225:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093 00000100:00100000:1.0:1782759869.452407:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.452438:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.452474:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.452501:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b76f76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.452618:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085760 00000100:00100000:0.0:1782759869.452624:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085760 00000100:00100000:0.0:1782759869.452657:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:0.0:1782759869.452665:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212085760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759869.452841:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212085760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.452848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:1.0:1782759869.452978:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759869.460300:0:160048:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:1.0:1782759869.463454:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:1.0:1782759869.463489:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759869.463502:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e1a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.463515:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d74000/0xdd99f5c4777e0e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e1a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759869.463525:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782759869.463528:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 23 10000000:01000000:1.0:1782759869.463531:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782759869.463570:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.463578:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.463588:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759869.463615:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.463689:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.463742:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917181359540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.467583:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212085888 00000100:00100000:3.0:1782759869.467598:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212085888 00000100:00100000:3.0:1782759869.467661:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1782759869.467672:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+15:5798:x1869355212085888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.467711:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759869.467730:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0e28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.467761:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e21 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.467773:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc000/0xdd99f5c4777e0e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e21 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.467784:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc000, rc 0) 00000100:00100000:3.0:1782759869.467879:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212085888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.467886:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1782759869.467965:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212085888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.467984:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e28 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.468004:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e28 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.468086:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.468119:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.468148:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.468160:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086016 00000100:00100000:3.0:1782759869.468164:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086016 00000100:00100000:3.0:1782759869.468197:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:3.0:1782759869.468203:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212086016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.468458:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212086016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.468465:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:3.0:1782759869.468494:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.468535:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.468573:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.468586:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d24900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.468597:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086144 00000100:00100000:3.0:1782759869.468600:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086144 00000100:00100000:3.0:1782759869.468621:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:3.0:1782759869.468627:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212086144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.468762:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212086144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.468769:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000100:00100000:3.0:1782759869.468805:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.469021:0:160050:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160050:1869355212086272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.469056:0:160050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.469075:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086272 00000100:00100000:3.0:1782759869.469079:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086272 00000100:00100000:3.0:1782759869.469097:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098 00000100:00100000:3.0:1782759869.469102:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:160050:x1869355212086272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.469248:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:160050:x1869355212086272:12345-0@lo:502:llog_process_th.0 Request processed in 145us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.469254:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098 00000100:00100000:3.0:1782759869.469291:0:160050:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082d246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.469304:0:160050:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160050:1869355212086272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759869.469325:0:160050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759869.469335:0:160050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759869.469337:0:160050:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre quota.ost 00000020:00000080:3.0:1782759869.469343:0:160050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759869.469363:0:160050:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160050:1869355212086400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.469393:0:160050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.469408:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086400 00000100:00100000:3.0:1782759869.469411:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086400 00000100:00100000:3.0:1782759869.469428:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099 00000100:00100000:3.0:1782759869.469433:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:160050:x1869355212086400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.469545:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:160050:x1869355212086400:12345-0@lo:502:llog_process_th.0 Request processed in 111us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.469553:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099 00000100:00100000:3.0:1782759869.469580:0:160050:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.469591:0:160050:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160050:1869355212086400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759869.469609:0:160050:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759869.469614:0:160050:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759869.469615:0:160050:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre quota.ost 00000040:00080000:3.0:1782759869.469619:0:160050:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 26 count 26 00000020:01000000:3.0:1782759869.469668:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 23-25 (rc=0) 10000000:01000000:3.0:1782759869.469681:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759869.469689:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e28 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.469699:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180031000/0xdd99f5c4777e0e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e28 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759869.469718:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759869.469721:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9171932e8800 from 55 10000000:01000000:3.0:1782759869.469724:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759869.469745:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.469753:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.469762:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.469774:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.469800:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.469813:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.469846:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086528 00000100:00100000:3.0:1782759869.469849:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086528 00000100:00100000:3.0:1782759869.469871:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1782759869.469877:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+16:5798:x1869355212086528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.469884:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759869.469895:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777e0e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.469911:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777e0e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e2f expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.469920:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd800/0xdd99f5c4777e0e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e2f expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.469937:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd800, rc 0) 00000100:00100000:3.0:1782759869.469965:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212086528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.469972:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1782759869.470005:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.470016:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e36 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.470023:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e36 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.470059:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.470082:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.470101:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.470111:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086656 00000100:00100000:3.0:1782759869.470114:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086656 00000100:00100000:3.0:1782759869.470134:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:3.0:1782759869.470139:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212086656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.470333:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212086656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.470339:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:3.0:1782759869.470371:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.470396:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.470430:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.470451:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917191b7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.470463:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086784 00000100:00100000:3.0:1782759869.470466:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086784 00000100:00100000:3.0:1782759869.470486:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:3.0:1782759869.470491:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212086784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.470609:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212086784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.470615:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:3.0:1782759869.470649:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759869.481010:0:160051:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 54 00000020:01000000:3.0:1782759869.490478:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-54 (rc=0) 10000000:01000000:3.0:1782759869.490529:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759869.490543:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e36 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.490556:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd200/0xdd99f5c4777e0e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e36 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759869.490567:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759869.490570:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 59 10000000:01000000:3.0:1782759869.490573:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759869.490612:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.490621:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.490633:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.490663:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.490758:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.490802:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaad240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.490847:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212086912 00000100:00100000:3.0:1782759869.490854:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212086912 00000100:00100000:3.0:1782759869.490897:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:3.0:1782759869.490906:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+17:5798:x1869355212086912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.490921:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759869.490933:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777e0e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e3d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.490958:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777e0e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e3d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.490968:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcda00/0xdd99f5c4777e0e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e3d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.490976:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcda00, rc 0) 00000100:00100000:3.0:1782759869.491026:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212086912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.491762:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:3.0:1782759869.495481:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212086912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.495518:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e44 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.495532:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e44 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.495621:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.495709:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.495813:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171bbaad240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759869.501467:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087040 00000100:00100000:2.0:1782759869.501482:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087040 00000100:00100000:3.0:1782759869.506273:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:3.0:1782759869.506287:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212087040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.506673:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212087040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (10962us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.506682:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1782759869.509546:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759869.512431:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759869.512541:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759869.512587:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.513317:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087168 00000100:00100000:3.0:1782759869.513327:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087168 00000100:00100000:3.0:1782759869.513385:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:3.0:1782759869.513395:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212087168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.513637:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212087168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.513646:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:3.0:1782759869.513721:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.513931:0:160053:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160053:1869355212087296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.513972:0:160053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759869.514257:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087296 00000100:00100000:0.0:1782759869.514261:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087296 00000100:00100000:0.0:1782759869.514289:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:0.0:1782759869.514296:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:160053:x1869355212087296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.514602:0:160053:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171853d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759869.514673:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:160053:x1869355212087296:12345-0@lo:502:llog_process_th.0 Request processed in 376us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.514681:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:3.0:1782759869.514961:0:160053:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160053:1869355212087296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759869.514987:0:160053:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759869.515008:0:160053:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759869.515011:0:160053:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre quota.ost 00000020:00000080:3.0:1782759869.515018:0:160053:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759869.515213:0:160053:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160053:1869355212087424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759869.515253:0:160053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.515290:0:160053:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b34610c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759869.515333:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087424 00000100:00100000:2.0:1782759869.515339:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087424 00000100:00100000:2.0:1782759869.515381:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:2.0:1782759869.515388:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:160053:x1869355212087424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759869.515533:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:160053:x1869355212087424:12345-0@lo:502:llog_process_th.0 Request processed in 144us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759869.515540:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:3.0:1782759869.515612:0:160053:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfd399a3-a1a2-417f-89de-b443f9e395e0:160053:1869355212087424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759869.515629:0:160053:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759869.515634:0:160053:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759869.515636:0:160053:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre quota.ost 00000040:00080000:3.0:1782759869.515640:0:160053:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 62 count 61 00000020:01000000:2.0:1782759869.515807:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 59-61 (rc=0) 10000000:01000000:2.0:1782759869.515851:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782759869.515862:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e44 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759869.515873:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc400/0xdd99f5c4777e0e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e44 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759869.515883:0:5798:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782759869.515886:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759869.515889:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782759869.515913:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759869.515921:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759869.515938:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759869.515951:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759869.515978:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759869.516006:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.516247:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087552 00000100:00100000:3.0:1782759869.516253:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087552 00000100:00100000:3.0:1782759869.516287:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00100000:3.0:1782759869.516295:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212087552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.516305:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759869.516319:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777e0e52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e4b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.516341:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777e0e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e4b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.516352:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcca00/0xdd99f5c4777e0e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e4b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.516363:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcca00, rc 0) 00000100:00100000:3.0:1782759869.516397:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212087552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.516403:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:3.0:1782759869.516435:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759869.516447:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e52 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.516456:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e52 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759869.516507:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.516534:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.516553:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759869.516563:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087680 00000100:00100000:3.0:1782759869.516566:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087680 00000100:00100000:3.0:1782759869.516584:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:3.0:1782759869.516589:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212087680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759869.516804:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212087680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (267us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759869.516811:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:3.0:1782759869.516865:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212087680:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759869.516884:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759869.516890:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e52 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759869.516897:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91200/0xdd99f5c4777e0e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e52 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759870.014264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759870.014378:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374592 00000100:00100000:3.0:1782759870.014390:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374592 00000100:00100000:3.0:1782759870.014453:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3110 00000100:00100000:3.0:1782759870.014464:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:95021:x1869355197374592:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759870.014494:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759870.014511:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e0e59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6728b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759870.014553:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e0e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6728b expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759870.014565:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e0e59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6728b expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759870.014574:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759870.014636:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197374592:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 172us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759870.014643:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3110 00000100:00100000:2.0:1782759870.025781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759870.026000:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374720 00000100:00100000:2.0:1782759870.026009:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374720 00000100:00100000:2.0:1782759870.026057:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3111 00000100:00100000:2.0:1782759870.026068:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197374720:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759870.030028:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197374720:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 3953us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759870.030042:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3111 00000100:00100000:2.0:1782759870.039005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759870.039063:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374848 00000100:00100000:3.0:1782759870.039072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374848 00000100:00100000:3.0:1782759870.039114:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3112 00000100:00100000:3.0:1782759870.039125:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197374848:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759870.039351:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197374848:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 227us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759870.039359:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3112 00000100:00100000:1.0:1782759870.051441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759870.051558:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197374976 00000100:00100000:2.0:1782759870.051568:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197374976 00000100:00100000:2.0:1782759870.051626:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3113 00000100:00100000:2.0:1782759870.051637:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+9:95021:x1869355197374976:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759870.051655:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759870.051673:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67292 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759870.051714:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67292 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759870.051744:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67292 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759870.051754:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759870.051813:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197374976:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 178us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759870.051843:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3113 00000100:00100000:2.0:1782759870.054909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759870.055044:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197375104 00000100:00100000:3.0:1782759870.055054:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197375104 00000100:00100000:3.0:1782759870.055105:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3114 00000100:00100000:3.0:1782759870.055114:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197375104:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759870.055401:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:95021:x1869355197375104:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 287us (499us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759870.055409:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3114 00010000:00010000:0.0:1782759870.452902:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759871.404088:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212087808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759871.404228:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212088320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759871.404283:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759871.404289:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212087936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759871.404327:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212088448:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759871.404380:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212088064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759871.404418:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759871.404423:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212088192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759871.404474:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087808 00000100:00100000:3.0:1782759871.404482:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087808 00000100:00100000:3.0:1782759871.404524:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1782759871.404532:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212087808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404586:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212087808:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.404593:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1782759871.404625:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088320 00000100:00100000:3.0:1782759871.404629:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088320 00000100:00100000:3.0:1782759871.404663:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212087936 00000100:00100000:3.0:1782759871.404666:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212087936 00000100:00100000:3.0:1782759871.404682:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088064 00000100:00100000:3.0:1782759871.404685:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088064 00000100:00100000:3.0:1782759871.404702:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1782759871.404717:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212088320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404751:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212088320:12345-0@lo:400:kworker.0 Request processed in 36us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.404758:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1782759871.404770:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:3.0:1782759871.404776:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212087936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404804:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212087936:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.404810:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:3.0:1782759871.404846:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1782759871.404854:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212088064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.404886:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212088064:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.404891:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1782759871.404912:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088448 00000100:00100000:3.0:1782759871.404916:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088448 00000100:00100000:3.0:1782759871.404941:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088192 00000100:00100000:3.0:1782759871.404944:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088192 00000100:00100000:3.0:1782759871.404966:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1782759871.404972:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212088448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405001:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212088448:12345-0@lo:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.405007:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1782759871.405018:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:3.0:1782759871.405024:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212088192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405051:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212088192:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.405065:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00080000:3.0:1782759871.405092:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759871.405096:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759871.405098:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759871.405156:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212088192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405170:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212088064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405204:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212087936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405213:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212088448:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405221:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212087808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759871.405230:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212088320:0@lo:400:kworker.0 00010000:00010000:3.0:1782759871.470850:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759871.917668:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759871.917694:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212088576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759871.917763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759871.917949:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088576 00000100:00100000:0.0:1782759871.917956:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088576 00000100:00100000:0.0:1782759871.918003:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1782759871.918028:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212088576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759871.918063:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83165184 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759871.918113:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212088576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759871.918120:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1782759871.919644:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212088576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759872.498101:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759873.518868:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759873.716904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759873.716946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759873.716976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759873.717010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759873.717039:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197375488 00000100:00100000:2.0:1782759873.717047:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197375488 00000100:00100000:2.0:1782759873.717107:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197375616 00000100:00100000:2.0:1782759873.717110:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197375616 00000100:00100000:2.0:1782759873.717128:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2290 00000100:00100000:2.0:1782759873.717137:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197375488:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759873.717204:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197375488:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759873.717211:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2290 00000100:00100000:2.0:1782759873.717242:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2291 00000100:00100000:2.0:1782759873.717247:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197375616:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759873.717270:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2364:x1869355197375616:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759873.717275:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2291 00000100:00100000:3.0:1782759873.717788:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197375232 00000100:00100000:3.0:1782759873.717794:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197375232 00000100:00100000:3.0:1782759873.717852:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3116 00000100:00100000:3.0:1782759873.717860:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197375232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759873.717895:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2364:x1869355197375232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 37us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759873.717901:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3116 00000100:00080000:3.0:1782759873.717929:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759873.717933:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759873.721310:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197375360 00000100:00100000:0.0:1782759873.721335:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197375360 00000100:00100000:0.0:1782759873.721435:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2843 00000100:00100000:0.0:1782759873.721446:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197375360:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759873.721541:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2364:x1869355197375360:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (4561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.721548:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2843 00000100:00080000:1.0:1782759873.725333:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759874.476067:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212088704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759874.476141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759874.476260:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088704 00000100:00100000:0.0:1782759874.476274:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088704 00000100:00100000:0.0:1782759874.476348:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1782759874.476360:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212088704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759874.476407:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84869120 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759874.476466:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212088704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759874.476474:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1782759874.476513:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212088704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759874.476961:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759874.540107:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759874.731165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759874.733588:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197375872 00000100:00100000:1.0:1782759874.733602:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197375872 00000100:00100000:1.0:1782759874.733744:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 399 00000100:00100000:1.0:1782759874.733756:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:109620:x1869355197375872:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:1.0:1782759874.734220:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:109620:x1869355197375872:12345-192.168.204.31@tcp:35:umount.0 Request processed in 465us (3243us total) trans 4294968198 rc 0/0 00000100:00100000:1.0:1782759874.734228:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 399 00000100:00100000:3.0:1782759874.742993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759874.745219:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197376128 00000100:00100000:0.0:1782759874.745234:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197376128 00000100:00100000:0.0:1782759874.745315:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 400 00000100:00100000:0.0:1782759874.745326:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198916850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+7:109620:x1869355197376128:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:0.0:1782759874.746200:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198916850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:109620:x1869355197376128:12345-192.168.204.31@tcp:35:umount.0 Request processed in 872us (3213us total) trans 4294968199 rc 0/0 00000100:00100000:0.0:1782759874.746210:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 400 00000100:00100000:3.0:1782759874.791025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759874.791138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759874.792324:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197376256 00000100:00100000:2.0:1782759874.792336:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197376256 00000100:00100000:0.0:1782759874.792351:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197376384 00000100:00100000:0.0:1782759874.792358:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197376384 00000100:00100000:3.0:1782759874.792366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759874.792418:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 189 00000100:00100000:2.0:1782759874.792427:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 190 00000100:00100000:0.0:1782759874.792432:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197376384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759874.792454:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5eacb22c-5970-4500-a1c7-1fc375a2c1df+11:2361:x1869355197376256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759874.792462:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759874.792466:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782759874.792474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782759874.792487:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e0e59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6728b expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759874.792488:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d65600/0xdd99f5c4777deb2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c41 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759874.792515:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197376512 00010000:00010000:2.0:1782759874.792520:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759874.792520:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759874.792521:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197376512 00000100:00100000:3.0:1782759874.792552:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 191 00000100:00100000:3.0:1782759874.792562:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2362:x1869355197376512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759874.792572:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759874.792587:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197376384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (1442us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759874.792588:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d64000/0xdd99f5c4777deb36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66c48 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759874.792588:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5eacb22c-5970-4500-a1c7-1fc375a2c1df+10:2361:x1869355197376256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759874.792607:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 189 00010000:00010000:3.0:1782759874.792610:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759874.792626:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 190 00000100:00100000:3.0:1782759874.792635:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eacb22c-5970-4500-a1c7-1fc375a2c1df+8:2362:x1869355197376512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759874.792644:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 191 00000100:00100000:1.0:1782759874.793223:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197377024 00000100:00100000:1.0:1782759874.793229:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197377024 00000100:00100000:0.0:1782759874.793525:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1042 00000100:00100000:0.0:1782759874.793533:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2360:x1869355197377024:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782759874.793559:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777deb4b 00000020:00010000:0.0:1782759874.793567:0:6599:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917081397800: total 0 00000100:00080000:0.0:1782759874.793572:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917081396000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1782759874.793601:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917081397800: total 0 00000001:00000004:0.0:1782759874.793608:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967435 00010000:00010000:2.0:1782759874.793632:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917081397800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1782759874.793676:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ea4872d/0xdd99f5c4777defd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66d59 expref: 7 pid: 126932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759874.793711:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029c1a895/0xdd99f5c4777e01ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6705b expref: 6 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759874.793748:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d0ada0/0xdd99f5c4777e05c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf670fc expref: 5 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759874.793760:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917081397800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1782759874.793772:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759874.793775:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759874.793776:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759874.793873:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+2:2360:x1869355197377024:12345-192.168.204.31@tcp:9:umount.0 Request processed in 339us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759874.793881:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1042 00000100:00100000:1.0:1782759874.802346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759874.802466:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197377280 00000100:00100000:3.0:1782759874.802476:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197377280 00000100:00100000:3.0:1782759874.802540:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1043 00000100:00100000:3.0:1782759874.802550:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+6:2360:x1869355197377280:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1782759874.802582:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777df4b3 00000020:00010000:3.0:1782759874.802601:0:6597:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917082d3e800: total 0 00000100:00080000:3.0:1782759874.802606:0:6597:0:(import.c:65:import_set_state_nolock()) ffff917082d3a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759874.802650:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967444 00000100:00100000:3.0:1782759874.802942:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+4:2360:x1869355197377280:12345-192.168.204.31@tcp:9:umount.0 Request processed in 392us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759874.802964:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1043 00000020:00010000:2.0:1782759874.803131:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917082d3e800: total 0 00010000:00010000:2.0:1782759874.803136:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759874.803168:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917082d3e800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1782759874.803200:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:2.0:1782759874.803203:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb mtime from disk: 0 -> 1782759509 00002000:00010000:2.0:1782759874.803205:0:5788:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1782759874.803233:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55ab351/0xdd99f5c4777dfce7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf66f66 expref: 3 pid: 126932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759874.803257:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917082d3e800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782759874.803266:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759874.803268:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759874.803269:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759874.823204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759874.823535:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197381120 00000100:00100000:3.0:1782759874.823546:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197381120 00000100:00100000:3.0:1782759874.823615:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2292 00000100:00100000:3.0:1782759874.823626:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+8:2360:x1869355197381120:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1782759874.823665:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777deb3d 00000020:00010000:3.0:1782759874.823675:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91708243d800: total 0 00000100:00080000:3.0:1782759874.823679:0:5803:0:(import.c:65:import_set_state_nolock()) ffff917082438800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759874.823711:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968199 00000020:00010000:1.0:1782759874.823772:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91708243d800: total 0 00010000:00010000:1.0:1782759874.823817:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708243d800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782759874.823937:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000418:0x29:0x0].0x0 (ffff917182dd1e00) 00010000:00010000:1.0:1782759874.823941:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 59 00010000:00010000:1.0:1782759874.823949:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e0d64 lrc: 0/0,0 mode: --/PW res: [0x200000418:0x29:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67276 expref: 7 pid: 7487 timeout: 4022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759874.823975:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708243d800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782759874.823988:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759874.823991:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759874.823993:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759874.827707:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5e146cd-50db-4b42-b3c2-9b1f84b4ef37+5:2360:x1869355197381120:12345-192.168.204.31@tcp:39:umount.0 Request processed in 4073us (4503us total) trans 4294968200 rc 0/0 00000100:00100000:3.0:1782759874.827722:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2292 00000100:00100000:0.0:1782759874.871241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759874.871910:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197381376 00000100:00100000:3.0:1782759874.871923:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197381376 00000100:00100000:3.0:1782759874.871991:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3117 00000100:00100000:3.0:1782759874.872000:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+7:2360:x1869355197381376:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782759874.872044:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777deb1a 00000020:00010000:3.0:1782759874.872070:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917081396800: total 0 00000100:00080000:3.0:1782759874.872075:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917081390800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782759874.872156:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eacb22c-5970-4500-a1c7-1fc375a2c1df+3:2360:x1869355197381376:12345-192.168.204.31@tcp:251:umount.0 Request processed in 157us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759874.872163:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3117 00000020:00010000:0.0:1782759874.872293:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917081396800: total 0 00010000:00010000:0.0:1782759874.872331:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917081396800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759874.872361:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67292 expref: 2 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759874.872378:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917081396800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782759874.872399:0:7496:0:(genops.c:906:class_export_put()) final put ffff917081396800/5eacb22c-5970-4500-a1c7-1fc375a2c1df 00010000:00010000:0.0:1782759874.872418:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759874.872420:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759874.872422:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759874.873555:0:155884:0:(genops.c:865:class_export_destroy()) destroying export ffff917081396800/5eacb22c-5970-4500-a1c7-1fc375a2c1df for MGS 00000020:00000080:3.0:1782759874.873602:0:155884:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081390800 for MGS 00010000:00010000:2.0:1782759875.573507:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759875.628242:0:160242:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff3ee20050 20000000:00000080:2.0:1782759875.628269:0:160242:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170810c4400 uarg=0000000000000000 10000000:01000000:2.0:1782759875.632300:0:160242:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759875.632327:0:160242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.632359:0:160242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.632368:0:160242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.632407:0:160242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.632423:0:160242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 18 pid: 5796 timeout: 4044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759875.632439:0:160242:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160242:1869355212088832:0@lo:104: 00000100:00100000:2.0:1782759875.632502:0:160242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759875.632713:0:160242:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084f88780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759875.633520:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088832 00000100:00100000:3.0:1782759875.633532:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088832 00000100:00100000:3.0:1782759875.633671:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1782759875.633683:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:160242:x1869355212088832:12345-0@lo:104: 00010000:00010000:3.0:1782759875.633717:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.634132:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759875.634140:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:160242:x1869355212088832:12345-0@lo:104: Request processed in 459us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759875.634148:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00010000:00010000:0.0:1782759875.634205:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759875.634214:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634222:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759875.634227:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634235:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759875.634251:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759875.634257:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759875.634299:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634305:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759875.634331:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634338:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc200/0xdd99f5c4777e0cf4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0cfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634354:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759875.634356:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759875.634357:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759875.634379:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212088960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759875.634421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759875.634485:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212088960 00000100:00100000:0.0:1782759875.634492:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212088960 00010000:00010000:0.0:1782759875.634520:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 19 pid: 5796 timeout: 4044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759875.634544:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1782759875.634552:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212088960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759875.634564:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759875.634569:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 19 pid: 5796 timeout: 4044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634588:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 19 pid: 5796 timeout: 4044 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634609:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634619:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634636:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634644:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634652:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634658:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634664:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759875.634669:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634676:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634686:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.634743:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759875.634777:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212088960:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759875.634784:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1782759875.634845:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212088960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759875.635268:0:160242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74e00/0xdd99f5c4777e0cfb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0cf4 expref: 18 pid: 5796 timeout: 4044 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759875.635281:0:160242:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160242:1869355212088832:0@lo:104: 00010000:00010000:2.0:1782759875.635297:0:160242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.635307:0:160242:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.635313:0:160242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.635319:0:160242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e0e67 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759876.054945:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968199 is committed 00000001:00100000:2.0:1782759876.054976:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000001:00080000:2.0:1782759876.054984:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968200 is committed 00000020:00000080:2.0:1782759876.054988:0:5824:0:(genops.c:906:class_export_put()) final put ffff91708243d800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:2.0:1782759876.055010:0:155884:0:(genops.c:865:class_export_destroy()) destroying export ffff91708243d800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 for lustre-MDT0000 00000020:00000080:2.0:1782759876.055071:0:155884:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082438800 for lustre-MDT0000 00000020:00000080:2.0:1782759876.392196:0:160290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0ca5e890 20000000:00000080:2.0:1782759876.392216:0:160290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b77a0c00 uarg=0000000000000000 10000000:01000000:2.0:1782759876.393209:0:160290:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759876.393232:0:160290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393248:0:160290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393260:0:160290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393266:0:160290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393272:0:160290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393279:0:160290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393285:0:160290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759876.393300:0:160290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393315:0:160290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393328:0:160290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393336:0:160290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759876.393342:0:160290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91000/0xdd99f5c4777e0e6e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759876.526441:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212089344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.526987:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212089088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.527060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759876.527105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759876.527110:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212089600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.527138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759876.527139:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759876.527147:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212089216:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.527161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759876.527169:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212089472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759876.527175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759876.527197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759876.527212:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089344 00000100:00100000:2.0:1782759876.527219:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089344 00000100:00100000:0.0:1782759876.527260:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089088 00000100:00100000:0.0:1782759876.527265:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089088 00000100:00100000:2.0:1782759876.527275:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089600 00000100:00100000:2.0:1782759876.527279:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089600 00000100:00100000:2.0:1782759876.527306:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:0.0:1782759876.527312:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089216 00000100:00100000:2.0:1782759876.527317:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212089344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.527318:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089216 00000100:00100000:0.0:1782759876.527351:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089472 00000100:00100000:0.0:1782759876.527355:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089472 00000100:00100000:0.0:1782759876.527397:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:0.0:1782759876.527403:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212089088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.527447:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212089088:12345-0@lo:400:kworker.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759876.527453:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:0.0:1782759876.527467:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1782759876.527472:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212089216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.527512:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212089216:12345-0@lo:400:kworker.0 Request processed in 40us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759876.527518:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1782759876.527528:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:0.0:1782759876.527533:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212089472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759876.527575:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212089344:12345-0@lo:400:kworker.0 Request processed in 259us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759876.527576:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212089472:12345-0@lo:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759876.527591:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00100000:0.0:1782759876.527591:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:2.0:1782759876.527615:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:2.0:1782759876.527622:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212089600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759876.527846:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212089600:12345-0@lo:400:kworker.0 Request processed in 201us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759876.527955:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00080000:2.0:1782759876.527983:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759876.527987:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759876.527989:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759876.528091:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212089216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759876.528104:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212089344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.531810:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212089472:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.532058:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212089088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759876.532073:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212089600:0@lo:400:kworker.0 00010000:00010000:0.0:1782759876.597321:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782759876.617500:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:0.0:1782759876.617510:0:6622:0:(genops.c:906:class_export_put()) final put ffff917082d3e800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:0.0:1782759876.617542:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3e800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 for lustre-OST0000 00000020:00000080:0.0:1782759876.617587:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d3a000 for lustre-OST0000 00000001:00100000:0.0:1782759876.646182:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:0.0:1782759876.646194:0:7507:0:(genops.c:906:class_export_put()) final put ffff917081397800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 00000020:00000080:1.0:1782759876.646254:0:155884:0:(genops.c:865:class_export_destroy()) destroying export ffff917081397800/c5e146cd-50db-4b42-b3c2-9b1f84b4ef37 for lustre-OST0001 00000020:00000080:1.0:1782759876.646308:0:155884:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917081396000 for lustre-OST0001 00000100:00100000:1.0:1782759877.039035:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212089728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759877.039110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759877.039745:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089728 00000100:00100000:2.0:1782759877.039755:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089728 00000100:00100000:2.0:1782759877.039813:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1782759877.039839:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212089728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759877.039878:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759877.041136:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212089728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1311us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759877.041148:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1782759877.041250:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212089728:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1782759877.175385:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759877.175394:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759877.175399:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759877.175446:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.175458:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.175469:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759877.175507:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212089856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759877.175577:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759877.175638:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193cd9600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759877.175675:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089856 00000100:00100000:2.0:1782759877.175681:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089856 00000100:00100000:2.0:1782759877.177074:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:2.0:1782759877.177089:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212089856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759877.177111:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759877.177136:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e75 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.177167:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.177179:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.177189:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759877.177249:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212089856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759877.177256:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:2.0:1782759877.177319:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212089856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759877.177335:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.177345:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759877.177376:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759877.177382:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.177389:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759877.283402:0:160339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe30c435e0 20000000:00000080:2.0:1782759877.283419:0:160339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082bc1400 uarg=0000000000000000 10000000:01000000:2.0:1782759877.283655:0:160339:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759877.283677:0:160339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.283697:0:160339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.283707:0:160339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.283745:0:160339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.283760:0:160339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 18 pid: 5794 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759877.283776:0:160339:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160339:1869355212089984:0@lo:104: 00000100:00100000:2.0:1782759877.284118:0:160339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759877.284210:0:160339:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c2add80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759877.284330:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212089984 00000100:00100000:3.0:1782759877.284338:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212089984 00000100:00100000:3.0:1782759877.284419:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1782759877.284429:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:160339:x1869355212089984:12345-0@lo:104: 00010000:00010000:3.0:1782759877.284441:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.284546:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759877.284553:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:160339:x1869355212089984:12345-0@lo:104: Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759877.284560:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00010000:00010000:0.0:1782759877.284600:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759877.284607:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284615:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759877.284620:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284643:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759877.284651:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759877.284657:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759877.284693:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284700:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759877.284720:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284728:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e0e75 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0e7c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284741:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759877.284743:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759877.284745:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759877.284756:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212090112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759877.284788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759877.284843:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090112 00000100:00100000:0.0:1782759877.284848:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090112 00010000:00010000:0.0:1782759877.284868:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 19 pid: 5794 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759877.284889:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1782759877.284896:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212090112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759877.284912:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759877.284917:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 19 pid: 5794 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284927:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 19 pid: 5794 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284941:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284950:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284964:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284971:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284978:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284985:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.284991:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759877.284996:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.285003:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.285035:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.285044:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759877.285073:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212090112:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759877.285080:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1782759877.285117:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170832d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212090112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759877.285270:0:160339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e0e7c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0e75 expref: 18 pid: 5794 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759877.285288:0:160339:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160339:1869355212089984:0@lo:104: 00010000:00010000:2.0:1782759877.285302:0:160339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.285325:0:160339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.285332:0:160339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759877.285338:0:160339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e0e83 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.612350:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759878.237245:0:160388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff0cc89f0 20000000:00000080:3.0:1782759878.237274:0:160388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7dbdc00 uarg=0000000000000000 10000000:01000000:3.0:1782759878.237628:0:160388:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759878.237657:0:160388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237679:0:160388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237703:0:160388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237711:0:160388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237720:0:160388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237728:0:160388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237735:0:160388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759878.237739:0:160388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237748:0:160388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237764:0:160388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237773:0:160388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.237780:0:160388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e8a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759878.645801:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759878.701226:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759878.701239:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759878.701247:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759878.701322:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.701337:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.701350:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759878.701387:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212090240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759878.701491:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759878.701643:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c2add80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759878.704185:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090240 00000100:00100000:3.0:1782759878.704205:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090240 00000100:00100000:3.0:1782759878.704308:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:3.0:1782759878.704321:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212090240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759878.704345:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759878.704371:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0e91 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.704406:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.704419:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.704429:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759878.704540:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212090240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759878.704548:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:0.0:1782759878.704881:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212090240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759878.704901:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759878.704909:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759878.704932:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759878.704938:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759878.704946:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759879.596960:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759879.597001:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759879.597118:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759879.597217:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090368 00000100:00100000:1.0:1782759879.597226:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090368 00000100:00100000:1.0:1782759879.597288:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00080000:2.0:1782759879.597863:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759879.598148:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212090368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759879.598186:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759879.598250:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212090368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759879.598377:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212090368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759879.602517:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00010000:00010000:0.0:1782759879.663998:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759880.684074:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759881.302115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.303064:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197381504 00000100:00100000:2.0:1782759881.303076:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197381504 00000100:00100000:2.0:1782759881.303174:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3120 00000100:00100000:2.0:1782759881.303183:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1869355197381504:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:2.0:1782759881.303215:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c276a8fc-707b-4100-a499-42c8469183db@192.168.204.31@tcp t0 exp 0000000000000000 cur 3949 last 0 00000020:00000080:2.0:1782759881.303245:0:5796:0:(genops.c:1406:class_connect()) connect: client c276a8fc-707b-4100-a499-42c8469183db, cookie 0xdd99f5c4777e0e9f 00000100:00080000:2.0:1782759881.303301:0:5796:0:(import.c:65:import_set_state_nolock()) ffff917082d38800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759881.303378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+5:2360:x1869355197381504:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 195us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.303386:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3120 00000100:00100000:1.0:1782759881.309325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.310067:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197381632 00000100:00100000:2.0:1782759881.310078:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197381632 00000100:00100000:2.0:1782759881.310143:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3121 00000100:00100000:2.0:1782759881.310155:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+5:109733:x1869355197381632:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759881.310175:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759881.310196:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e0ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf672a7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.310227:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e0ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672a7 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.310240:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e0ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672a7 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.310250:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90600, rc 0) 00000100:00100000:2.0:1782759881.310336:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+6:109733:x1869355197381632:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 182us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.310345:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3121 00000100:00100000:0.0:1782759881.312807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.312932:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197381760 00000100:00100000:2.0:1782759881.313012:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197381760 00000100:00100000:2.0:1782759881.313074:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3122 00000100:00100000:2.0:1782759881.313084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+6:109733:x1869355197381760:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759881.313819:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+6:109733:x1869355197381760:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 733us (1022us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759881.313862:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3122 00000100:00100000:1.0:1782759881.326931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.327083:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197381888 00000100:00100000:2.0:1782759881.327096:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197381888 00000100:00100000:2.0:1782759881.327151:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3123 00000100:00100000:2.0:1782759881.327161:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+6:109733:x1869355197381888:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759881.327180:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759881.327197:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777e0ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf672ae expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.327226:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777e0ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672ae expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.327238:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777e0ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672ae expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.327247:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90c00, rc 0) 00000100:00100000:2.0:1782759881.327322:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+7:109733:x1869355197381888:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 162us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.327349:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3123 00000100:00100000:1.0:1782759881.336321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.336667:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382016 00000100:00100000:2.0:1782759881.336677:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382016 00000100:00100000:2.0:1782759881.336743:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3124 00000100:00100000:2.0:1782759881.336755:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+7:109733:x1869355197382016:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759881.337238:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+8:109733:x1869355197382016:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 418us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.337248:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3124 00000100:00100000:1.0:1782759881.345240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759881.352189:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382144 00000100:00100000:0.0:1782759881.352206:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382144 00000100:00100000:0.0:1782759881.352299:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3125 00000100:00100000:0.0:1782759881.352311:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+8:109733:x1869355197382144:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759881.352844:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+8:109733:x1869355197382144:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 511us (7591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759881.352854:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3125 00000100:00100000:1.0:1782759881.355701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759881.355781:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382272 00000100:00100000:3.0:1782759881.355792:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382272 00000100:00100000:3.0:1782759881.355882:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3126 00000100:00100000:3.0:1782759881.355893:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+8:109751:x1869355197382272:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759881.356582:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+8:109751:x1869355197382272:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 689us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.356591:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3126 00000100:00100000:1.0:1782759881.374167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759881.375707:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382400 00000100:00100000:3.0:1782759881.375719:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382400 00000100:00100000:3.0:1782759881.375789:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3127 00000100:00100000:3.0:1782759881.375801:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+8:109751:x1869355197382400:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759881.376442:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+8:109751:x1869355197382400:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 641us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.376452:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3127 00000100:00100000:2.0:1782759881.387331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759881.387992:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382528 00000100:00100000:3.0:1782759881.388003:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382528 00000100:00100000:3.0:1782759881.388066:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3128 00000100:00100000:3.0:1782759881.388077:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+8:109751:x1869355197382528:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759881.388464:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+8:109751:x1869355197382528:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 387us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.388472:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3128 00000100:00100000:0.0:1782759881.402723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.405388:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382656 00000100:00100000:2.0:1782759881.405403:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382656 00000100:00100000:2.0:1782759881.405475:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3129 00000100:00100000:2.0:1782759881.405487:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+8:109733:x1869355197382656:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782759881.405517:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759881.405534:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e0eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf672d8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.405566:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e0eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672d8 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.405577:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e0eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672d8 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.405605:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91c00, rc 0) 00000100:00100000:2.0:1782759881.405682:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+9:109733:x1869355197382656:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 196us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.405688:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3129 00000100:00100000:1.0:1782759881.424985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759881.425622:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382784 00000100:00100000:3.0:1782759881.425633:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382784 00000100:00100000:3.0:1782759881.425695:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3130 00000100:00100000:3.0:1782759881.425706:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+9:109733:x1869355197382784:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782759881.425734:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782759881.425762:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782759881.425767:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782759881.425771:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782759881.425774:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782759881.439161:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+9:109733:x1869355197382784:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 13444us (14173us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.439177:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3130 00000100:00100000:0.0:1782759881.443017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759881.443470:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197382912 00000100:00100000:1.0:1782759881.443482:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197382912 00000100:00100000:1.0:1782759881.443563:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3131 00000100:00100000:1.0:1782759881.443575:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+9:109733:x1869355197382912:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759881.443594:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759881.443612:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030200/0xdd99f5c4777e0ebb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf672df expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759881.443642:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030200/0xdd99f5c4777e0ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672df expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759881.443676:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030200/0xdd99f5c4777e0ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672df expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759881.443685:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030200, rc 0) 00000100:00100000:1.0:1782759881.443751:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:109733:x1869355197382912:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 178us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.443758:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3131 00000100:00100000:1.0:1782759881.446264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.446383:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383040 00000100:00100000:2.0:1782759881.446393:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383040 00000100:00100000:2.0:1782759881.446448:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3132 00000100:00100000:2.0:1782759881.446457:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:109733:x1869355197383040:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782759881.446777:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:109733:x1869355197383040:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 319us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.446785:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3132 00000100:00100000:3.0:1782759881.449318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.449465:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383168 00000100:00100000:2.0:1782759881.449474:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383168 00000100:00100000:2.0:1782759881.449543:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3133 00000100:00100000:2.0:1782759881.449553:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:109733:x1869355197383168:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759881.451066:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:109733:x1869355197383168:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 1507us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.451079:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3133 00000100:00100000:0.0:1782759881.459106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759881.459218:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383296 00000100:00100000:1.0:1782759881.459229:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383296 00000100:00100000:1.0:1782759881.459327:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3134 00000100:00100000:1.0:1782759881.459338:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:109757:x1869355197383296:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759881.459640:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:109757:x1869355197383296:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 303us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.459649:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3134 00000100:00100000:1.0:1782759881.484394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.484510:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383424 00000100:00100000:2.0:1782759881.484522:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383424 00000100:00100000:2.0:1782759881.484589:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3135 00000100:00100000:2.0:1782759881.484616:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:109757:x1869355197383424:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759881.485191:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:109757:x1869355197383424:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 574us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.485202:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3135 00000100:00100000:2.0:1782759881.490510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759881.490627:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383552 00000100:00100000:0.0:1782759881.490638:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383552 00000100:00100000:0.0:1782759881.490691:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2293 00000100:00100000:0.0:1782759881.490700:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1869355197383552:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782759881.490731:0:5801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 95d4477b-602f-4eb6-8798-a97fbce0e608@192.168.204.31@tcp t0 exp 0000000000000000 cur 3949 last 0 00000020:00000080:0.0:1782759881.490768:0:5801:0:(genops.c:1406:class_connect()) connect: client 95d4477b-602f-4eb6-8798-a97fbce0e608, cookie 0xdd99f5c4777e0ec2 00000004:00100000:0.0:1782759881.490800:0:5801:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782759881.491502:0:5801:0:(import.c:65:import_set_state_nolock()) ffff91708297d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759881.491631:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2360:x1869355197383552:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 929us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759881.491640:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2293 00000100:00100000:0.0:1782759881.493604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759881.493686:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.494187:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383808 00000100:00100000:2.0:1782759881.494197:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383808 00000100:00100000:1.0:1782759881.494316:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383680 00000100:00100000:1.0:1782759881.494320:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383680 00000100:00100000:1.0:1782759881.494374:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2294 00000100:00100000:1.0:1782759881.494383:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:0:x1869355197383680:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759881.494425:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2250506240 avail 2248409088 00000100:00100000:1.0:1782759881.494489:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:0:x1869355197383680:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 107us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.494497:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2294 00000100:00100000:2.0:1782759881.494710:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2295 00000100:00100000:2.0:1782759881.494726:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170832d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109733:x1869355197383808:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759881.494741:0:146757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2250506240 avail 2248409088 00000100:00100000:2.0:1782759881.494767:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170832d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109733:x1869355197383808:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 51us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.494774:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2295 00000100:00080000:3.0:1782759881.495183:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759881.496869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759881.497112:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197383936 00000100:00100000:3.0:1782759881.497121:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197383936 00000100:00100000:3.0:1782759881.497223:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2296 00000100:00100000:3.0:1782759881.497250:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109733:x1869355197383936:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782759881.497337:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109733:x1869355197383936:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 89us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.497345:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2296 00000100:00100000:2.0:1782759881.501038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.501076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759881.501414:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384064 00000100:00100000:0.0:1782759881.501441:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384064 00000100:00100000:0.0:1782759881.501481:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384192 00000100:00100000:0.0:1782759881.501485:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384192 00000100:00100000:0.0:1782759881.501518:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1044 00000100:00100000:0.0:1782759881.501526:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355197384064:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782759881.501558:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 95d4477b-602f-4eb6-8798-a97fbce0e608@192.168.204.31@tcp t0 exp 0000000000000000 cur 3949 last 0 00000020:00000080:0.0:1782759881.501602:0:9120:0:(genops.c:1406:class_connect()) connect: client 95d4477b-602f-4eb6-8798-a97fbce0e608, cookie 0xdd99f5c4777e0ec9 00002000:00100000:0.0:1782759881.501616:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95d4477b-602f-4eb6-8798-a97fbce0e608/ffff917082978000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759881.501628:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782759881.501863:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1045 00000100:00100000:3.0:1782759881.501880:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355197384192:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782759881.501900:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 95d4477b-602f-4eb6-8798-a97fbce0e608@192.168.204.31@tcp t0 exp 0000000000000000 cur 3949 last 0 00002000:00080000:0.0:1782759881.501905:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782759881.501954:0:9120:0:(import.c:65:import_set_state_nolock()) ffff91708297a800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1782759881.501971:0:6597:0:(genops.c:1406:class_connect()) connect: client 95d4477b-602f-4eb6-8798-a97fbce0e608, cookie 0xdd99f5c4777e0ed0 00002000:00100000:3.0:1782759881.501979:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95d4477b-602f-4eb6-8798-a97fbce0e608/ffff9170836cb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782759881.501995:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1782759881.502038:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2360:x1869355197384064:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 509us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759881.502049:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1044 00000100:00100000:2.0:1782759881.502089:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759881.502152:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384320 00000100:00100000:2.0:1782759881.502157:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384320 00000100:00100000:2.0:1782759881.502192:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 401 00000100:00100000:2.0:1782759881.502200:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109733:x1869355197384320:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782759881.502403:0:121722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000100:00100000:2.0:1782759881.502479:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109733:x1869355197384320:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 280us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.502484:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 401 00002000:00080000:3.0:1782759881.504633:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782759881.504671:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9170836c8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759881.505051:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2360:x1869355197384192:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 3169us (3971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.505115:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1045 00000100:00100000:3.0:1782759881.655555:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212090496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.655740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759881.655858:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212090624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.655890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759881.655928:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090624 00000100:00100000:0.0:1782759881.655984:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090496 00000100:00100000:0.0:1782759881.655993:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090496 00000100:00100000:3.0:1782759881.656009:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090624 00000100:00100000:0.0:1782759881.656037:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:0.0:1782759881.656046:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212090496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.656124:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:0.0:1782759881.656129:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212090496:12345-0@lo:400:kworker.0 Request processed in 83us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.656135:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759881.656142:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1782759881.656188:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212090624:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.656196:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:3.0:1782759881.656509:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212090496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.656547:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212090624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.656585:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759881.657163:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212090752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.657201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759881.657317:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090752 00000100:00100000:0.0:1782759881.657323:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090752 00000100:00100000:0.0:1782759881.657368:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:0.0:1782759881.657376:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212090752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759881.657579:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759881.658129:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759881.658141:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212090880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759881.660953:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212091136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759881.661353:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759881.661378:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212091008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759881.661442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759881.661498:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091008 00000100:00100000:0.0:1782759881.661505:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091008 00000100:00100000:0.0:1782759881.661559:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1782759881.661568:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212091008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759881.661625:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212091008:12345-0@lo:400:kworker.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759881.661633:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1782759881.661674:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212091008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759881.661713:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212090752:12345-0@lo:400:kworker.0 Request processed in 4338us (4511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759881.661721:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:3.0:1782759881.665480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759881.665571:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212090880 00000100:00100000:3.0:1782759881.665579:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212090880 00000100:00100000:3.0:1782759881.666835:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:3.0:1782759881.666854:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212090880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.668151:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212090880:12345-0@lo:400:kworker.0 Request processed in 1302us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.668162:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:3.0:1782759881.668228:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212090880:0@lo:400:kworker.0 00000100:00080000:3.0:1782759881.668488:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759881.668494:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759881.672803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759881.672962:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212090752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759881.675752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759881.675791:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384448 00000100:00100000:3.0:1782759881.675800:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384448 00000100:00100000:3.0:1782759881.675877:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2297 00000100:00100000:3.0:1782759881.675888:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109774:x1869355197384448:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759881.675925:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759881.676005:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0ed7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67309 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.676067:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0ede lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.676101:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.676113:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759881.676710:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1782759881.676716:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759881.676795:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.676846:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0ed7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67309 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.676864:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0ede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67309 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.676872:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1900) 00010000:00010000:3.0:1782759881.676876:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759881.676878:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759881.677005:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+7:109774:x1869355197384448:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1117us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.677013:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2297 00000100:00100000:1.0:1782759881.682033:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091136 00000100:00100000:1.0:1782759881.682048:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091136 00000100:00080000:2.0:1782759881.682303:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759881.682380:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:1.0:1782759881.682391:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212091136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759881.682488:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212091136:12345-0@lo:400:kworker.0 Request processed in 99us (9691us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.682496:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:1.0:1782759881.682637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212091136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759881.686496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759881.687030:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384576 00000100:00100000:1.0:1782759881.687042:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384576 00000100:00100000:1.0:1782759881.687101:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2298 00000100:00100000:1.0:1782759881.687111:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:109774:x1869355197384576:12345-192.168.204.31@tcp:48:lfs.0 00010000:00010000:0.0:1782759881.708463:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782759881.710472:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000001:00100000:1.0:1782759881.716790:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000001:00100000:0.0:1782759881.740599:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000100:00100000:3.0:1782759881.740791:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091264:0@lo:106: 00000100:00100000:3.0:1782759881.740965:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759881.741065:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7dc3300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759881.741189:0:73865:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759881.741204:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091264 00000100:00100000:2.0:1782759881.741211:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091264 00000100:00100000:2.0:1782759881.741396:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1782759881.741406:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082734050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:5803:x1869355212091264:12345-0@lo:106: 00010000:00010000:2.0:1782759881.741419:0:73865:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.741429:0:73865:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9171c0b90a00/0xdd99f5c4777e0529 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0530 expref: -99 pid: 155102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759881.741500:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082734050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:5803:x1869355212091264:12345-0@lo:106: Request processed in 96us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759881.741508:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1782759881.742483:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091264:0@lo:106: 00000100:00100000:2.0:1782759881.770371:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091392:0@lo:106: 00000100:00100000:2.0:1782759881.770443:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759881.770499:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081875880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091520:0@lo:106: 00000100:00100000:2.0:1782759881.770520:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759881.770549:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081874700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091648:0@lo:106: 00000100:00100000:2.0:1782759881.770566:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759881.770581:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170810e6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759881.770647:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091392 00000100:00100000:1.0:1782759881.770655:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091392 00000100:00100000:1.0:1782759881.770697:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091520 00000100:00100000:1.0:1782759881.770700:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091520 00000100:00100000:1.0:1782759881.770711:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091648 00000100:00100000:1.0:1782759881.770713:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091648 00000100:00100000:1.0:1782759881.770728:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1782759881.770736:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0000+8:5803:x1869355212091392:12345-0@lo:106: 00010000:00010000:1.0:1782759881.770748:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759881.770759:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff9171a93c4c00/0xdd99f5c4777e0481 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b2 expref: -99 pid: 154816 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759881.770859:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0000+8:5803:x1869355212091392:12345-0@lo:106: Request processed in 123us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.770867:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1782759881.770887:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1782759881.770893:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:5803:x1869355212091520:12345-0@lo:106: 00010000:00010000:1.0:1782759881.770900:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759881.770908:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9171c0b91800/0xdd99f5c4777e0488 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04b9 expref: -99 pid: 154817 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759881.770955:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:5803:x1869355212091520:12345-0@lo:106: Request processed in 62us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.770960:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1782759881.770972:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1782759881.770979:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5803:x1869355212091648:12345-0@lo:106: 00010000:00010000:1.0:1782759881.770986:0:139369:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759881.770994:0:139369:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff917082f99a00/0xdd99f5c4777e047a lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e04ab expref: -99 pid: 154815 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759881.771028:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:5803:x1869355212091648:12345-0@lo:106: Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.771034:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1782759881.771603:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091392:0@lo:106: 00000100:00100000:1.0:1782759881.771620:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081875880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091520:0@lo:106: 00000100:00100000:1.0:1782759881.771627:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081874700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5803:1869355212091648:0@lo:106: 00000100:00100000:1.0:1782759881.771687:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109774:x1869355197384576:12345-192.168.204.31@tcp:48:lfs.0 Request processed in 84577us (85199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759881.771695:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2298 00000100:00100000:1.0:1782759882.157869:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759882.157895:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212091776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759882.157980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759882.158445:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091776 00000100:00100000:3.0:1782759882.158454:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091776 00000100:00100000:3.0:1782759882.158527:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:3.0:1782759882.158537:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212091776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759882.158572:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759882.158626:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212091776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759882.158794:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212091776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759882.158916:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00010000:00010000:0.0:1782759882.732493:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759883.756749:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759884.716167:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212091904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759884.716255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759884.716345:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212091904 00000100:00100000:1.0:1782759884.716355:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212091904 00000100:00100000:1.0:1782759884.716423:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1782759884.716433:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212091904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759884.716470:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759884.716511:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212091904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759884.716530:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00080000:1.0:1782759884.716556:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759884.716590:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212091904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759884.780741:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759884.843052:0:160638:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64j: Nodemap enforces projid_set RBAC role ========================================================== 15:04:42 (1782759882) 00000100:00100000:0.0:1782759885.006993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759885.007597:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384704 00000100:00100000:1.0:1782759885.007607:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384704 00000100:00100000:1.0:1782759885.007698:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1782759885.007709:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109966:x1869355197384704:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:1.0:1782759885.007846:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109966:x1869355197384704:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 138us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759885.007856:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00080000:3.0:1782759885.009104:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759885.011538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759885.011672:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197384960 00000100:00100000:1.0:1782759885.011683:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197384960 00000100:00100000:1.0:1782759885.011763:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2299 00000100:00100000:1.0:1782759885.012058:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:109966:x1869355197384960:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782759885.012123:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759885.012157:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0ede lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67309 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.012181:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1900) 00010000:00010000:1.0:1782759885.012196:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759885.013565:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.013585:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.013596:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.013659:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.013667:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.013675:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759885.018570:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782759885.018594:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.018605:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.018613:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.018620:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759885.018623:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.018631:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.018647:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5500) 00010000:00010000:1.0:1782759885.018650:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759885.018656:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.018661:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e0ee5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759885.018683:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071414047 reply state 0000000088955073 transno 4294968201 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759885.018693:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759885.018810:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:109966:x1869355197384960:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 7034us (7281us total) trans 4294968201 rc 0/0 00000100:00100000:1.0:1782759885.018874:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2299 00010000:00010000:3.0:1782759885.032876:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.032894:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.032903:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.032910:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759885.032916:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.032924:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.032944:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff9171889c5f00) 00010000:00010000:3.0:1782759885.032955:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759885.032960:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.032967:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e0eec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.814249:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759886.517461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759886.517509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759886.517642:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385088 00000100:00100000:2.0:1782759886.517669:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385088 00000100:00100000:2.0:1782759886.517741:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3137 00000100:00100000:2.0:1782759886.517753:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197385088:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759886.517866:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197385088:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 114us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759886.517874:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3137 00000100:00100000:3.0:1782759886.518302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759886.518329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759886.518377:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385216 00000100:00100000:2.0:1782759886.518383:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385216 00000100:00100000:2.0:1782759886.518429:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2850 00000100:00100000:2.0:1782759886.518437:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197385216:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759886.518485:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197385216:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759886.518492:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2850 00000100:00100000:0.0:1782759886.532801:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385344 00000100:00100000:0.0:1782759886.532816:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385344 00000100:00100000:0.0:1782759886.535024:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385472 00000100:00100000:0.0:1782759886.535040:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385472 00000100:00100000:0.0:1782759886.535080:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2296 00000100:00100000:0.0:1782759886.535090:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197385344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759886.535262:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197385344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 172us (17751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759886.535269:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2296 00000100:00100000:0.0:1782759886.535289:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2297 00000100:00100000:0.0:1782759886.535365:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197385472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759886.535390:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197385472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (17060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759886.535396:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2297 00000100:00080000:3.0:1782759886.537035:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759886.537047:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759886.773327:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212092032:0@lo:400:kworker.0 00000100:00100000:0.0:1782759886.773786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759886.774122:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092032 00000100:00100000:0.0:1782759886.774131:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092032 00000100:00100000:0.0:1782759886.774188:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:0.0:1782759886.774199:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759886.774342:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212092032:12345-0@lo:400:kworker.0 Request processed in 144us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759886.774350:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:0.0:1782759886.774405:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212092032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.777316:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212092160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.777382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759886.779362:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092160 00000100:00100000:1.0:1782759886.779375:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092160 00000100:00100000:1.0:1782759886.779441:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1782759886.779451:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212092160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.779541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212092160:12345-0@lo:400:kworker.0 Request processed in 90us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759886.779548:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1782759886.782896:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212092160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.783087:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212092672:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.783150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759886.783180:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759886.783209:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212092288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.784150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759886.784213:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212092416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759886.784354:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092288 00000100:00100000:2.0:1782759886.784364:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092288 00000100:00100000:2.0:1782759886.784465:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:2.0:1782759886.784476:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212092288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759886.784551:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212092288:12345-0@lo:400:kworker.0 Request processed in 76us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759886.784559:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1782759886.784625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759886.784658:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759886.784666:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212092544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.784692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759886.784724:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092672 00000100:00100000:1.0:1782759886.784728:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092672 00000100:00100000:2.0:1782759886.784766:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092416 00000100:00100000:2.0:1782759886.784770:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092416 00000100:00080000:0.0:1782759886.784970:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759886.785150:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759886.785154:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759886.785405:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:1.0:1782759886.785413:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212092672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.785462:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212092672:12345-0@lo:400:kworker.0 Request processed in 50us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759886.785469:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00100000:1.0:1782759886.785594:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092544 00000100:00100000:1.0:1782759886.785598:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092544 00000100:00100000:1.0:1782759886.785625:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1782759886.785631:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212092544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.785668:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212092544:12345-0@lo:400:kworker.0 Request processed in 37us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759886.785675:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1782759886.785711:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212092288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.785724:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212092672:0@lo:400:kworker.0 00000100:00100000:1.0:1782759886.786733:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212092544:0@lo:400:kworker.0 00000100:00080000:0.0:1782759886.787093:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759886.787430:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:2.0:1782759886.787440:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212092416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759886.787503:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212092416:12345-0@lo:400:kworker.0 Request processed in 66us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759886.787520:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:2.0:1782759886.787566:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212092416:0@lo:400:kworker.0 00010000:00010000:2.0:1782759886.831451:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759886.852206:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968201 is committed 00000100:00100000:2.0:1782759887.277086:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212092800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759887.277174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759887.278505:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092800 00000100:00100000:3.0:1782759887.278517:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092800 00000100:00100000:2.0:1782759887.278596:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1782759887.278610:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212092800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759887.279091:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759887.279213:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212092800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 607us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759887.279222:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1782759887.280592:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212092800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759887.853359:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759888.749201:0:160837:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7334b070 20000000:00000080:0.0:1782759888.749220:0:160837:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbf5b400 uarg=0000000000000000 10000000:01000000:0.0:1782759888.749704:0:160837:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759888.751468:0:160837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.751493:0:160837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.751503:0:160837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.751552:0:160837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.751568:0:160837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 18 pid: 5793 timeout: 4057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759888.751584:0:160837:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160837:1869355212092928:0@lo:104: 00000100:00100000:0.0:1782759888.751652:0:160837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759888.751763:0:160837:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759888.752264:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212092928 00000100:00100000:3.0:1782759888.752272:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212092928 00000100:00100000:3.0:1782759888.752361:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1782759888.752371:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:160837:x1869355212092928:12345-0@lo:104: 00010000:00010000:3.0:1782759888.752386:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759888.752464:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759888.752470:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:160837:x1869355212092928:12345-0@lo:104: Request processed in 101us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.752477:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1782759888.752542:0:160837:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160837:1869355212092928:0@lo:104: 00010000:00010000:1.0:1782759888.752565:0:160837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752610:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759888.752618:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752626:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759888.752630:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752639:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759888.752646:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759888.752652:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759888.752692:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752710:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759888.752743:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752751:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e0e91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0e98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752768:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759888.752769:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759888.752771:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759888.752784:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212093056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759888.752862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759888.752906:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093056 00000100:00100000:2.0:1782759888.752910:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093056 00010000:00010000:2.0:1782759888.752930:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 19 pid: 5793 timeout: 4057 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759888.752952:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1782759888.752959:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212093056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759888.752969:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759888.752975:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 19 pid: 5793 timeout: 4057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752984:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 19 pid: 5793 timeout: 4057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.752999:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e0e98 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0e91 expref: 19 pid: 5793 timeout: 4057 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753021:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753033:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753049:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753056:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753064:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753072:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753078:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759888.753082:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753088:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753100:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.753109:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759888.753142:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212093056:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759888.753156:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1782759888.753195:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212093056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759888.753289:0:160837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759888.753298:0:160837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759888.753304:0:160837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e0ef3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759888.875964:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759889.798500:0:160885:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff81ff89d0 20000000:00000080:0.0:1782759889.798521:0:160885:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb93d400 uarg=0000000000000000 10000000:01000000:0.0:1782759889.799009:0:160885:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759889.799030:0:160885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799047:0:160885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799058:0:160885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799066:0:160885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799081:0:160885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799089:0:160885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799095:0:160885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759889.799099:0:160885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799108:0:160885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799121:0:160885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799128:0:160885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759889.799135:0:160885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e0efa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759889.836361:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759889.836389:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212093184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759889.836460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759889.836520:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093184 00000100:00100000:1.0:1782759889.836528:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093184 00000100:00100000:1.0:1782759889.836593:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:1.0:1782759889.836602:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212093184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759889.836639:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759889.836681:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212093184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759889.836688:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00080000:1.0:1782759889.836714:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759889.836747:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212093184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759889.900270:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759890.669975:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759890.669983:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759890.669988:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759890.670041:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759890.670052:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759890.670080:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759890.670107:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212093312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759890.670181:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759890.670223:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759890.670297:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093312 00000100:00100000:1.0:1782759890.670304:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093312 00000100:00100000:1.0:1782759890.670356:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:1.0:1782759890.670365:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212093312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759890.670379:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759890.670394:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0f01 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759890.670416:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759890.670426:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759890.670436:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030e00, rc 0) 00000100:00100000:1.0:1782759890.670490:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212093312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759890.670498:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:3.0:1782759890.671894:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212093312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759890.671919:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759890.671930:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759890.671971:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759890.671977:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759890.671984:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759890.924235:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759891.641228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759891.641268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759891.641313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759891.641337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759891.641371:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385984 00000100:00100000:1.0:1782759891.641393:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385984 00000100:00100000:1.0:1782759891.641491:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385856 00000100:00100000:1.0:1782759891.641495:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385856 00000100:00100000:1.0:1782759891.641521:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2300 00000100:00100000:1.0:1782759891.641531:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197385984:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759891.641588:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385728 00000100:00100000:2.0:1782759891.641594:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385728 00000100:00100000:1.0:1782759891.641617:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197385984:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759891.641627:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2300 00000100:00100000:2.0:1782759891.641636:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2854 00000100:00100000:2.0:1782759891.641647:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197385728:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759891.641654:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2301 00000100:00100000:1.0:1782759891.641664:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197385856:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759891.641687:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197385728:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 41us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759891.641695:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2854 00000100:00100000:1.0:1782759891.641700:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197385856:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759891.641708:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2301 00000100:00080000:1.0:1782759891.641729:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759891.641734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759891.641747:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759891.641933:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197385600 00000100:00100000:0.0:1782759891.641939:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197385600 00000100:00100000:0.0:1782759891.641967:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3140 00000100:00100000:0.0:1782759891.641973:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197385600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759891.642000:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197385600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759891.642007:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3140 00000100:00100000:1.0:1782759891.885030:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212093696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.885063:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212093440:0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.886137:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212093824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.888269:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759891.888487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759891.888520:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212093952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.888556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759891.888575:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759891.888581:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212093568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.888621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759891.888637:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212094080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.888655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759891.888679:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093952 00000100:00100000:2.0:1782759891.888685:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093952 00000100:00100000:2.0:1782759891.888724:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093568 00000100:00100000:2.0:1782759891.888726:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093568 00000100:00100000:2.0:1782759891.888763:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1782759891.888782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759891.888784:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212093952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.888851:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212093952:12345-0@lo:400:kworker.0 Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759891.888857:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:2.0:1782759891.888927:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093696 00000100:00100000:2.0:1782759891.888931:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093696 00000100:00100000:2.0:1782759891.888956:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:2.0:1782759891.888963:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.888987:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093824 00000100:00100000:2.0:1782759891.888993:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212093568:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759891.888994:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093824 00000100:00100000:2.0:1782759891.889001:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:2.0:1782759891.889018:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:2.0:1782759891.889025:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212093696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.889032:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094080 00000100:00100000:0.0:1782759891.889037:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094080 00000100:00100000:2.0:1782759891.889060:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212093696:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00080000:1.0:1782759891.889066:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759891.889067:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1782759891.889071:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00080000:1.0:1782759891.889072:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759891.889078:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759891.889083:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212093824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.889089:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:2.0:1782759891.889098:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.889139:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212093824:12345-0@lo:400:kworker.0 Request processed in 58us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759891.889145:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212094080:12345-0@lo:400:kworker.0 Request processed in 47us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759891.889152:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1782759891.889160:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00100000:1.0:1782759891.889161:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212093696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.889186:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212093440 00000100:00100000:2.0:1782759891.889194:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212093568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.889200:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212093440 00000100:00100000:2.0:1782759891.889206:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212094080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759891.889221:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212093952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.889235:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:0.0:1782759891.889321:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212093440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759891.889369:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212093440:12345-0@lo:400:kworker.0 Request processed in 127us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759891.889376:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:0.0:1782759891.889547:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212093440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759891.889594:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212093824:0@lo:400:kworker.0 00010000:00010000:2.0:1782759891.947922:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759892.414504:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212094208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759892.414591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759892.415982:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094208 00000100:00100000:2.0:1782759892.415995:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094208 00000100:00100000:2.0:1782759892.416050:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1782759892.416060:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212094208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759892.416204:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759892.416275:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212094208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759892.416282:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1782759892.416435:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212094208:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1782759892.539787:0:161036:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeba59d180 20000000:00000080:1.0:1782759892.539808:0:161036:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917186ca2c00 uarg=0000000000000000 10000000:01000000:1.0:1782759892.542541:0:161036:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759892.542564:0:161036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759892.542583:0:161036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759892.542591:0:161036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759892.542630:0:161036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759892.542647:0:161036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 18 pid: 5793 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759892.542664:0:161036:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161036:1869355212094336:0@lo:104: 00000100:00100000:1.0:1782759892.542745:0:161036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759892.542924:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094336 00000100:00100000:2.0:1782759892.542933:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094336 00000100:00100000:1.0:1782759892.542990:0:161036:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826956c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759892.545326:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1782759892.545350:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161036:x1869355212094336:12345-0@lo:104: 00010000:00010000:2.0:1782759892.545369:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.545514:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759892.545520:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161036:x1869355212094336:12345-0@lo:104: Request processed in 184us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759892.545528:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1782759892.549895:0:161036:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161036:1869355212094336:0@lo:104: 00010000:00010000:0.0:1782759892.549928:0:161036:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550056:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759892.550065:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550074:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759892.550078:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550088:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759892.550095:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759892.550101:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759892.550170:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550177:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759892.550204:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550230:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e0f01 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f08 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550248:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759892.550250:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759892.550252:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759892.550287:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212094464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759892.550349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759892.550415:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094464 00000100:00100000:3.0:1782759892.550422:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094464 00010000:00010000:3.0:1782759892.550452:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 19 pid: 5793 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759892.550586:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1782759892.550596:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212094464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759892.550610:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759892.550616:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 19 pid: 5793 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550626:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 19 pid: 5793 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550639:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030e00/0xdd99f5c4777e0f08 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0f01 expref: 19 pid: 5793 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550652:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550670:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550684:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550691:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550696:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550703:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550708:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759892.550712:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550728:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550737:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.550746:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759892.550780:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212094464:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759892.550788:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1782759892.550850:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212094464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759892.551064:0:161036:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759892.551073:0:161036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759892.551078:0:161036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031800/0xdd99f5c4777e0f0f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.975489:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759893.409635:0:161084:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffced778b90 20000000:00000080:1.0:1782759893.409653:0:161084:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084fa2000 uarg=0000000000000000 10000000:01000000:1.0:1782759893.410404:0:161084:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759893.410427:0:161084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.410445:0:161084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.410456:0:161084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.410463:0:161084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.410469:0:161084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.410476:0:161084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.410483:0:161084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759893.411602:0:161084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.411620:0:161084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.411634:0:161084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.411643:0:161084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.411649:0:161084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030600/0xdd99f5c4777e0f16 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759893.932034:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759893.932042:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759893.932047:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759893.932094:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759893.932106:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759893.932119:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759893.932148:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212094592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759893.932222:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759893.932286:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759893.932364:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094592 00000100:00100000:1.0:1782759893.932372:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094592 00000100:00100000:1.0:1782759893.932431:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:1.0:1782759893.932441:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212094592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759893.932455:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759893.932468:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0f1d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.932493:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.932503:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759893.932513:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030800, rc 0) 00000100:00100000:1.0:1782759893.932558:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212094592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759893.932578:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1782759893.932709:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212094592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759893.932733:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759893.932742:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759893.932762:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759893.932767:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759893.932774:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759894.000207:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759894.382510:0:161132:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7ab57a10 20000000:00000080:2.0:1782759894.382529:0:161132:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082702000 uarg=0000000000000000 10000000:01000000:2.0:1782759894.383655:0:161132:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759894.383696:0:161132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759894.383715:0:161132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759894.383736:0:161132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759894.383773:0:161132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759894.383788:0:161132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 18 pid: 5793 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759894.383804:0:161132:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081877800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161132:1869355212094720:0@lo:104: 00000100:00100000:2.0:1782759894.383886:0:161132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759894.384101:0:161132:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181a240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759894.386538:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759894.387352:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094720 00000100:00100000:1.0:1782759894.387364:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094720 00000100:00100000:3.0:1782759894.387508:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1782759894.387521:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7838050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161132:x1869355212094720:12345-0@lo:104: 00010000:00010000:3.0:1782759894.387543:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759894.387884:0:161132:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081877800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161132:1869355212094720:0@lo:104: 00010000:00010000:2.0:1782759894.387914:0:161132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759894.388164:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759894.388172:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7838050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161132:x1869355212094720:12345-0@lo:104: Request processed in 654us (4286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759894.388180:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00010000:00010000:0.0:1782759894.388338:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759894.388361:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759894.388368:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75a00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759894.388373:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759894.388382:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759894.388389:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759894.388394:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759894.388449:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759894.388455:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759894.388507:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212094848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759894.388571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759894.388938:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094848 00000100:00100000:1.0:1782759894.388946:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094848 00010000:00010000:1.0:1782759894.388978:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 19 pid: 5793 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759894.389020:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1782759894.389028:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212094848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759894.389041:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759894.389046:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 19 pid: 5793 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389056:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 19 pid: 5793 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389071:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030800/0xdd99f5c4777e0f24 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0f1d expref: 19 pid: 5793 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389087:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389095:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389109:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389115:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389129:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389136:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389141:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759894.389146:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389153:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389169:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759894.389179:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759894.389675:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759894.389693:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75a00/0xdd99f5c4777e0f1d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759894.389710:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759894.389712:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759894.389714:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759894.391229:0:161132:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759894.391245:0:161132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759894.391273:0:161132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e0f2b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759894.396445:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212094848:12345-0@lo:103:ldlm_bl.0 Request processed in 7406us (7862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759894.396464:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1782759894.406275:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212094848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759894.959568:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759894.959589:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212094976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759894.960068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759894.960225:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212094976 00000100:00100000:3.0:1782759894.960233:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212094976 00000100:00100000:3.0:1782759894.960300:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1782759894.960312:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212094976:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759894.960453:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782759894.960508:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759894.960577:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212094976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759894.960585:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1782759894.960754:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212094976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759895.019989:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759895.286647:0:161180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6d5b8940 20000000:00000080:0.0:1782759895.286680:0:161180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084d16800 uarg=0000000000000000 10000000:01000000:0.0:1782759895.287369:0:161180:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759895.287401:0:161180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287419:0:161180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287430:0:161180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287437:0:161180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287443:0:161180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287449:0:161180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287455:0:161180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759895.287460:0:161180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287467:0:161180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287481:0:161180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287488:0:161180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.287494:0:161180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e0f32 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759895.983120:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759895.983129:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759895.983135:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759895.983186:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.983198:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.983209:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759895.983236:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212095104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759895.983306:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759895.983360:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917083b28840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759895.984813:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095104 00000100:00100000:0.0:1782759895.984879:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095104 00000100:00100000:0.0:1782759895.984961:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:0.0:1782759895.984972:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212095104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759895.984993:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759895.985012:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0f39 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.985043:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.985056:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.985066:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75200, rc 0) 00000100:00100000:0.0:1782759895.985144:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212095104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.985150:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00100000:0.0:1782759895.985230:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b7766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212095104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759895.985251:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.985260:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759895.985282:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759895.985288:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.985309:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.064850:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759896.602341:0:161228:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe03497850 20000000:00000080:0.0:1782759896.602358:0:161228:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084d17800 uarg=0000000000000000 00010000:00010000:0.0:1782759896.602580:0:161228:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759896.602595:0:161228:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759896.602609:0:161228:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759896.602628:0:161228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.602657:0:161228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.602665:0:161228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.602702:0:161228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.602716:0:161228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 18 pid: 5794 timeout: 4065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759896.602733:0:161228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161228:1869355212095232:0@lo:104: 00000100:00100000:0.0:1782759896.602796:0:161228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759896.602880:0:161228:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759896.603073:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095232 00000100:00100000:1.0:1782759896.603080:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095232 00000100:00100000:1.0:1782759896.603127:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1782759896.603137:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161228:x1869355212095232:12345-0@lo:104: 00010000:00010000:1.0:1782759896.603152:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.603218:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759896.603224:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161228:x1869355212095232:12345-0@lo:104: Request processed in 89us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759896.603243:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00010000:00010000:1.0:1782759896.603271:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759896.603277:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.603285:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759896.603288:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.603297:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759896.603304:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759896.603310:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759896.603339:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.603345:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759896.603378:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.603385:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcd400/0xdd99f5c4777e0f39 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f40 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.603400:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759896.603403:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759896.603405:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759896.603422:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212095360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759896.603457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759896.604040:0:161228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161228:1869355212095232:0@lo:104: 00010000:00010000:0.0:1782759896.604070:0:161228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759896.604694:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095360 00000100:00100000:2.0:1782759896.604701:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095360 00010000:00010000:2.0:1782759896.604733:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 19 pid: 5794 timeout: 4065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759896.604771:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1782759896.604779:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212095360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759896.604791:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759896.604795:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 19 pid: 5794 timeout: 4065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604805:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 19 pid: 5794 timeout: 4065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604819:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e0f40 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0f39 expref: 19 pid: 5794 timeout: 4065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604846:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604854:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604868:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604875:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604882:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604887:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604899:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759896.604903:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604911:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604929:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.604939:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759896.604988:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212095360:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759896.604996:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1782759896.605026:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bdef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212095360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759896.605131:0:161228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.605140:0:161228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.605146:0:161228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e0f47 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759896.756120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759896.756168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759896.756211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759896.756255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759896.756286:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386496 00000100:00100000:3.0:1782759896.756769:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386496 00000100:00100000:3.0:1782759896.756856:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386368 00000100:00100000:3.0:1782759896.756859:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386368 00000100:00100000:3.0:1782759896.756882:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2304 00000100:00100000:3.0:1782759896.756900:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197386496:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759896.757384:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197386496:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 492us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759896.757469:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2304 00000100:00100000:3.0:1782759896.757496:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2305 00000100:00100000:3.0:1782759896.757504:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197386368:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759896.757535:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197386368:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759896.757540:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2305 00000100:00100000:3.0:1782759896.757565:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386112 00000100:00100000:3.0:1782759896.757569:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386112 00000100:00100000:3.0:1782759896.757596:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3144 00000100:00100000:3.0:1782759896.757602:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197386112:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759896.757624:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197386112:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759896.757630:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3144 00000100:00080000:3.0:1782759896.757671:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759896.757675:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759896.759096:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386240 00000100:00100000:0.0:1782759896.759108:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386240 00000100:00100000:0.0:1782759896.759175:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2858 00000100:00100000:0.0:1782759896.759188:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197386240:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759896.759252:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197386240:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759896.759259:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2858 00000100:00080000:3.0:1782759896.759801:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759897.005514:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212095872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759897.005515:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212095488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759897.005721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759897.005738:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212095616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.005768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759897.005795:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212096000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.005803:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759897.005812:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212095744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759897.005847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759897.005869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759897.005917:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095488 00000100:00100000:1.0:1782759897.005921:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096000 00000100:00100000:0.0:1782759897.005926:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095488 00000100:00100000:1.0:1782759897.005927:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096000 00000100:00100000:0.0:1782759897.005972:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095616 00000100:00100000:0.0:1782759897.005976:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095616 00000100:00100000:0.0:1782759897.006000:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1782759897.006008:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212095488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.006063:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bdef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212095488:12345-0@lo:400:kworker.0 Request processed in 55us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759897.006070:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1782759897.006088:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1782759897.006105:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212095616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.006143:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212095616:12345-0@lo:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759897.006150:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1782759897.006169:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095744 00000100:00100000:0.0:1782759897.006173:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095744 00000100:00100000:0.0:1782759897.006202:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1782759897.006208:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212095744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.006239:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212095744:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759897.006245:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1782759897.007052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759897.007100:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212095872 00000100:00100000:0.0:1782759897.007104:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212095872 00000100:00100000:0.0:1782759897.007136:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759897.007143:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212095872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.007191:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212095872:12345-0@lo:400:kworker.0 Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759897.007198:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759897.007244:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212095744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.007259:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212095616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759897.007289:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212095872:0@lo:400:kworker.0 00000100:00080000:1.0:1782759897.008337:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759897.008344:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759897.008346:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759897.008680:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212095488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759897.011189:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:1.0:1782759897.011205:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212096000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759897.011302:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212096000:12345-0@lo:400:kworker.0 Request processed in 101us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759897.011309:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:1.0:1782759897.012762:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212096000:0@lo:400:kworker.0 00010000:00010000:2.0:1782759897.073974:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759897.524807:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212096128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759897.524903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759897.525098:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096128 00000100:00100000:0.0:1782759897.525106:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096128 00000100:00100000:0.0:1782759897.525166:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1782759897.525175:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212096128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759897.525214:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759897.525265:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212096128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759897.525272:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1782759897.525481:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212096128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759898.092068:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759898.220301:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759898.220379:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759898.220385:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759898.220452:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759898.220467:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759898.220481:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759898.220515:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212096256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759898.220602:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759898.220698:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759898.222089:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096256 00000100:00100000:3.0:1782759898.222106:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096256 00000100:00100000:3.0:1782759898.222180:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:3.0:1782759898.222194:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212096256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759898.222218:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759898.222243:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0f4e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.222280:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.222294:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.222306:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd000, rc 0) 00000100:00100000:3.0:1782759898.222386:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212096256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759898.222394:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:3.0:1782759898.222466:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212096256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759898.222487:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.222498:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759898.222528:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759898.222535:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.222556:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759899.116975:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759900.076157:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212096384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759900.076233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759900.076359:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096384 00000100:00100000:1.0:1782759900.076368:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096384 00000100:00100000:1.0:1782759900.076430:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1782759900.076440:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212096384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759900.076497:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759900.081112:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212096384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4664us (4870us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759900.081126:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00080000:1.0:1782759900.081167:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759900.085773:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212096384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759900.142079:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759900.821673:0:161426:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4b7d86d0 20000000:00000080:0.0:1782759900.821689:0:161426:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084d14400 uarg=0000000000000000 00010000:00010000:1.0:1782759900.828213:0:161426:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759900.828235:0:161426:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759900.828254:0:161426:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759900.828401:0:161426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.828422:0:161426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.828431:0:161426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.828654:0:161426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.828670:0:161426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 18 pid: 5793 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759900.828685:0:161426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161426:1869355212096512:0@lo:104: 00000100:00100000:1.0:1782759900.828927:0:161426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759900.829050:0:161426:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3237180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759900.829052:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096512 00000100:00100000:3.0:1782759900.829058:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096512 00000100:00100000:3.0:1782759900.829116:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1782759900.829126:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161426:x1869355212096512:12345-0@lo:104: 00010000:00010000:3.0:1782759900.829149:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759900.829227:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759900.829234:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161426:x1869355212096512:12345-0@lo:104: Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.829241:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00010000:00010000:0.0:1782759900.829359:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759900.829367:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829375:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759900.829386:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829395:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759900.829403:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759900.829420:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759900.829453:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829459:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759900.829487:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829495:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e0f4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759900.829501:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212096640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759900.829511:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759900.829513:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759900.829514:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759900.829532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759900.829616:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096640 00000100:00100000:0.0:1782759900.829621:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096640 00010000:00010000:0.0:1782759900.829641:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 19 pid: 5793 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759900.829670:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1782759900.829678:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212096640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759900.829688:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759900.829700:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 19 pid: 5793 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829710:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 19 pid: 5793 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829726:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829746:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829759:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829766:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829772:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829778:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829783:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759900.829786:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829793:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829801:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.829818:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759900.829876:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212096640:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759900.829883:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1782759900.829916:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212096640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759900.830625:0:161426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e0f55 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0f4e expref: 18 pid: 5793 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759900.830638:0:161426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161426:1869355212096512:0@lo:104: 00010000:00010000:1.0:1782759900.830654:0:161426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.830661:0:161426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.830667:0:161426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.830673:0:161426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777e0f5c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.164347:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759901.878065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759901.878099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759901.878139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759901.878169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759901.878557:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386880 00000100:00100000:3.0:1782759901.878567:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386880 00000100:00100000:3.0:1782759901.878628:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197387008 00000100:00100000:3.0:1782759901.878632:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197387008 00000100:00100000:3.0:1782759901.878659:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1046 00000100:00100000:3.0:1782759901.878669:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2360:x1869355197386880:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:3.0:1782759901.878702:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777e0ec9 00000100:00080000:3.0:1782759901.878711:0:6597:0:(import.c:65:import_set_state_nolock()) ffff91708297a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759901.878762:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967444 00000100:00100000:0.0:1782759901.879102:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1047 00000100:00100000:0.0:1782759901.879114:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2360:x1869355197387008:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1782759901.879129:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777e0ed0 00000100:00080000:0.0:1782759901.879135:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9170836c8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759901.879161:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967435 00000100:00100000:3.0:1782759901.880849:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+2:2360:x1869355197386880:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 2155us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759901.880871:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1046 00000100:00100000:0.0:1782759901.881037:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+2:2360:x1869355197387008:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 1925us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759901.881046:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1047 00000100:00100000:0.0:1782759901.881069:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386752 00000100:00100000:0.0:1782759901.881075:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386752 00000100:00100000:0.0:1782759901.881117:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2862 00000100:00100000:0.0:1782759901.881125:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2364:x1869355197386752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759901.881159:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2364:x1869355197386752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759901.881164:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2862 00010000:00010000:0.0:1782759901.881514:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759901.881521:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759901.883091:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197386624 00000100:00100000:3.0:1782759901.883103:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197386624 00000100:00100000:3.0:1782759901.883165:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3146 00000100:00100000:3.0:1782759901.883175:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197386624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759901.883258:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197386624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759901.883266:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3146 00000100:00080000:3.0:1782759901.883302:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759901.883307:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759901.883310:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759902.129177:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212096768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.129323:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212097280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.129374:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759902.129380:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212097152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.129434:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212096896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.129470:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212097408:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.129509:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759902.129514:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212097024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.129576:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096768 00000100:00100000:0.0:1782759902.129584:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096768 00000100:00100000:0.0:1782759902.129628:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:0.0:1782759902.129637:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212096768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.129687:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212096768:12345-0@lo:400:kworker.0 Request processed in 51us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.129694:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:0.0:1782759902.129727:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097280 00000100:00100000:0.0:1782759902.129730:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097280 00000100:00100000:0.0:1782759902.129760:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212096896 00000100:00100000:0.0:1782759902.129763:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212096896 00000100:00100000:0.0:1782759902.129778:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097024 00000100:00100000:0.0:1782759902.129780:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097024 00000100:00100000:0.0:1782759902.129798:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1782759902.129803:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212097280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130100:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212097280:12345-0@lo:400:kworker.0 Request processed in 295us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.130107:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1782759902.130121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1782759902.130127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212096896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130158:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212096896:12345-0@lo:400:kworker.0 Request processed in 32us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.130164:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1782759902.130175:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1782759902.130181:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212097024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130207:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212097024:12345-0@lo:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.130212:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1782759902.130229:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097152 00000100:00100000:0.0:1782759902.130232:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097152 00000100:00100000:0.0:1782759902.130254:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097408 00000100:00100000:0.0:1782759902.130257:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097408 00000100:00100000:0.0:1782759902.130275:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:0.0:1782759902.130281:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212097152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130323:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212097152:12345-0@lo:400:kworker.0 Request processed in 42us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.130329:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:0.0:1782759902.130340:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:0.0:1782759902.130345:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212097408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130373:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212097408:12345-0@lo:400:kworker.0 Request processed in 28us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.130389:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:0.0:1782759902.130442:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212097152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130453:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212096768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130463:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212097280:0@lo:400:kworker.0 00000100:00080000:0.0:1782759902.130491:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759902.130495:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759902.130498:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759902.130528:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212097024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130554:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212096896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759902.130563:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212097408:0@lo:400:kworker.0 00000001:00100000:3.0:1782759902.174021:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:3.0:1782759902.174032:0:7507:0:(genops.c:906:class_export_put()) final put ffff9170836cb000/95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:3.0:1782759902.174066:0:88727:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836cb000/95d4477b-602f-4eb6-8798-a97fbce0e608 for lustre-OST0001 00000020:00000080:3.0:1782759902.174114:0:88727:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836c8000 for lustre-OST0001 00000001:00100000:2.0:1782759902.183343:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:2.0:1782759902.183356:0:6622:0:(genops.c:906:class_export_put()) final put ffff917082978000/95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:3.0:1782759902.183454:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917082978000/95d4477b-602f-4eb6-8798-a97fbce0e608 for lustre-OST0000 00000020:00000080:3.0:1782759902.183512:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91708297a800 for lustre-OST0000 00010000:00010000:3.0:1782759902.189223:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759902.251964:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759902.251973:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759902.251978:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759902.252029:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759902.252044:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759902.252068:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759902.252099:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212097536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759902.252189:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759902.252257:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759902.252401:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097536 00000100:00100000:0.0:1782759902.252410:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097536 00000100:00100000:0.0:1782759902.252464:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:0.0:1782759902.252475:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212097536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759902.252489:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759902.252504:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e0f63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759902.252545:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759902.252557:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759902.252568:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75400, rc 0) 00000100:00100000:0.0:1782759902.252622:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212097536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.252640:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:2.0:1782759902.252755:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212097536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759902.252772:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759902.252781:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759902.252815:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759902.252981:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759902.252991:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759902.644423:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759902.644451:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212097664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759902.644549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759902.644811:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097664 00000100:00100000:0.0:1782759902.644848:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097664 00000100:00100000:0.0:1782759902.645333:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1782759902.645346:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212097664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759902.645376:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759902.645446:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212097664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759902.645453:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1782759902.646625:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212097664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759903.212124:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759903.944913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759903.945002:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197387136 00000100:00100000:0.0:1782759903.945013:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197387136 00000100:00100000:0.0:1782759903.945091:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2300 00000100:00100000:0.0:1782759903.945103:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110276:x1869355197387136:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759903.945126:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759903.945152:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e0f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67310 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.945214:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e0f78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.945228:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e0f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.945241:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e0f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759903.945452:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1782759903.945456:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759903.945559:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e0f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.945585:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e0f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67310 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.945600:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e0f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67310 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.945608:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1400) 00010000:00010000:0.0:1782759903.945611:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759903.945615:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75a00, rc 0) 00000100:00100000:0.0:1782759903.945676:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110276:x1869355197387136:12345-192.168.204.31@tcp:101:touch.0 Request processed in 575us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759903.945684:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2300 00000100:00080000:1.0:1782759903.945924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759903.950391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759903.950587:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197387264 00000100:00100000:1.0:1782759903.950598:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197387264 00000100:00100000:2.0:1782759903.953665:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2301 00000100:00100000:2.0:1782759903.953682:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110276:x1869355197387264:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759903.953703:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759903.953780:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e0f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67317 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.953858:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.953872:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.953884:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.953898:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.953917:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.953924:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954395:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0f94 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954404:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0f94 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954411:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0f94 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759903.954494:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782759903.954509:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759903.954586:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0f94 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954600:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954607:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954614:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954620:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759903.954625:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954639:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954651:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1400) 00010000:00010000:2.0:1782759903.954654:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759903.954659:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954665:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e0f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954675:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954680:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954687:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954692:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759903.954695:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954700:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954706:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff917191f75500) 00010000:00010000:2.0:1782759903.954708:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759903.954710:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954866:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e0f8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954902:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e0f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67317 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954916:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0f94 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67317 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.954924:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782759903.954927:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759903.954929:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782759903.955020:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110276:x1869355197387264:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1343us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759903.955030:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2301 00000100:00100000:1.0:1782759903.961036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759903.962699:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197387520 00000100:00100000:2.0:1782759903.962716:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197387520 00000100:00100000:2.0:1782759903.962849:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2302 00000100:00100000:2.0:1782759903.962860:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110276:x1869355197387520:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759903.962889:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759903.962893:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782759903.962929:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e0f94 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67317 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.962950:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782759903.962963:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759903.962991:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0f9b lrc: 2/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6731e expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.963329:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 3/0,1 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.963343:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.963354:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.963366:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.963373:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.963379:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759903.965355:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38:0x0], index 0: 0 00010000:00010000:2.0:1782759903.965642:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0fb0 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.965660:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.965671:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.965710:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966665:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 2/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966672:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966679:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759903.966683:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966692:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 4/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966706:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759903.966710:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759903.966715:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 2/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966733:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0fa2 lrc: 0/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759903.966748:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a622aa2 reply state 00000000bb8a5a0f transno 4294968202 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759903.966758:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759903.966811:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e0f9b lrc: 0/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6731e expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966846:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6731e expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759903.966865:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782759903.966867:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759903.966870:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759903.966962:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110276:x1869355197387520:12345-192.168.204.31@tcp:101:touch.0 Request processed in 4103us (5935us total) trans 4294968202 rc 0/0 00000100:00100000:2.0:1782759903.966972:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2302 00000100:00100000:2.0:1782759903.970771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759903.970901:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197387776 00000100:00100000:3.0:1782759903.970911:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197387776 00000100:00100000:3.0:1782759903.970971:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2303 00000100:00100000:3.0:1782759903.970981:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110276:x1869355197387776:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:3.0:1782759903.971041:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759903.971069:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e0fb0 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6731e expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.971090:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75300) 00010000:00010000:3.0:1782759903.971102:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759903.971145:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,1 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.971159:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.971170:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759903.971336:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096cf12fe reply state 000000002fa65a0e transno 4294968203 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759903.971345:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759903.971439:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110276:x1869355197387776:12345-192.168.204.31@tcp:36:touch.0 Request processed in 459us (680us total) trans 4294968203 rc 0/0 00000100:00100000:3.0:1782759903.971447:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2303 00010000:00010000:0.0:1782759903.972291:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.972301:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.972309:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.972315:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759903.972319:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.972337:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.972353:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff917191f75400) 00010000:00010000:0.0:1782759903.972356:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759903.972361:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.972368:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e0fa9 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759903.975534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759903.975609:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197387904 00000100:00100000:0.0:1782759903.975619:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197387904 00000100:00100000:0.0:1782759903.975678:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2304 00000100:00100000:0.0:1782759903.975689:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110276:x1869355197387904:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759903.975715:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759903.975736:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e0fc5 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67325 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.975796:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e0fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67325 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.975843:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e0fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67325 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759903.975866:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:0.0:1782759903.975870:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759903.975887:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75600, rc 0) 00000100:00100000:0.0:1782759903.975940:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110276:x1869355197387904:12345-192.168.204.31@tcp:101:touch.0 Request processed in 253us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759903.975947:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2304 00010000:00010000:3.0:1782759903.981600:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.981619:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.981627:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.981633:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759903.981638:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.981646:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.981667:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759903.981670:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759903.981676:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 2/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759903.981682:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fbe lrc: 0/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759903.987515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759903.987585:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197388032 00000100:00100000:1.0:1782759903.987594:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197388032 00000100:00100000:1.0:1782759903.987649:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1048 00000100:00100000:1.0:1782759903.987658:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1869355197388032:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:1.0:1782759903.987687:0:9120:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 95d4477b-602f-4eb6-8798-a97fbce0e608@192.168.204.31@tcp t0 exp 0000000000000000 cur 3972 last 0 00000020:00000080:1.0:1782759903.987712:0:9120:0:(genops.c:1406:class_connect()) connect: client 95d4477b-602f-4eb6-8798-a97fbce0e608, cookie 0xdd99f5c4777e0fcc 00002000:00100000:1.0:1782759903.987725:0:9120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95d4477b-602f-4eb6-8798-a97fbce0e608/ffff917082ef6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759903.987748:0:9120:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759903.988039:0:9120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782759903.988068:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917082ef5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759903.988133:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2360:x1869355197388032:12345-192.168.204.31@tcp:8:touch.0 Request processed in 475us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759903.988139:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1048 00000100:00100000:1.0:1782759903.990246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759903.990317:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197388160 00000100:00100000:3.0:1782759903.990326:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197388160 00000100:00100000:3.0:1782759903.990398:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000100:00100000:3.0:1782759903.990409:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:0:x1869355197388160:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:1.0:1782759903.990766:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759904.048522:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+7:0:x1869355197388160:12345-192.168.204.31@tcp:2:touch.0 Request processed in 58103us (58271us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1782759904.048538:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1049 00000001:00100000:3.0:1782759904.049395:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000001:00080000:3.0:1782759904.049411:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967445 is committed 00000100:00100000:3.0:1782759904.050532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759904.050999:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197388416 00000100:00100000:1.0:1782759904.051011:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197388416 00000100:00100000:1.0:1782759904.051078:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 402 00000100:00100000:1.0:1782759904.051089:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110276:x1869355197388416:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782759904.051487:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110276:x1869355197388416:12345-192.168.204.31@tcp:35:touch.0 Request processed in 398us (961us total) trans 4294968204 rc 0/0 00000100:00100000:1.0:1782759904.051505:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 402 00000100:00100000:0.0:1782759904.073407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759904.073485:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197388544 00000100:00100000:3.0:1782759904.073506:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197388544 00000100:00100000:3.0:1782759904.073566:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2305 00000100:00100000:3.0:1782759904.073577:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110277:x1869355197388544:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:3.0:1782759904.073605:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759904.073627:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6732c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.073698:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.073712:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.073724:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.073739:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.073746:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.073772:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074325:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0fe8 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074335:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074343:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759904.074380:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782759904.074384:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759904.074409:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074421:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074428:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074435:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074441:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759904.074446:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074454:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074476:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782759904.074479:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759904.074485:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074491:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e0fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074523:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074530:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074536:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074540:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759904.074543:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074550:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074558:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff9171908a1600) 00010000:00010000:3.0:1782759904.074560:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759904.074563:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074569:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e0fe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074614:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6732c expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074628:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6732c expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.074637:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759904.074639:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759904.074641:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759904.074751:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110277:x1869355197388544:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 1175us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759904.074760:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2305 00000100:00100000:0.0:1782759904.080419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759904.080509:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197388800 00000100:00100000:3.0:1782759904.080523:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197388800 00000100:00100000:3.0:1782759904.080626:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2306 00000100:00100000:3.0:1782759904.080637:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110277:x1869355197388800:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782759904.080788:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 3/0,1 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.080803:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.080935:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.082729:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.082755:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.082767:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759904.083750:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782759904.083765:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.083773:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 2/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.083781:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.083787:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759904.083792:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.083799:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 4/0,0 mode: CW/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.083946:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:0.0:1782759904.083949:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759904.083954:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 2/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.083961:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e0fef lrc: 0/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759904.083974:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c4590ef reply state 00000000c4071644 transno 4294968205 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759904.083984:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759904.084128:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+13:110277:x1869355197388800:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 3488us (3716us total) trans 4294968205 rc 0/0 00000100:00100000:0.0:1782759904.084139:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2306 00010000:00010000:0.0:1782759904.085656:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.085670:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.085676:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.085681:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759904.085686:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.085693:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.085724:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917182dd1f00) 00010000:00010000:0.0:1782759904.085727:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759904.085731:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.085737:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74e00/0xdd99f5c4777e0ff6 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759904.100620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.100781:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197388928 00000100:00100000:2.0:1782759904.100792:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197388928 00000100:00100000:2.0:1782759904.100885:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2307 00000100:00100000:2.0:1782759904.100896:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+12:110278:x1869355197388928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759904.100923:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759904.100944:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0ffd lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67333 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101009:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101023:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101034:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101049:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101056:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101078:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101186:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101194:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101201:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759904.101234:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759904.101238:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759904.101257:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101274:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101283:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101290:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101297:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101303:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.101307:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101321:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101335:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:2.0:1782759904.101338:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759904.101343:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101350:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1004 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101364:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101370:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101376:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101380:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.101383:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101388:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101394:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff917191f75900) 00010000:00010000:2.0:1782759904.101397:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759904.101400:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101412:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e100b lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101442:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e0ffd lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67333 expref: 14 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101455:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67333 expref: 13 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.101462:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:2.0:1782759904.101464:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759904.101467:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90800, rc 0) 00000100:00100000:2.0:1782759904.101597:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+13:110278:x1869355197388928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 702us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759904.101605:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2307 00000100:00100000:1.0:1782759904.107478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759904.107561:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197389056 00000100:00100000:0.0:1782759904.107572:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197389056 00000100:00100000:0.0:1782759904.107625:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1050 00000100:00100000:0.0:1782759904.107635:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2364:x1869355197389056:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759904.107651:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759904.107670:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e1019 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6733a expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759904.107698:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x6a42c1df, atime: 0x6a42c1df, ctime: 0x6a42c1df, blocks: 0x1 00010000:00010000:0.0:1782759904.107717:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=3972s v=(0 0) 00010000:00010000:0.0:1782759904.107722:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759904.107731:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e1019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6733a expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.107751:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e1019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6733a expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.107784:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74e00, rc 0) 00000100:00100000:0.0:1782759904.107875:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197389056:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 240us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.107883:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1050 00000100:00100000:0.0:1782759904.114506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.114611:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197389312 00000100:00100000:2.0:1782759904.114621:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197389312 00000100:00100000:2.0:1782759904.114713:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2308 00000100:00100000:2.0:1782759904.114724:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+13:110278:x1869355197389312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759904.114747:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759904.114770:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1020 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67341 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.114958:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1027 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.114973:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1027 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.114995:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1027 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759904.115009:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782759904.115138:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1020 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67341 expref: 16 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.115156:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1027 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67341 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.115165:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:2.0:1782759904.115168:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782759904.115171:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782759904.115232:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+15:110278:x1869355197389312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 510us (748us total) trans 4294968206 rc 0/0 00000100:00100000:2.0:1782759904.115240:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2308 00000100:00100000:3.0:1782759904.117665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.117783:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197389568 00000100:00100000:2.0:1782759904.117794:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197389568 00000100:00100000:2.0:1782759904.117978:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2309 00000100:00100000:2.0:1782759904.117988:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+15:110278:x1869355197389568:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759904.118042:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759904.118068:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1012 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67333 expref: 15 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.118086:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:2.0:1782759904.118090:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759904.118124:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.118137:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.118145:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759904.118720:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].58, 88 off12072 00000004:00080000:2.0:1782759904.118732:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3972521908989ns, next at 3973521906764ns, rc = 0 00000004:00010000:2.0:1782759904.118811:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7ec1127 reply state 00000000378a18d5 transno 4294968207 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759904.118865:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759904.118972:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+16:110278:x1869355197389568:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 984us (1313us total) trans 4294968207 rc 0/0 00000100:00100000:2.0:1782759904.118981:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2309 00010000:00010000:3.0:1782759904.122774:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.122806:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.122847:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.122854:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759904.122860:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.122869:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.122887:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759904.122891:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759904.122897:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.122903:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e1035 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759904.136441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.137133:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197389696 00000100:00100000:2.0:1782759904.137146:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197389696 00000100:00100000:2.0:1782759904.137268:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2310 00000100:00100000:2.0:1782759904.137279:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+15:110279:x1869355197389696:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759904.137304:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759904.137326:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e103c lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67348 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137386:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137400:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137436:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137453:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137460:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137468:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137581:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1051 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137590:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1051 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137596:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1051 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759904.137637:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782759904.137641:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759904.137665:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1051 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137676:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137683:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137701:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137707:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.137711:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137719:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137730:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:2.0:1782759904.137734:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759904.137738:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137744:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1043 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137758:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137764:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137769:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137774:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.137777:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137792:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137800:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917191f75900) 00010000:00010000:2.0:1782759904.137802:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759904.137804:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137810:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e104a lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137874:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e103c lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67348 expref: 17 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137887:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1051 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67348 expref: 16 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.137895:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782759904.137897:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759904.137900:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:3.0:1782759904.138023:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+16:110279:x1869355197389696:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 744us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759904.138032:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2310 00000100:00100000:1.0:1782759904.147972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759904.148345:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197389952 00000100:00100000:3.0:1782759904.148369:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197389952 00000100:00100000:3.0:1782759904.148442:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2311 00000100:00100000:3.0:1782759904.148453:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+16:110279:x1869355197389952:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759904.148486:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759904.148525:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1058 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6734f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759904.148651:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782759904.149108:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1058 lrc: 1/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6734f expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.149125:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759904.149128:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759904.149135:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1058 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6734f expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.149150:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759904.149466:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+17:110279:x1869355197389952:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1012us (1504us total) trans 4294968208 rc 301/301 00000100:00100000:3.0:1782759904.149475:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2311 00000100:00100000:0.0:1782759904.155351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.161979:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197390208 00000100:00100000:2.0:1782759904.161997:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197390208 00000100:00100000:2.0:1782759904.162388:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2312 00000100:00100000:2.0:1782759904.162399:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+17:110279:x1869355197390208:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759904.162457:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759904.162483:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1051 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67348 expref: 17 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.162541:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75f00) 00010000:00010000:2.0:1782759904.162552:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759904.162576:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.162589:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.162598:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759904.162819:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d60f7135 reply state 00000000ead15984 transno 4294968209 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759904.163250:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759904.163272:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00000100:00100000:2.0:1782759904.163516:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+18:110279:x1869355197390208:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1116us (8176us total) trans 4294968209 rc 0/0 00000100:00100000:2.0:1782759904.163524:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2312 00000100:00100000:0.0:1782759904.178269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759904.178363:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197390464 00000100:00100000:3.0:1782759904.178374:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197390464 00000100:00100000:3.0:1782759904.178427:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 403 00000100:00100000:3.0:1782759904.178436:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+18:110279:x1869355197390464:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759904.178730:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+19:110279:x1869355197390464:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 294us (471us total) trans 4294968210 rc 0/0 00000100:00100000:3.0:1782759904.178737:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 403 00010000:00010000:2.0:1782759904.178973:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.178986:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.178993:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.178999:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.179003:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.179021:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.179035:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759904.179038:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759904.179043:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.179049:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1066 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759904.181700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759904.181945:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197390720 00000100:00100000:0.0:1782759904.181956:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197390720 00000100:00100000:0.0:1782759904.182016:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2313 00000100:00100000:0.0:1782759904.182027:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+18:110279:x1869355197390720:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759904.182056:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759904.182077:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e106d lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67356 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182156:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182172:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182185:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182203:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182232:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182239:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759904.182399:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782759904.182594:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182602:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182609:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182615:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759904.182620:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182627:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182638:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:0.0:1782759904.182641:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759904.182645:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182651:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1074 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182675:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182681:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182687:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182692:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759904.182696:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182701:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182709:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917182dd1a00) 00010000:00010000:0.0:1782759904.182711:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759904.182714:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182719:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e107b lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182758:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e106d lrc: 1/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67356 expref: 20 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182768:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:0.0:1782759904.182771:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759904.182780:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e106d lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67356 expref: 20 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.182789:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74c00, rc 0) 00000100:00100000:0.0:1782759904.183100:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+19:110279:x1869355197390720:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1073us (1407us total) trans 4294968211 rc 301/301 00000100:00100000:0.0:1782759904.183110:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2313 00000100:00100000:1.0:1782759904.186591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.186720:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197390848 00000100:00100000:2.0:1782759904.186731:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197390848 00000100:00100000:2.0:1782759904.186797:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2314 00000100:00100000:2.0:1782759904.186808:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+19:110279:x1869355197390848:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759904.186867:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759904.186892:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1089 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6735d expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.186985:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1090 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.187002:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1090 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.187015:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1090 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759904.187071:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782759904.187075:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759904.187123:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1090 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.187151:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1089 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6735d expref: 21 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.187169:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1090 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6735d expref: 20 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.187179:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759904.187182:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759904.187187:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759904.187261:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+20:110279:x1869355197390848:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 453us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759904.187268:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2314 00000100:00100000:3.0:1782759904.191716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759904.191891:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197390976 00000100:00100000:1.0:1782759904.191903:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197390976 00000100:00100000:1.0:1782759904.191964:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 404 00000100:00100000:1.0:1782759904.191975:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+20:110279:x1869355197390976:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:2.0:1782759904.197180:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+20:110279:x1869355197390976:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 5194us (5460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759904.197197:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 404 00000100:00100000:0.0:1782759904.210285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759904.211943:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197391232 00000100:00100000:3.0:1782759904.211975:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197391232 00000100:00100000:3.0:1782759904.212052:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 405 00000100:00100000:3.0:1782759904.212064:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198914450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+20:110279:x1869355197391232:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759904.212401:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198914450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+21:110279:x1869355197391232:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 339us (2126us total) trans 4294968212 rc 0/0 00000100:00100000:3.0:1782759904.212409:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 405 00010000:00010000:0.0:1782759904.237328:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759904.238774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759904.239183:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197391360 00000100:00100000:2.0:1782759904.239195:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197391360 00000100:00100000:2.0:1782759904.239268:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2315 00000100:00100000:2.0:1782759904.239280:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+21:110281:x1869355197391360:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759904.239310:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759904.239334:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1097 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67364 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239407:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239443:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239456:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239472:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239479:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239485:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239604:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239613:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239619:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759904.239654:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759904.239659:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759904.239681:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239691:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239710:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239729:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239736:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239742:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.239746:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239754:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239767:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:2.0:1782759904.239770:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759904.239774:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239780:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e109e lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239792:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239799:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.239804:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240124:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759904.240128:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240134:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240142:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff917191f75f00) 00010000:00010000:2.0:1782759904.240144:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759904.240147:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240153:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10a5 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240186:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1097 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67364 expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240198:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67364 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.240206:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:2.0:1782759904.240208:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759904.240210:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90800, rc 0) 00000100:00100000:2.0:1782759904.240288:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+22:110281:x1869355197391360:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1009us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759904.240296:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2315 00000100:00100000:1.0:1782759904.289549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759904.289675:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197391488 00000100:00100000:3.0:1782759904.289688:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197391488 00000100:00100000:3.0:1782759904.290071:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2316 00000100:00100000:3.0:1782759904.290089:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+22:110284:x1869355197391488:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759904.290117:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759904.290144:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e10b3 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6736b expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290226:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290241:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290253:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290271:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290277:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290310:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290428:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e10c8 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290436:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e10c8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290444:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e10c8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759904.290487:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782759904.290504:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759904.290534:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e10c8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290547:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290553:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290559:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290565:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759904.290568:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290576:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290596:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759904.290599:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759904.290604:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290610:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e10ba lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290624:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290630:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290636:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290640:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759904.290643:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290648:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290654:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff9171908a1600) 00010000:00010000:3.0:1782759904.290656:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759904.290659:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290664:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10c1 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290706:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e10b3 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6736b expref: 24 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290734:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e10c8 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6736b expref: 23 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.290742:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782759904.290744:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759904.290746:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:3.0:1782759904.290979:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+23:110284:x1869355197391488:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 897us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759904.290987:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2316 00000100:00100000:0.0:1782759904.296401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759904.296527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759904.297182:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197391872 00000100:00100000:1.0:1782759904.297193:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197391872 00000100:00100000:1.0:1782759904.297273:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 192 00000100:00100000:1.0:1782759904.297284:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+23:2364:x1869355197391872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759904.297302:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759904.297330:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e10c8 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6736b expref: 23 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.297349:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:1.0:1782759904.297354:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759904.297504:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+22:2364:x1869355197391872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 221us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759904.297513:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 192 00000100:00100000:2.0:1782759904.297594:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197391744 00000100:00100000:2.0:1782759904.297615:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197391744 00000100:00100000:2.0:1782759904.297727:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2317 00000100:00100000:2.0:1782759904.297737:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+22:110284:x1869355197391744:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759904.297758:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759904.297776:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e10cf lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67372 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.297941:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10d6 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.297956:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10d6 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.297967:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10d6 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759904.297980:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782759904.298112:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e10cf lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67372 expref: 25 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.298127:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10d6 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67372 expref: 24 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.298134:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759904.298136:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782759904.298138:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782759904.298167:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+24:110284:x1869355197391744:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 433us (1777us total) trans 4294968213 rc 0/0 00000100:00100000:2.0:1782759904.298173:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2317 00000020:00000080:3.0:1782759904.973087:0:161627:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc29c877f0 20000000:00000080:3.0:1782759904.973105:0:161627:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708919b800 uarg=0000000000000000 00010000:00010000:3.0:1782759904.973539:0:161627:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1782759904.973572:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759904.973576:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759904.973587:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e0fc5 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67325 expref: 23 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973604:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759904.973606:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759904.973610:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e10ac lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67364 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973622:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782759904.973630:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782759904.973635:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e10d6 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67372 expref: 21 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973648:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1400) 00010000:00010000:3.0:1782759904.973651:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759904.973654:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e0f78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67310 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973670:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759904.973673:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782759904.973676:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1027 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67341 expref: 19 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973689:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782759904.973692:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759904.973696:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1090 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6735d expref: 18 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973709:0:161627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759904.973711:0:161627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759904.973714:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e0fe8 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6732c expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973727:0:161627:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 7 locks, left on hash table 0. 10000000:01000000:3.0:1782759904.973742:0:161627:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759904.973754:0:161627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973777:0:161627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973785:0:161627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973846:0:161627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759904.973861:0:161627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 18 pid: 5793 timeout: 4073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759904.973876:0:161627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161627:1869355212097792:0@lo:104: 00000100:00100000:3.0:1782759904.973939:0:161627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759904.973993:0:161627:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759904.974078:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097792 00000100:00100000:1.0:1782759904.974085:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097792 00000100:00100000:1.0:1782759904.974128:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1782759904.974137:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161627:x1869355212097792:12345-0@lo:104: 00010000:00010000:1.0:1782759904.974149:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974217:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759904.974224:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161627:x1869355212097792:12345-0@lo:104: Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759904.974231:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00010000:00010000:1.0:1782759904.974254:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759904.974260:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974268:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759904.974272:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974281:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759904.974287:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759904.974293:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759904.974328:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974335:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759904.974358:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974364:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcdc00/0xdd99f5c4777e0f63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e0f6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974388:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759904.974389:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759904.974390:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759904.974416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212097920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759904.974443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759904.974502:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212097920 00000100:00100000:1.0:1782759904.974506:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212097920 00010000:00010000:1.0:1782759904.974525:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 19 pid: 5793 timeout: 4073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759904.974547:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1782759904.974554:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212097920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759904.974564:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759904.974570:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 19 pid: 5793 timeout: 4073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974580:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 19 pid: 5793 timeout: 4073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974594:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974602:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974615:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974622:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974634:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974641:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974646:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759904.974650:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974657:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974665:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759904.974674:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759904.974699:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212097920:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759904.974706:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1782759904.974735:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212097920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759904.981610:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e0f6a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e0f63 expref: 18 pid: 5793 timeout: 4073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759904.981632:0:161627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161627:1869355212097792:0@lo:104: 00010000:00010000:2.0:1782759904.981661:0:161627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.981670:0:161627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.981676:0:161627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759904.981682:0:161627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e10e4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759905.196720:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3973599894466ns, next at 3974599892379ns, rc = 0 00000100:00100000:0.0:1782759905.196783:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759905.196803:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212098048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759905.196906:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759905.196976:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098048 00000100:00100000:0.0:1782759905.196984:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098048 00000100:00100000:0.0:1782759905.197039:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1782759905.197048:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212098048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759905.197071:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759905.197118:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212098048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759905.197126:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00080000:0.0:1782759905.197146:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759905.197183:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212098048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759905.263729:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759906.285355:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759906.476463:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759906.476471:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759906.476477:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759906.476535:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759906.476548:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759906.476559:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759906.476585:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212098176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759906.476657:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759906.476763:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098176 00000100:00100000:1.0:1782759906.476772:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098176 00000100:00100000:1.0:1782759906.476854:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1782759906.476866:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212098176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759906.476881:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759906.476896:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e10eb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759906.476929:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759906.476939:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759906.476948:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:0.0:1782759906.477048:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171813773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759906.477492:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212098176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 627us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759906.477500:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:0.0:1782759906.479548:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212098176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759906.479578:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759906.479592:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759906.479618:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759906.479625:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759906.479632:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759906.999309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759906.999352:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759906.999362:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197392128 00000100:00100000:3.0:1782759906.999371:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197392128 00000100:00100000:1.0:1782759906.999391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759906.999419:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197392000 00000100:00100000:0.0:1782759906.999424:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197392000 00000100:00100000:0.0:1782759906.999487:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3150 00000100:00100000:0.0:1782759906.999497:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197392000:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759906.999582:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197392000:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759906.999592:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3150 00000100:00100000:0.0:1782759906.999622:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197392256 00000100:00100000:0.0:1782759906.999625:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197392256 00000100:00100000:3.0:1782759906.999740:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2866 00000100:00100000:3.0:1782759906.999748:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+17:2361:x1869355197392128:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759906.999784:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+17:2361:x1869355197392128:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759906.999790:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2866 00000100:00100000:0.0:1782759906.999886:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2310 00000100:00100000:0.0:1782759906.999893:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917191922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197392256:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759906.999921:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917191922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197392256:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759906.999927:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2310 00000100:00080000:2.0:1782759907.000114:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759907.000118:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759907.244334:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212098688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759907.244420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759907.244488:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759907.244494:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212098560:0@lo:400:kworker.0 00000100:00100000:2.0:1782759907.244519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759907.244549:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098688 00000100:00100000:2.0:1782759907.244557:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098688 00000100:00100000:2.0:1782759907.244609:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1782759907.244618:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212098688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759907.244670:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212098688:12345-0@lo:400:kworker.0 Request processed in 53us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759907.244694:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00080000:2.0:1782759907.244738:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759907.244772:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212098688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759907.244860:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098560 00000100:00100000:0.0:1782759907.244865:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098560 00000100:00100000:3.0:1782759907.244948:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212098304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759907.244966:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1782759907.244975:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.244993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759907.245032:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212098816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759907.245035:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212098560:12345-0@lo:400:kworker.0 Request processed in 60us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759907.245044:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1782759907.245279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759907.245302:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759907.245309:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212098432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.245454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759907.245474:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212098944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.245498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759907.245551:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098816 00000100:00100000:3.0:1782759907.245557:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098816 00000100:00100000:3.0:1782759907.245586:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098432 00000100:00100000:3.0:1782759907.245588:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098432 00000100:00100000:3.0:1782759907.245606:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:3.0:1782759907.245612:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212098816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.245648:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212098816:12345-0@lo:400:kworker.0 Request processed in 36us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759907.245654:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:3.0:1782759907.245666:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:3.0:1782759907.245672:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212098432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.245694:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212098432:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759907.245699:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:3.0:1782759907.245713:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098304 00000100:00100000:3.0:1782759907.245715:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098304 00000100:00100000:3.0:1782759907.245737:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151 00000100:00100000:3.0:1782759907.245743:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212098304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.245770:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212098304:12345-0@lo:400:kworker.0 Request processed in 28us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759907.245876:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151 00000100:00100000:3.0:1782759907.245909:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212098944 00000100:00100000:3.0:1782759907.245912:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212098944 00000100:00100000:3.0:1782759907.245935:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:3.0:1782759907.245940:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212098944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.245971:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212098944:12345-0@lo:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759907.245976:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00100000:3.0:1782759907.246011:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212098432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.246022:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212098944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.246029:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212098304:0@lo:400:kworker.0 00000100:00100000:3.0:1782759907.246041:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212098816:0@lo:400:kworker.0 00000100:00080000:0.0:1782759907.246279:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759907.246285:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759907.246358:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212098560:0@lo:400:kworker.0 00000001:00080000:0.0:1782759907.302576:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968211 is committed 00000001:00080000:0.0:1782759907.302612:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968213 is committed 00000004:00080000:0.0:1782759907.302623:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 132 committed 00000004:00080000:0.0:1782759907.302652:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 133 committed 00000100:00100000:1.0:1782759907.302851:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759907.302873:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212099072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782759907.302938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759907.303040:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099072 00000100:00100000:2.0:1782759907.303047:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099072 00000100:00100000:2.0:1782759907.303100:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1782759907.303110:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212099072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782759907.303616:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759907.303621:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb mtime from disk: 1782759903 -> 1782759903 00002000:00010000:2.0:1782759907.303624:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb atime from disk: 1782759903 -> 1782759903 00002000:00010000:2.0:1782759907.303626:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb ctime from disk: 1782759903 -> 1782759903 00002000:00010000:2.0:1782759907.303628:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759907.303682:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082861f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869355212099072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 572us (742us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1782759907.303690:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000004:00080000:1.0:1782759907.303780:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff917081876a00/2, rc 0, transno 4294967446 00000100:00100000:1.0:1782759907.303786:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212099072:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1782759907.308515:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759907.756045:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759907.756077:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212099200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759907.756168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759907.756257:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099200 00000100:00100000:3.0:1782759907.756267:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099200 00000100:00100000:3.0:1782759907.756325:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:3.0:1782759907.756335:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212099200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759907.756381:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759907.756449:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212099200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759907.756458:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:3.0:1782759907.756518:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212099200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759907.804711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759907.805208:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197392512 00000100:00100000:3.0:1782759907.805222:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197392512 00000100:00100000:3.0:1782759907.805298:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2318 00000100:00100000:3.0:1782759907.805311:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110358:x1869355197392512:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759907.805387:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759907.805393:0:19544:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e10ac) 00010000:00010000:3.0:1782759907.805395:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759907.805507:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110358:x1869355197392512:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 198us (806us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759907.805516:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2318 00000100:00100000:0.0:1782759907.842041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759907.842123:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197392768 00000100:00100000:3.0:1782759907.842136:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197392768 00000100:00100000:3.0:1782759907.842204:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2319 00000100:00100000:3.0:1782759907.842218:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110359:x1869355197392768:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759907.842290:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759907.842295:0:5801:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e1090) 00010000:00010000:3.0:1782759907.842297:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759907.842398:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110359:x1869355197392768:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 183us (372us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759907.842405:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2319 00000100:00100000:1.0:1782759907.873691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759907.873975:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197392896 00000100:00100000:3.0:1782759907.873988:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197392896 00000100:00100000:3.0:1782759907.874078:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2320 00000100:00100000:3.0:1782759907.874092:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110361:x1869355197392896:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759907.874121:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759907.874152:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10f9 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67379 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.874262:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.874279:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.874295:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.874309:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.874315:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.874322:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879046:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879073:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879088:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759907.879146:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759907.879152:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759907.879180:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879208:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879221:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879229:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879237:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879244:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759907.879249:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879258:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879275:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:2.0:1782759907.879279:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759907.879284:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879291:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1100 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879308:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879314:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879327:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879332:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759907.879335:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879341:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879349:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171908a1600) 00010000:00010000:2.0:1782759907.879351:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759907.879354:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879359:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1107 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879410:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e10f9 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67379 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879442:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67379 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759907.879451:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782759907.879453:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759907.879455:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782759907.879560:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110361:x1869355197392896:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5470us (5884us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759907.879580:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2320 00000100:00100000:0.0:1782759907.920182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759907.920287:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197393024 00000100:00100000:3.0:1782759907.920307:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197393024 00000100:00100000:3.0:1782759907.920451:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2321 00000100:00100000:3.0:1782759907.920474:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110364:x1869355197393024:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759907.920495:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759907.920520:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1115 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67380 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.920583:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.920595:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.920624:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.920639:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.920646:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.920653:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921056:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e112a lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921066:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e112a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921073:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e112a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759907.921157:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1782759907.921161:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759907.921234:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e112a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921246:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921252:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921268:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921274:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759907.921278:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921286:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921299:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782759907.921302:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759907.921306:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921313:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e111c lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921326:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921332:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921337:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921342:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759907.921345:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921360:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921369:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff9171908a1100) 00010000:00010000:3.0:1782759907.921370:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759907.921373:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921379:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1123 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921409:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1115 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67380 expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921436:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e112a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67380 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.921443:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff9171908a1300) 00010000:00010000:3.0:1782759907.921445:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759907.921447:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759907.921526:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110364:x1869355197393024:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1056us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759907.921534:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2321 00000100:00100000:1.0:1782759907.951326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759907.951435:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197393280 00000100:00100000:3.0:1782759907.951447:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197393280 00000100:00100000:3.0:1782759907.951583:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2322 00000100:00100000:3.0:1782759907.951597:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110366:x1869355197393280:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759907.951759:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759907.951792:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e110e lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67379 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759907.951935:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782759907.952020:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759907.952088:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110366:x1869355197393280:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 494us (771us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759907.952095:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2322 00000100:00100000:1.0:1782759907.970568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759907.970694:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197393536 00000100:00100000:0.0:1782759907.970727:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197393536 00000100:00100000:0.0:1782759907.970792:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2323 00000100:00100000:0.0:1782759907.970803:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110367:x1869355197393536:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759907.970909:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759907.970940:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e112a lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67380 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759907.970962:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff9171908a1300) 00010000:00010000:0.0:1782759907.970975:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759907.971050:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110367:x1869355197393536:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 249us (502us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759907.971058:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2323 00010000:00010000:2.0:1782759908.334316:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759908.746021:0:161825:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc52ff8f30 20000000:00000080:0.0:1782759908.746039:0:161825:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170831c9400 uarg=0000000000000000 00010000:00010000:0.0:1782759908.746624:0:161825:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759908.746640:0:161825:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759908.746654:0:161825:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759908.746672:0:161825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.746688:0:161825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.746697:0:161825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.746929:0:161825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.746954:0:161825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 18 pid: 5794 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759908.746970:0:161825:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161825:1869355212099328:0@lo:104: 00000100:00100000:0.0:1782759908.747042:0:161825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759908.747155:0:161825:0:(client.c:2701:ptlrpc_set_wait()) set ffff917198924d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759908.747343:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099328 00000100:00100000:2.0:1782759908.747352:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099328 00000100:00100000:2.0:1782759908.747482:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1782759908.747492:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161825:x1869355212099328:12345-0@lo:104: 00010000:00010000:2.0:1782759908.747505:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.747574:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759908.747580:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:161825:x1869355212099328:12345-0@lo:104: Request processed in 91us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759908.747588:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00010000:00010000:2.0:1782759908.747618:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759908.747624:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.747631:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759908.747635:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.747643:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759908.747650:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759908.747655:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759908.747697:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.747702:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759908.747940:0:161825:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161825:1869355212099328:0@lo:104: 00010000:00010000:1.0:1782759908.747963:0:161825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.748030:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.748038:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75400/0xdd99f5c4777e10eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e10f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759908.748055:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759908.748057:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759908.748058:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759908.748076:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212099456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759908.748110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759908.748346:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099456 00000100:00100000:0.0:1782759908.748351:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099456 00010000:00010000:0.0:1782759908.748373:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 19 pid: 5794 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759908.748623:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1782759908.748632:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212099456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759908.748643:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759908.748648:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 19 pid: 5794 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748658:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 19 pid: 5794 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748670:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e10f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e10eb expref: 19 pid: 5794 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748685:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748695:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748719:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748802:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748808:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.748815:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.749130:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759908.749137:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.749146:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759908.749250:0:161825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759908.749258:0:161825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.749393:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.750110:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75800/0xdd99f5c4777e1131 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759908.750131:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759908.750251:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212099456:12345-0@lo:103:ldlm_bl.0 Request processed in 1618us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759908.750260:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1782759908.752950:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212099456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759909.356979:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759909.357039:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967446 is committed 10000000:01000000:2.0:1782759909.995918:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759909.995929:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759909.995935:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759909.995984:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759909.995997:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759909.996009:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759909.996048:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212099584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759909.996120:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.996191:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082695b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759909.996418:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099584 00000100:00100000:3.0:1782759909.996427:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099584 00000100:00100000:3.0:1782759909.996488:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:3.0:1782759909.996499:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212099584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759909.996515:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759909.996534:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1138 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759909.996563:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759909.996576:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759909.996588:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759909.996648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212099584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759909.996656:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00000100:00100000:2.0:1782759909.997065:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212099584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759909.997082:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759909.997093:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759909.997116:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759909.997121:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759909.997130:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759910.326995:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212099712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759910.327077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759910.327184:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099712 00000100:00100000:2.0:1782759910.327193:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099712 00000100:00100000:2.0:1782759910.327257:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1782759910.327266:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212099712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759910.327304:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759910.327354:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212099712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759910.327360:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00080000:3.0:1782759910.327478:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759910.327513:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967446 gen 2 00000004:00080000:3.0:1782759910.327519:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff917081876a00, transno 4294967446 00000100:00100000:3.0:1782759910.327546:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212099712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759910.380946:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759911.403984:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759911.709003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759911.712272:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197393664 00000100:00100000:3.0:1782759911.712295:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197393664 00000100:00080000:0.0:1782759911.712380:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759911.712458:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2324 00000100:00100000:3.0:1782759911.712470:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110441:x1869355197393664:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759911.712491:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759911.712516:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1146 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67387 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.713328:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.713362:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.713381:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.713397:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.713404:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.713410:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715447:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715467:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715478:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759911.715523:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759911.715528:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759911.715550:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715562:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715572:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715579:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715587:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715593:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759911.715598:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715606:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715633:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759911.715637:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759911.715641:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715647:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e114d lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715661:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715674:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715680:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715686:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759911.715689:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715695:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715702:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171908a1900) 00010000:00010000:3.0:1782759911.715704:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759911.715707:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715712:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1154 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715765:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1146 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67387 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715782:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67387 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.715789:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1400) 00010000:00010000:3.0:1782759911.715791:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759911.715793:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759911.715910:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110441:x1869355197393664:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3442us (6921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759911.715919:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2324 00000100:00100000:1.0:1782759911.729124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759911.729399:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197393920 00000100:00100000:2.0:1782759911.729410:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197393920 00000100:00100000:2.0:1782759911.729470:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2325 00000100:00100000:2.0:1782759911.729480:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110441:x1869355197393920:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759911.729541:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759911.729580:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e115b lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67387 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.729599:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1400) 00010000:00010000:2.0:1782759911.729611:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759911.729638:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.729650:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.729670:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759911.730511:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].59, 88 off12160 00000004:00080000:2.0:1782759911.730524:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3980133700458ns, next at 3981133697777ns, rc = 0 00000004:00010000:2.0:1782759911.730671:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000214f4957 reply state 00000000c7f12c6f transno 4294968214 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759911.730681:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759911.730796:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110441:x1869355197393920:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1315us (1679us total) trans 4294968214 rc 0/0 00000100:00100000:2.0:1782759911.730804:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2325 00010000:00010000:3.0:1782759911.732261:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.732276:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.732283:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.732288:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759911.732294:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.732300:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.732315:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75500) 00010000:00010000:3.0:1782759911.732332:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759911.732336:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.732342:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1162 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759911.751102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759911.752926:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197394048 00000100:00100000:2.0:1782759911.752940:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197394048 00000100:00100000:2.0:1782759911.753001:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2326 00000100:00100000:2.0:1782759911.753011:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110442:x1869355197394048:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759911.753036:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759911.753071:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1169 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6738e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753138:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753154:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753167:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753180:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753187:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753194:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753635:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e117e lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753656:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e117e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.753664:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e117e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759911.754010:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782759911.754015:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759911.754092:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e117e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754113:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754120:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754127:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754133:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759911.754138:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754145:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754159:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75600) 00010000:00010000:2.0:1782759911.754162:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759911.754168:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754174:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1170 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754185:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754192:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754198:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754210:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759911.754213:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754219:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754228:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917191f75a00) 00010000:00010000:2.0:1782759911.754230:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759911.754233:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754239:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1177 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754279:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1169 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6738e expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754295:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e117e lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6738e expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.754303:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782759911.754305:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759911.754307:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759911.754398:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110442:x1869355197394048:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1388us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759911.754407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2326 00000100:00100000:2.0:1782759911.759455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759911.759637:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197394304 00000100:00100000:1.0:1782759911.759647:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197394304 00000100:00100000:1.0:1782759911.759709:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2327 00000100:00100000:1.0:1782759911.759720:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110442:x1869355197394304:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759911.759788:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759911.759816:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e117e lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6738e expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.759874:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917191f75100) 00010000:00010000:1.0:1782759911.759886:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759911.759912:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.759927:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.759937:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759911.760333:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000727ffbbf reply state 0000000049b65db9 transno 4294968215 ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759911.760361:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759911.760427:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000100:00100000:1.0:1782759911.760516:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110442:x1869355197394304:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 797us (1070us total) trans 4294968215 rc 0/0 00000100:00100000:1.0:1782759911.760524:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2327 00000100:00100000:0.0:1782759911.763494:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759911.763535:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197394560 00010000:00010000:2.0:1782759911.763538:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759911.763546:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197394560 00010000:00010000:2.0:1782759911.763555:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.763565:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.763572:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759911.763578:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.763587:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.763607:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:2.0:1782759911.763610:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759911.763615:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.763623:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e1185 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759911.763656:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2328 00000100:00100000:3.0:1782759911.763678:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110442:x1869355197394560:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759911.763702:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759911.763726:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e118c lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67395 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.763793:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.763807:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.763816:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.763850:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.763858:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.763866:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759911.764301:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1782759911.764460:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764468:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764473:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764478:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759911.764482:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764487:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764496:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759911.764500:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759911.764503:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764509:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1193 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764519:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764525:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764541:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764546:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759911.764549:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764555:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764567:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff9171908a1900) 00010000:00010000:3.0:1782759911.764570:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759911.764572:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764577:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e119a lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764623:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e118c lrc: 1/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67395 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764632:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1700) 00010000:00010000:3.0:1782759911.764635:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759911.764638:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e118c lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67395 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.764649:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd000, rc 0) 00000100:00100000:3.0:1782759911.764720:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110442:x1869355197394560:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1044us (1240us total) trans 4294968216 rc 301/301 00000100:00100000:3.0:1782759911.764738:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2328 00000100:00100000:0.0:1782759911.771003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759911.771054:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197394816 00000100:00100000:1.0:1782759911.771064:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197394816 00000100:00100000:1.0:1782759911.771126:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 406 00000100:00100000:1.0:1782759911.771138:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110442:x1869355197394816:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759911.771621:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110442:x1869355197394816:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 484us (958us total) trans 4294968217 rc 0/0 00000100:00100000:1.0:1782759911.771629:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 406 00000100:00100000:2.0:1782759911.780286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759911.780390:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197394944 00000100:00100000:0.0:1782759911.780400:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197394944 00000100:00100000:0.0:1782759911.780466:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2329 00000100:00100000:0.0:1782759911.780477:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110442:x1869355197394944:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759911.780506:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759911.780533:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e11a8 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6739c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.780626:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e11af lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.780641:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e11af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.780653:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e11af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759911.781388:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782759911.781396:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759911.781482:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e11af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.781515:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e11a8 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6739c expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.781532:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e11af lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6739c expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.781552:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:0.0:1782759911.781555:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759911.781559:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75600, rc 0) 00000100:00100000:0.0:1782759911.781636:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110442:x1869355197394944:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1160us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759911.781644:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2329 00000100:00100000:0.0:1782759911.785586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759911.785703:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395072 00000100:00100000:1.0:1782759911.785714:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395072 00000100:00100000:1.0:1782759911.785783:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 407 00000100:00100000:1.0:1782759911.785795:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110442:x1869355197395072:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:0.0:1782759911.795043:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110442:x1869355197395072:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 9238us (9458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759911.795058:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 407 00000100:00100000:3.0:1782759911.828258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759911.828393:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395200 00000100:00100000:1.0:1782759911.828405:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395200 00000100:00100000:1.0:1782759911.828466:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2330 00000100:00100000:1.0:1782759911.828476:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110444:x1869355197395200:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759911.828500:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759911.828527:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e11b6 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673a3 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.828595:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.828626:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.828637:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.828651:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.828658:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.828665:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829058:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829067:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829075:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759911.829109:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782759911.829113:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759911.829132:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829143:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829164:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829171:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829178:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829184:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759911.829188:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829196:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829209:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171889c5000) 00010000:00010000:1.0:1782759911.829212:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759911.829216:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829222:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e11bd lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829235:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829241:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829248:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829260:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759911.829263:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829269:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829278:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171889c5900) 00010000:00010000:1.0:1782759911.829280:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759911.829283:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829289:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e11c4 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829321:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e11b6 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673a3 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829335:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673a3 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.829358:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759911.829361:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759911.829363:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030e00, rc 0) 00000100:00100000:1.0:1782759911.829425:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110444:x1869355197395200:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 950us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759911.829434:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2330 00000100:00100000:1.0:1782759911.864665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759911.865683:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395328 00000100:00100000:0.0:1782759911.865697:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395328 00000100:00100000:0.0:1782759911.865762:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2331 00000100:00100000:0.0:1782759911.865773:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110447:x1869355197395328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759911.865792:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759911.865815:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e11d2 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673aa expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.865918:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.865931:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.865942:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.865971:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.865979:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.865986:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866319:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e11e7 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866328:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e11e7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866336:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e11e7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759911.866446:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782759911.866451:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759911.866532:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e11e7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866542:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866549:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866555:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866570:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759911.866575:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866583:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866596:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917182dd1a00) 00010000:00010000:0.0:1782759911.866599:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759911.866604:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866610:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e11d9 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866621:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866626:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866631:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866635:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759911.866638:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866643:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866660:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917182dd1300) 00010000:00010000:0.0:1782759911.866662:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759911.866664:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866670:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e11e0 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866701:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e11d2 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673aa expref: 13 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866715:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e11e7 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673aa expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.866722:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:0.0:1782759911.866724:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759911.866726:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75000, rc 0) 00000100:00100000:0.0:1782759911.867364:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+12:110447:x1869355197395328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1588us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759911.867373:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2331 00000100:00100000:0.0:1782759911.875537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759911.875648:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395456 00000100:00100000:1.0:1782759911.875669:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395456 00000100:00100000:1.0:1782759911.875744:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 193 00000100:00100000:1.0:1782759911.875756:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+12:2362:x1869355197395456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759911.875773:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759911.875801:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e11e7 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673aa expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.875875:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:1.0:1782759911.875880:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759911.875933:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+11:2362:x1869355197395456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 179us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759911.875951:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 193 00000100:00100000:2.0:1782759912.118940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759912.118985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759912.119066:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395712 00000100:00100000:0.0:1782759912.119077:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395712 00000100:00100000:0.0:1782759912.119156:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2313 00000100:00100000:0.0:1782759912.119166:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197395712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759912.119239:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197395712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759912.119263:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2313 00000100:00100000:3.0:1782759912.119445:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395584 00000100:00100000:3.0:1782759912.119450:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395584 00000100:00100000:3.0:1782759912.119492:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3153 00000100:00100000:3.0:1782759912.119499:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197395584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759912.119535:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197395584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 36us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759912.119541:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3153 00000100:00080000:1.0:1782759912.119789:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759912.368594:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212099968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759912.369273:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212099840:0@lo:400:kworker.0 00000100:00100000:2.0:1782759912.371502:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212100096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759912.371624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759912.371686:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212100352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759912.371712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759912.371763:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100352 00000100:00100000:0.0:1782759912.371772:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100352 00000100:00100000:0.0:1782759912.371864:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:0.0:1782759912.371874:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212100352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759912.371928:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212100352:12345-0@lo:400:kworker.0 Request processed in 56us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759912.371935:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:0.0:1782759912.371976:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212100352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759912.372744:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099840 00000100:00100000:1.0:1782759912.372752:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099840 00000100:00100000:1.0:1782759912.372788:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:1.0:1782759912.372795:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759912.372898:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212099840:12345-0@lo:400:kworker.0 Request processed in 103us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759912.372905:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00080000:1.0:1782759912.372937:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759912.372964:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212099840:0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.376550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759912.376607:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212100480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.376677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759912.376718:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212100224:0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.376747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759912.376794:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212099968 00000100:00100000:3.0:1782759912.376802:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212099968 00000100:00100000:3.0:1782759912.376874:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:3.0:1782759912.376884:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212099968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.376941:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212099968:12345-0@lo:400:kworker.0 Request processed in 57us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759912.376948:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:3.0:1782759912.376970:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100480 00000100:00100000:3.0:1782759912.376973:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100480 00000100:00100000:3.0:1782759912.377000:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100224 00000100:00100000:3.0:1782759912.377014:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100224 00000100:00100000:3.0:1782759912.377040:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:3.0:1782759912.377046:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212100480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.377078:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212100480:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759912.377084:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00100000:3.0:1782759912.377095:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:3.0:1782759912.377100:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212100224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.377129:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212100224:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759912.377135:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:3.0:1782759912.377190:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212099968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.377202:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212100480:0@lo:400:kworker.0 00000100:00080000:3.0:1782759912.377226:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759912.377229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759912.377247:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212100224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759912.377609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759912.378013:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100096 00000100:00100000:3.0:1782759912.378018:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100096 00000100:00100000:3.0:1782759912.378067:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1782759912.378074:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212100096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759912.378116:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212100096:12345-0@lo:400:kworker.0 Request processed in 42us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759912.378123:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1782759912.378154:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212100096:0@lo:400:kworker.0 00000100:00080000:2.0:1782759912.378249:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759912.427991:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759912.445044:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968217 is committed 00000004:00080000:2.0:1782759912.445082:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 134 committed 00000100:00100000:3.0:1782759912.445402:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759912.445432:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212100608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782759912.445507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759912.446978:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100608 00000100:00100000:2.0:1782759912.446989:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100608 00000100:00100000:2.0:1782759912.447045:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1782759912.447054:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212100608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782759912.447455:0:9120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759912.447459:0:9120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb mtime from disk: 1782759903 -> 1782759903 00002000:00010000:2.0:1782759912.447462:0:9120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb atime from disk: 1782759903 -> 1782759903 00002000:00010000:2.0:1782759912.447464:0:9120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb ctime from disk: 1782759903 -> 1782759903 00002000:00010000:2.0:1782759912.447466:0:9120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759912.447548:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212100608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 494us (2040us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1782759912.447556:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000004:00080000:2.0:1782759912.447611:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170835a8a80/2, rc 0, transno 4294967447 00000100:00100000:2.0:1782759912.447617:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212100608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782759912.880418:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759912.880445:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212100736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759912.880525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759912.880591:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100736 00000100:00100000:3.0:1782759912.880600:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100736 00000100:00100000:3.0:1782759912.880643:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1782759912.880652:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212100736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759912.880688:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759912.880734:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212100736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759912.880742:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1782759912.880789:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212100736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759913.456474:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759913.513585:0:162072:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdec1f670 20000000:00000080:3.0:1782759913.513604:0:162072:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917089199800 uarg=0000000000000000 00010000:00010000:3.0:1782759913.518722:0:162072:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782759913.518780:0:162072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:3.0:1782759913.518784:0:162072:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759913.518796:0:162072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e11cb lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673a3 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.518850:0:162072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:3.0:1782759913.518853:0:162072:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759913.518858:0:162072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e11af lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6739c expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.518891:0:162072:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 2 locks, left on hash table 0. 10000000:01000000:3.0:1782759913.518928:0:162072:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759913.518940:0:162072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.518953:0:162072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.518961:0:162072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.518994:0:162072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.519008:0:162072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 18 pid: 5793 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759913.519022:0:162072:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162072:1869355212100864:0@lo:104: 00000100:00100000:3.0:1782759913.519081:0:162072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759913.519970:0:162072:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759913.520050:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100864 00000100:00100000:1.0:1782759913.520058:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100864 00000100:00100000:1.0:1782759913.520119:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1782759913.520138:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162072:x1869355212100864:12345-0@lo:104: 00010000:00010000:1.0:1782759913.520152:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.520230:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759913.520236:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162072:x1869355212100864:12345-0@lo:104: Request processed in 101us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759913.520243:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00010000:00010000:0.0:1782759913.520356:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759913.520365:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759913.520373:0:162072:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162072:1869355212100864:0@lo:104: 00010000:00010000:0.0:1782759913.520377:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759913.520383:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520393:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.520395:0:162072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759913.520407:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759913.520425:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759913.520476:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520566:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759913.520598:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520605:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1138 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e113f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759913.520621:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212100992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759913.520622:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759913.520698:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759913.520700:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759913.520758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759913.520856:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212100992 00000100:00100000:0.0:1782759913.520861:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212100992 00010000:00010000:0.0:1782759913.520883:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 19 pid: 5793 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759913.520907:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1782759913.520914:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212100992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759913.520924:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759913.520929:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 19 pid: 5793 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520938:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 19 pid: 5793 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520950:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcc600/0xdd99f5c4777e113f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1138 expref: 19 pid: 5793 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520970:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520978:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520992:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.520999:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.521005:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.521011:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.521017:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759913.521020:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.521027:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.521050:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759913.521059:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759913.521100:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212100992:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759913.521112:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1782759913.521268:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212100992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759913.521342:0:162072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.521351:0:162072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.521358:0:162072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd000/0xdd99f5c4777e11ee lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759914.426305:0:162120:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff12e3c310 20000000:00000080:2.0:1782759914.426322:0:162120:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082efec00 uarg=0000000000000000 00010000:00010000:2.0:1782759914.426528:0:162120:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759914.426543:0:162120:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759914.426562:0:162120:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759914.426585:0:162120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426602:0:162120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426612:0:162120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426627:0:162120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426635:0:162120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426642:0:162120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426648:0:162120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759914.426653:0:162120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426662:0:162120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426752:0:162120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426759:0:162120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759914.426765:0:162120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e11f5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759914.467529:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967447 is committed 00010000:00010000:1.0:1782759914.475952:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759915.181100:0:162170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0d7a8b40 20000000:00000080:3.0:1782759915.181125:0:162170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb93e000 uarg=0000000000000000 00010000:00010000:3.0:1782759915.181468:0:162170:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759915.181488:0:162170:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759915.181521:0:162170:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759915.181548:0:162170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181567:0:162170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181580:0:162170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181588:0:162170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181675:0:162170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181685:0:162170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181691:0:162170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759915.181696:0:162170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181704:0:162170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181718:0:162170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181726:0:162170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.181742:0:162170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e11fc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759915.437854:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212101120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759915.437920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759915.448123:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101120 00000100:00100000:2.0:1782759915.448139:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101120 00000100:00100000:2.0:1782759915.448231:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1782759915.448244:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212101120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759915.448297:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759915.448389:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212101120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (10467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759915.448396:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00080000:2.0:1782759915.448416:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759915.448527:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967447 gen 2 00000004:00080000:2.0:1782759915.448646:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170835a8a80, transno 4294967447 00000100:00100000:2.0:1782759915.448671:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212101120:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782759915.449199:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759915.449204:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759915.449207:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759915.449243:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759915.449254:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759915.449285:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759915.449308:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212101248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759915.449354:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759915.449393:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170818bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759915.449695:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101248 00000100:00100000:0.0:1782759915.449702:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101248 00000100:00100000:0.0:1782759915.449750:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1782759915.449759:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212101248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759915.449770:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759915.449783:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1203 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759915.449806:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759915.449817:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759915.449863:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75a00, rc 0) 00000100:00100000:0.0:1782759915.449909:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212101248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759915.449915:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:2.0:1782759915.450123:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212101248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759915.450139:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759915.450148:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759915.450163:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759915.450169:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759915.450176:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759915.501952:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759916.251492:0:162218:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff187c7390 20000000:00000080:0.0:1782759916.251719:0:162218:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170831cbc00 uarg=0000000000000000 00010000:00010000:0.0:1782759916.252422:0:162218:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759916.252442:0:162218:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759916.252464:0:162218:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759916.252489:0:162218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759916.252778:0:162218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759916.252801:0:162218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759916.253231:0:162218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759916.253253:0:162218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 18 pid: 5793 timeout: 4084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759916.253285:0:162218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162218:1869355212101376:0@lo:104: 00000100:00100000:0.0:1782759916.253376:0:162218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759916.253467:0:162218:0:(client.c:2701:ptlrpc_set_wait()) set ffff91718c114f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759916.255890:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101376 00000100:00100000:2.0:1782759916.255912:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101376 00000100:00100000:2.0:1782759916.256003:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1782759916.256017:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162218:x1869355212101376:12345-0@lo:104: 00010000:00010000:2.0:1782759916.256060:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759916.256199:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759916.256207:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162218:x1869355212101376:12345-0@lo:104: Request processed in 193us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759916.256216:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00010000:00010000:3.0:1782759916.256321:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759916.256330:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256340:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759916.256344:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256355:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759916.256364:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759916.256370:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759916.256426:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256433:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759916.256461:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256468:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180031800/0xdd99f5c4777e1203 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e120a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256507:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759916.256516:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759916.256518:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759916.256536:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212101504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759916.256606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759916.256669:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101504 00000100:00100000:3.0:1782759916.256674:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101504 00010000:00010000:3.0:1782759916.256698:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 19 pid: 5793 timeout: 4084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759916.256725:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1782759916.256731:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170835a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212101504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759916.256744:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759916.256749:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 19 pid: 5793 timeout: 4084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256759:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 19 pid: 5793 timeout: 4084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256780:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256790:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256809:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256816:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256855:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256868:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256874:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74a00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759916.256878:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256887:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256896:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.256911:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759916.256944:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170835a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212101504:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759916.256952:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1782759916.256998:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212101504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759916.257426:0:162218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75a00/0xdd99f5c4777e120a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1203 expref: 18 pid: 5793 timeout: 4084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759916.257440:0:162218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162218:1869355212101376:0@lo:104: 00010000:00010000:1.0:1782759916.257463:0:162218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.257472:0:162218:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.257479:0:162218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.257486:0:162218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74a00/0xdd99f5c4777e1211 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.528674:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759917.251405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759917.251449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759917.252113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759917.252157:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395840 00000100:00100000:2.0:1782759917.252165:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395840 00000100:00100000:2.0:1782759917.252221:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3156 00000100:00100000:2.0:1782759917.252233:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197395840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759917.252324:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197395840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 94us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759917.252332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3156 00000100:00100000:2.0:1782759917.252369:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197396096 00000100:00100000:2.0:1782759917.252373:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197396096 00000100:00100000:2.0:1782759917.252420:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2316 00000100:00100000:2.0:1782759917.252429:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197396096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759917.252630:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197396096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 199us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759917.252640:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2316 00000100:00080000:2.0:1782759917.252802:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759917.253311:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197395968 00000100:00100000:1.0:1782759917.253318:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197395968 00000100:00100000:1.0:1782759917.253373:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2873 00000100:00100000:1.0:1782759917.253383:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2364:x1869355197395968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759917.253434:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2364:x1869355197395968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 55us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759917.253454:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2873 00000100:00080000:2.0:1782759917.253902:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1782759917.292098:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759917.292110:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759917.292117:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759917.292194:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759917.292209:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759917.292224:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759917.292269:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212101632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759917.292363:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759917.292509:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101632 00000100:00100000:1.0:1782759917.292525:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101632 00000100:00100000:1.0:1782759917.292601:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1782759917.292611:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212101632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759917.292628:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759917.292645:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1218 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.292672:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.292683:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.292692:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759917.292763:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212101632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759917.292770:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:3.0:1782759917.293639:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759917.293673:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212101632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759917.293695:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759917.293706:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759917.293729:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759917.293744:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759917.293751:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759917.491041:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212101760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759917.491116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759917.491228:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212102272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759917.492915:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212102144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759917.493045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759917.493220:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212101888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759917.493262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759917.493287:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759917.493293:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212102016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759917.493319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759917.493403:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101760 00000100:00100000:1.0:1782759917.493412:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101760 00000100:00100000:1.0:1782759917.493461:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102144 00000100:00100000:1.0:1782759917.493464:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102144 00000100:00100000:1.0:1782759917.493492:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212101888 00000100:00100000:1.0:1782759917.493496:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212101888 00000100:00100000:3.0:1782759917.493630:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:3.0:1782759917.493643:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212101760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759917.493701:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212101760:12345-0@lo:400:kworker.0 Request processed in 61us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759917.493709:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:3.0:1782759917.493732:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:3.0:1782759917.493738:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212102144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759917.493789:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212102144:12345-0@lo:400:kworker.0 Request processed in 52us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759917.493796:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:3.0:1782759917.493812:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:3.0:1782759917.493819:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212101888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759917.493867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759917.493933:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212101760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759917.494111:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102016 00000100:00100000:2.0:1782759917.494116:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102016 00000100:00100000:2.0:1782759917.494201:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102272 00000100:00100000:2.0:1782759917.494206:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102272 00000100:00100000:3.0:1782759917.494290:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212101888:12345-0@lo:400:kworker.0 Request processed in 472us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759917.494298:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1782759917.498143:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:2.0:1782759917.498170:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212102016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759917.498368:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:0.0:1782759917.498380:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212102272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759917.498482:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212102272:12345-0@lo:400:kworker.0 Request processed in 106us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759917.498490:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:2.0:1782759917.498692:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212102016:12345-0@lo:400:kworker.0 Request processed in 125us (4962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759917.498701:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:0.0:1782759917.499066:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212102272:0@lo:400:kworker.0 00000100:00080000:1.0:1782759917.499405:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759917.499412:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759917.499417:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759917.499713:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212102144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759917.499746:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212102016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759917.499760:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212101888:0@lo:400:kworker.0 00010000:00010000:1.0:1782759917.549202:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759917.996162:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212102400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759917.996302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759917.996431:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102400 00000100:00100000:2.0:1782759917.996452:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102400 00000100:00100000:2.0:1782759917.996527:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1782759917.996554:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212102400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759917.996605:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759918.005880:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212102400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9328us (9564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759918.005930:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1782759918.009757:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212102400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759918.573842:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759919.596003:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759920.558208:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759920.558236:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212102528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759920.558331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759920.558461:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102528 00000100:00100000:1.0:1782759920.558471:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102528 00000100:00100000:1.0:1782759920.558549:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:1.0:1782759920.558562:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212102528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759920.558603:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759920.558654:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212102528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759920.558663:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00080000:0.0:1782759920.558734:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759920.558779:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212102528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759920.622022:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759920.822287:0:162416:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1e341b20 20000000:00000080:3.0:1782759920.822307:0:162416:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc0400 uarg=0000000000000000 10000000:01000000:3.0:1782759920.823799:0:162416:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759920.823860:0:162416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759920.823889:0:162416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759920.823898:0:162416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759920.823943:0:162416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759920.823958:0:162416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 18 pid: 5794 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759920.823974:0:162416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162416:1869355212102656:0@lo:104: 00000100:00100000:3.0:1782759920.824041:0:162416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759920.824116:0:162416:0:(client.c:2701:ptlrpc_set_wait()) set ffff917193118780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759920.824395:0:139369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759920.824410:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102656 00000100:00100000:1.0:1782759920.824416:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102656 00000100:00100000:1.0:1782759920.824475:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1782759920.824484:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162416:x1869355212102656:12345-0@lo:104: 00010000:00010000:1.0:1782759920.824496:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759920.824570:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759920.824577:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162416:x1869355212102656:12345-0@lo:104: Request processed in 94us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759920.824583:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1782759920.824898:0:162416:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162416:1869355212102656:0@lo:104: 00010000:00010000:3.0:1782759920.824923:0:162416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825061:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759920.825069:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825077:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759920.825081:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825101:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759920.825110:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759920.825117:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759920.825153:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825161:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759920.825191:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825211:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91e00/0xdd99f5c4777e1218 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e121f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825230:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759920.825232:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759920.825233:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759920.825241:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759920.825253:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212102784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759920.825291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759920.825331:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102784 00000100:00100000:0.0:1782759920.825335:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102784 00010000:00010000:0.0:1782759920.825356:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 19 pid: 5794 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759920.825600:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1782759920.825609:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212102784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759920.825621:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759920.825627:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 19 pid: 5794 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825638:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 19 pid: 5794 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825651:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e121f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1218 expref: 19 pid: 5794 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825664:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825684:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825698:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825705:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825711:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825717:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825723:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759920.825727:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825733:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825754:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759920.825766:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759920.825799:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355212102784:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759920.825805:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00010000:00010000:2.0:1782759920.825957:0:162416:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759920.825966:0:162416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759920.825972:0:162416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1226 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759920.827215:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212102784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759921.647063:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759921.733733:0:162464:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6b0fbc80 20000000:00000080:3.0:1782759921.733752:0:162464:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbfc0400 uarg=0000000000000000 10000000:01000000:3.0:1782759921.734212:0:162464:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759921.734238:0:162464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734368:0:162464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734381:0:162464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734399:0:162464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734407:0:162464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734415:0:162464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734421:0:162464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759921.734425:0:162464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734435:0:162464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734449:0:162464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734540:0:162464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759921.734547:0:162464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e122d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759922.232316:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759922.232325:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759922.232331:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759922.232393:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759922.232407:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759922.232420:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759922.232450:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212102912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759922.232695:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759922.232759:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170811c6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759922.232766:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212102912 00000100:00100000:0.0:1782759922.232774:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212102912 00000100:00100000:0.0:1782759922.232819:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:0.0:1782759922.233848:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212102912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759922.233874:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759922.233969:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1234 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759922.233998:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759922.234029:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759922.234039:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91600, rc 0) 00000100:00100000:2.0:1782759922.234112:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212102912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1268us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759922.234119:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:3.0:1782759922.234196:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212102912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759922.234221:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.234252:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759922.234283:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759922.234290:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.234303:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759922.371578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759922.371630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759922.371666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759922.371709:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197396480 00000100:00100000:2.0:1782759922.371721:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197396480 00000100:00100000:2.0:1782759922.371783:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2319 00000100:00100000:2.0:1782759922.371793:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197396480:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759922.371883:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197396480:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759922.371892:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2319 00000100:00100000:0.0:1782759922.373062:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197396352 00000100:00100000:0.0:1782759922.373072:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197396352 00000100:00100000:0.0:1782759922.373126:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2877 00000100:00100000:0.0:1782759922.373134:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197396352:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759922.373207:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197396352:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759922.373214:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2877 00000100:00080000:0.0:1782759922.373246:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759922.373250:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759922.374220:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197396224 00000100:00100000:3.0:1782759922.374228:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197396224 00000100:00100000:3.0:1782759922.374278:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3159 00000100:00100000:3.0:1782759922.374286:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197396224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759922.374339:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197396224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 54us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.374346:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3159 00000100:00100000:3.0:1782759922.605430:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212103424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.605520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759922.605573:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759922.605580:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212103040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.605610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759922.605631:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212103552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.605655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759922.605686:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103552 00000100:00100000:3.0:1782759922.605708:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103552 00000100:00100000:3.0:1782759922.605767:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:3.0:1782759922.605777:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212103552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606045:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212103552:12345-0@lo:400:kworker.0 Request processed in 268us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.606178:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1782759922.606224:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212103296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606234:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212103552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759922.606253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759922.606275:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782759922.606279:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103040 00000100:00100000:2.0:1782759922.606281:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212103168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606283:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103040 00000100:00100000:2.0:1782759922.606301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759922.606307:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:3.0:1782759922.606312:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759922.606317:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212103680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759922.606338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759922.606346:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212103040:12345-0@lo:400:kworker.0 Request processed in 33us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.606352:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:3.0:1782759922.606379:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103424 00000100:00100000:3.0:1782759922.606383:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103424 00000100:00100000:3.0:1782759922.606408:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103680 00000100:00100000:3.0:1782759922.606410:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103680 00000100:00100000:3.0:1782759922.606430:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:3.0:1782759922.606436:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212103424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606480:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b3122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212103424:12345-0@lo:400:kworker.0 Request processed in 43us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.606485:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00100000:3.0:1782759922.606497:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1782759922.606503:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212103680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606535:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212103680:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.606549:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1782759922.606588:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212103040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606598:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212103424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606630:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103296 00000100:00100000:3.0:1782759922.606633:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103296 00000100:00100000:3.0:1782759922.606654:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103168 00000100:00100000:3.0:1782759922.606656:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103168 00000100:00100000:3.0:1782759922.606672:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:3.0:1782759922.606678:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212103296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606705:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212103296:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.606711:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:3.0:1782759922.606721:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1782759922.606726:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606747:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212103168:12345-0@lo:400:kworker.0 Request processed in 20us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.606752:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1782759922.606790:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212103168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606800:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212103680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759922.606807:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212103296:0@lo:400:kworker.0 00000100:00080000:3.0:1782759922.607777:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759922.607784:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759922.607787:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759922.670591:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759922.748291:0:162514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4108ef60 20000000:00000080:1.0:1782759922.748312:0:162514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917089299000 uarg=0000000000000000 00010000:00010000:1.0:1782759922.749307:0:162514:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759922.749328:0:162514:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759922.749348:0:162514:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759922.749368:0:162514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.749387:0:162514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.749397:0:162514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.749678:0:162514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.749695:0:162514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 18 pid: 5793 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759922.749712:0:162514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082863b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162514:1869355212103808:0@lo:104: 00000100:00100000:1.0:1782759922.749982:0:162514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759922.750092:0:162514:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170826ca600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759922.750300:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103808 00000100:00100000:2.0:1782759922.750316:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103808 00000100:00100000:2.0:1782759922.750422:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1782759922.750442:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162514:x1869355212103808:12345-0@lo:104: 00010000:00010000:2.0:1782759922.750458:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759922.750536:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759922.750543:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162514:x1869355212103808:12345-0@lo:104: Request processed in 112us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759922.750550:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00010000:00010000:3.0:1782759922.750598:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759922.750612:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750620:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759922.750624:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750634:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759922.750641:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759922.750647:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759922.750684:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750692:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759922.750711:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750718:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91000/0xdd99f5c4777e1234 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e123b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750748:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759922.750750:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759922.750752:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759922.750765:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212103936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759922.750797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759922.750861:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212103936 00000100:00100000:3.0:1782759922.750871:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212103936 00010000:00010000:3.0:1782759922.750891:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 19 pid: 5793 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759922.750913:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1782759922.750918:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212103936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759922.750928:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759922.750933:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 19 pid: 5793 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750942:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 19 pid: 5793 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750958:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750966:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750980:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750986:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750992:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.750998:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.751003:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759922.751014:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.751023:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.751033:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759922.751043:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759922.751074:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212103936:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759922.751080:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1782759922.751142:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b311f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212103936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759922.751669:0:162514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91600/0xdd99f5c4777e123b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1234 expref: 18 pid: 5793 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759922.751683:0:162514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082863b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162514:1869355212103808:0@lo:104: 00010000:00010000:1.0:1782759922.751697:0:162514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.751707:0:162514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.751713:0:162514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759922.751720:0:162514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030000/0xdd99f5c4777e1242 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759923.116534:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759923.116564:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212104064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759923.116664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759923.116887:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104064 00000100:00100000:0.0:1782759923.116896:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104064 00000100:00100000:0.0:1782759923.116954:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1782759923.116965:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212104064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759923.117012:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759923.117089:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212104064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759923.117097:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1782759923.117171:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212104064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759923.693537:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759923.888340:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759923.888350:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759923.888355:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759923.888405:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888417:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888429:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759923.888455:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212104192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759923.888519:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759923.888562:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759923.888582:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104192 00000100:00100000:2.0:1782759923.888602:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104192 00000100:00100000:2.0:1782759923.888661:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:2.0:1782759923.888670:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212104192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759923.888684:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759923.888696:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1249 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888718:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888728:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888738:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759923.888774:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212104192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759923.888781:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:2.0:1782759923.888845:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212104192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759923.888860:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888868:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759923.888889:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759923.888894:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759923.888901:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759924.716810:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759925.684486:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759925.684510:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212104320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759925.684585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759925.684656:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104320 00000100:00100000:1.0:1782759925.684664:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104320 00000100:00100000:1.0:1782759925.684722:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1782759925.684732:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212104320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759925.684787:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759925.684854:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212104320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759925.684862:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1782759925.684911:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212104320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759925.689431:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759925.741276:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759926.204100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759926.204736:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197396736 00000100:00100000:2.0:1782759926.204813:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197396736 00000100:00100000:2.0:1782759926.204908:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2332 00000100:00100000:2.0:1782759926.204919:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110647:x1869355197396736:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759926.204944:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759926.204968:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1257 lrc: 2/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673b1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759926.205016:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759926.209360:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e125e lrc: 3/0,1 mode: --/CW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759926.209383:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e125e lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759926.209396:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e125e lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759926.209495:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782759926.209905:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1257 lrc: 0/0,0 mode: --/CW res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673b1 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759926.210276:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e125e lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673b1 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759926.210288:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782759926.210291:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1782759926.210306:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782759926.210428:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110647:x1869355197396736:12345-192.168.204.31@tcp:101:touch.0 Request processed in 5509us (6333us total) trans 4294968218 rc 0/0 00000100:00100000:2.0:1782759926.210438:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2332 00000100:00100000:1.0:1782759926.214951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759926.214992:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197396992 00000100:00100000:1.0:1782759926.215001:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197396992 00000100:00100000:1.0:1782759926.215053:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2333 00000100:00100000:1.0:1782759926.215077:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110647:x1869355197396992:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:1.0:1782759926.215134:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759926.215164:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e125e lrc: 0/0,0 mode: --/CW res: [0x200000419:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673b1 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.215180:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e11cb) 00010000:00010000:1.0:1782759926.215185:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75400) 00010000:00010000:1.0:1782759926.215197:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759926.215241:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,1 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.215253:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.215263:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759926.215454:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050570182 reply state 00000000d1ef3af2 transno 4294968219 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759926.215464:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759926.215569:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110647:x1869355197396992:12345-192.168.204.31@tcp:36:touch.0 Request processed in 506us (627us total) trans 4294968219 rc 0/0 00000100:00100000:1.0:1782759926.215577:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2333 00010000:00010000:1.0:1782759926.217055:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.217084:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.217091:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.217096:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759926.217100:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.217111:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.217129:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:1.0:1782759926.217133:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759926.217137:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 2/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759926.217144:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e126c lrc: 0/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759926.221849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759926.221898:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197397120 00000100:00100000:2.0:1782759926.221909:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197397120 00000100:00100000:2.0:1782759926.222107:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00100000:2.0:1782759926.222119:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197397120:12345-192.168.204.31@tcp:2:touch.0 00002000:00010000:2.0:1782759926.222402:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759926.222406:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb mtime from disk: 1782759903 -> 1782759925 00002000:00010000:2.0:1782759926.222409:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb atime from disk: 1782759903 -> 1782759925 00002000:00010000:2.0:1782759926.222538:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb ctime from disk: 1782759903 -> 1782759925 00002000:00010000:2.0:1782759926.222540:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782759926.222623:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:2363:x1869355197397120:12345-192.168.204.31@tcp:2:touch.0 Request processed in 504us (805us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1782759926.222631:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1053 00000100:00080000:3.0:1782759926.223865:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759926.241164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759926.241219:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197397376 00000100:00100000:3.0:1782759926.241230:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197397376 00000100:00100000:3.0:1782759926.241287:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 408 00000100:00100000:3.0:1782759926.241298:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110647:x1869355197397376:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:3.0:1782759926.241658:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b76f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110647:x1869355197397376:12345-192.168.204.31@tcp:35:touch.0 Request processed in 362us (507us total) trans 4294968220 rc 0/0 00000100:00100000:3.0:1782759926.241667:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 408 00010000:00010000:1.0:1782759926.767973:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759927.173116:0:162709:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd33e0ac50 20000000:00000080:0.0:1782759927.173133:0:162709:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9170831cbc00 uarg=0000000000000000 00010000:00010000:0.0:1782759927.174072:0:162709:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759927.174092:0:162709:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759927.174113:0:162709:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759927.174132:0:162709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759927.174149:0:162709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759927.174158:0:162709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759927.174197:0:162709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759927.174214:0:162709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 18 pid: 5794 timeout: 4095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759927.174229:0:162709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162709:1869355212104448:0@lo:104: 00000100:00100000:0.0:1782759927.174295:0:162709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759927.174528:0:162709:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759927.174578:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104448 00000100:00100000:1.0:1782759927.174586:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104448 00000100:00100000:1.0:1782759927.174673:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1782759927.174683:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162709:x1869355212104448:12345-0@lo:104: 00010000:00010000:1.0:1782759927.174697:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759927.174840:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759927.174847:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162709:x1869355212104448:12345-0@lo:104: Request processed in 166us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759927.174855:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1782759927.174945:0:162709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162709:1869355212104448:0@lo:104: 00010000:00010000:0.0:1782759927.174964:0:162709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175060:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759927.175068:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175075:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759927.175086:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175095:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759927.175102:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759927.175107:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759927.175167:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175174:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759927.175204:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175211:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1249 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1250 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175228:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759927.175230:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759927.175232:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759927.175239:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759927.175250:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212104576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759927.175288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759927.175325:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104576 00000100:00100000:3.0:1782759927.175330:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104576 00010000:00010000:3.0:1782759927.175368:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 19 pid: 5794 timeout: 4095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759927.175405:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1782759927.175413:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212104576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759927.175425:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759927.175429:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 19 pid: 5794 timeout: 4095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175439:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 19 pid: 5794 timeout: 4095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175451:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e1250 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1249 expref: 19 pid: 5794 timeout: 4095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175464:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175471:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175484:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175491:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175498:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175504:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175519:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759927.175523:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175530:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175542:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759927.175551:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759927.175583:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b311f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212104576:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759927.175589:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1782759927.175623:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212104576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759927.175684:0:162709:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759927.175692:0:162709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759927.175704:0:162709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74600/0xdd99f5c4777e1273 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759927.476886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759927.476931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759927.476983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759927.477014:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197397632 00000100:00100000:1.0:1782759927.477024:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197397632 00000100:00100000:1.0:1782759927.477088:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2881 00000100:00100000:1.0:1782759927.477099:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+8:2361:x1869355197397632:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759927.477179:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+8:2361:x1869355197397632:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759927.477186:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2881 00000100:00100000:2.0:1782759927.477865:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197397760 00000100:00100000:2.0:1782759927.477871:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197397760 00000100:00100000:2.0:1782759927.477916:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2322 00000100:00100000:2.0:1782759927.477925:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:2361:x1869355197397760:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759927.477977:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:2361:x1869355197397760:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 53us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759927.477984:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2322 00000100:00100000:3.0:1782759927.479726:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197397504 00000100:00100000:3.0:1782759927.479737:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197397504 00000100:00100000:3.0:1782759927.479804:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3162 00000100:00100000:3.0:1782759927.479814:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197397504:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759927.479904:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197397504:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759927.479912:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3162 00000100:00100000:3.0:1782759927.731118:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212104704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.731231:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759927.731282:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104704 00000100:00100000:3.0:1782759927.731289:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212105216:0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.731291:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104704 00000100:00100000:0.0:1782759927.731344:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:0.0:1782759927.731354:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.731406:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212104704:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759927.731414:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:0.0:1782759927.731941:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212104832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.731978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759927.732003:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212105344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.732028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759927.732062:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759927.732069:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212104960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.732095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759927.732125:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104832 00000100:00100000:0.0:1782759927.732130:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104832 00000100:00100000:0.0:1782759927.732160:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212104960 00000100:00100000:0.0:1782759927.732163:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212104960 00000100:00100000:0.0:1782759927.732191:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1782759927.732198:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.732239:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212104832:12345-0@lo:400:kworker.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759927.732246:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1782759927.732274:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:0.0:1782759927.732281:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198913850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212104960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.732313:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198913850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212104960:12345-0@lo:400:kworker.0 Request processed in 33us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759927.732319:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1782759927.732523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759927.732575:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212104704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.732596:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759927.732604:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212105088:0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.732633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759927.732885:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105344 00000100:00100000:3.0:1782759927.732891:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105344 00000100:00100000:3.0:1782759927.732930:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105088 00000100:00100000:3.0:1782759927.732933:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105088 00000100:00100000:3.0:1782759927.732965:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:3.0:1782759927.732974:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.733018:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212105344:12345-0@lo:400:kworker.0 Request processed in 46us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759927.733026:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:3.0:1782759927.733054:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:3.0:1782759927.733062:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212105088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.733103:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212105088:12345-0@lo:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759927.733110:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00080000:3.0:1782759927.733130:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759927.733135:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759927.733139:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759927.733149:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105216 00000100:00100000:3.0:1782759927.733153:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105216 00000100:00100000:3.0:1782759927.733184:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1782759927.733192:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.733229:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212105216:12345-0@lo:400:kworker.0 Request processed in 38us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759927.733245:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1782759927.733297:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212105088:0@lo:400:kworker.0 00000100:00100000:3.0:1782759927.733337:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91718796b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212105216:0@lo:400:kworker.0 00000100:00080000:3.0:1782759927.733362:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759927.733891:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212104960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.733911:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170835ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212104832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759927.733927:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917187968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212105344:0@lo:400:kworker.0 00010000:00010000:0.0:1782759927.790563:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759927.818358:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968219 is committed 00000001:00080000:0.0:1782759927.818383:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968220 is committed 00000100:00100000:3.0:1782759928.238203:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212105472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759928.238318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759928.238562:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105472 00000100:00100000:1.0:1782759928.238572:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105472 00000100:00100000:1.0:1782759928.238638:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:1.0:1782759928.238650:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212105472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759928.238701:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759928.239159:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212105472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 509us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759928.239169:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1782759928.239215:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212105472:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1782759928.492381:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759928.492393:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759928.492400:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759928.492467:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759928.492482:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759928.492495:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759928.492530:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212105600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759928.492627:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759928.492705:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759928.492883:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105600 00000100:00100000:2.0:1782759928.492893:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105600 00000100:00100000:2.0:1782759928.492948:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:2.0:1782759928.492959:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212105600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759928.492991:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759928.493010:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e127a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759928.493053:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759928.493066:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759928.493077:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759928.493139:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212105600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759928.493147:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00100000:1.0:1782759928.493260:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212105600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759928.493279:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759928.493300:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759928.493330:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759928.493347:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759928.493356:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759928.820143:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759929.837124:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759929.845850:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967448 is committed 00000100:00100000:1.0:1782759930.762910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759930.762993:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197397888 00000100:00100000:3.0:1782759930.763014:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197397888 00000100:00100000:3.0:1782759930.763139:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2334 00000100:00100000:3.0:1782759930.763156:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110723:x1869355197397888:12345-192.168.204.31@tcp:101:lfs.0 00000100:00080000:0.0:1782759930.763170:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759930.763189:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759930.763222:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1288 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673b8 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.763337:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.763356:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.763374:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.763390:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.763423:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.763431:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764224:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764236:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764247:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759930.764302:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759930.764307:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759930.764338:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764350:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764361:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764368:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764376:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764394:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759930.764400:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764410:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764426:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759930.764430:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759930.764437:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764443:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e128f lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764457:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764463:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764470:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764475:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759930.764478:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764484:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764503:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171908a1500) 00010000:00010000:3.0:1782759930.764505:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759930.764508:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764514:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1296 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764558:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e1288 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673b8 expref: 7 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764576:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673b8 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.764584:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759930.764586:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759930.764588:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd000, rc 0) 00000100:00100000:3.0:1782759930.764693:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110723:x1869355197397888:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1543us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759930.764703:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2334 00000100:00100000:1.0:1782759930.780712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759930.780844:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197398144 00000100:00100000:0.0:1782759930.780855:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197398144 00000100:00100000:0.0:1782759930.780915:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2335 00000100:00100000:0.0:1782759930.780926:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110723:x1869355197398144:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759930.780992:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759930.781024:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e129d lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673b8 expref: 6 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.781042:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:0.0:1782759930.781054:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759930.781081:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.781094:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.781104:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759930.781611:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].60, 88 off12248 00000004:00080000:0.0:1782759930.781622:0:7487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3999184799204ns, next at 4000184796666ns, rc = 0 00000004:00010000:0.0:1782759930.781713:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066ba3031 reply state 00000000ee0a463f transno 4294968221 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759930.781723:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759930.781887:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110723:x1869355197398144:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 961us (1182us total) trans 4294968221 rc 0/0 00000100:00100000:0.0:1782759930.781895:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2335 00010000:00010000:2.0:1782759930.783770:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.783788:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.783796:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.783803:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759930.783808:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.783817:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.783879:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:2.0:1782759930.783897:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759930.783903:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.783909:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e12a4 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759930.802024:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212105728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759930.802139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759930.803621:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105728 00000100:00100000:0.0:1782759930.803655:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105728 00000100:00100000:0.0:1782759930.803742:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1782759930.803754:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212105728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759930.803797:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759930.803938:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212105728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759930.803946:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1782759930.804075:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212105728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759930.804300:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759930.804543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759930.804704:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197398400 00000100:00100000:0.0:1782759930.804711:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197398400 00000100:00100000:0.0:1782759930.804762:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2336 00000100:00100000:0.0:1782759930.804771:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110724:x1869355197398400:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759930.804819:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759930.804855:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e11af) 00010000:00010000:0.0:1782759930.804858:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759930.804890:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,1 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.804905:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.804916:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759930.805490:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b59edfa reply state 0000000097fae20f transno 4294968222 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759930.805502:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759930.805581:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000100:00100000:0.0:1782759930.805678:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110724:x1869355197398400:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 905us (1137us total) trans 4294968222 rc 0/0 00000100:00100000:0.0:1782759930.805695:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2336 00000100:00100000:1.0:1782759930.811505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759930.811647:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197398656 00000100:00100000:2.0:1782759930.811660:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197398656 00000100:00100000:2.0:1782759930.811857:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2337 00000100:00100000:2.0:1782759930.811871:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110724:x1869355197398656:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759930.811906:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759930.811935:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e12b2 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673bf expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.812050:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.812069:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.812084:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.812096:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.812103:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.812110:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759930.812691:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782759930.813536:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813551:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813559:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813567:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759930.813572:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813579:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813598:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782759930.813601:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759930.813606:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813612:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12b9 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813626:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813632:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813649:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813655:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759930.813657:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813663:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813670:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917191f75900) 00010000:00010000:2.0:1782759930.813672:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759930.813674:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.813680:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12c0 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815532:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815552:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815583:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815589:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759930.815595:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815603:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815623:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1000) 00010000:00010000:3.0:1782759930.815626:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759930.815631:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 2/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.815638:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e12ab lrc: 0/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.816488:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e12b2 lrc: 1/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673bf expref: 9 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.816506:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782759930.816509:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759930.816513:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e12b2 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673bf expref: 9 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.816536:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759930.816700:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110724:x1869355197398656:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4830us (5208us total) trans 4294968223 rc 301/301 00000100:00100000:2.0:1782759930.816740:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2337 00000100:00100000:2.0:1782759930.825109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759930.825455:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197398912 00000100:00100000:0.0:1782759930.825470:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197398912 00000100:00100000:0.0:1782759930.825574:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 409 00000100:00100000:0.0:1782759930.825585:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110724:x1869355197398912:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759930.826354:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110724:x1869355197398912:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 765us (1257us total) trans 4294968224 rc 0/0 00000100:00100000:0.0:1782759930.826366:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 409 00000100:00100000:2.0:1782759930.832585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759930.832818:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399040 00000100:00100000:0.0:1782759930.832878:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399040 00000100:00100000:0.0:1782759930.832947:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2338 00000100:00100000:0.0:1782759930.832959:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110724:x1869355197399040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759930.833006:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759930.833042:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e12ce lrc: 2/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673c6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.833158:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e12d5 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.833175:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e12d5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.833188:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e12d5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759930.833475:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782759930.833492:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759930.833604:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e12d5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.833640:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e12ce lrc: 0/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673c6 expref: 11 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.833664:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e12d5 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673c6 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.833674:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1500) 00010000:00010000:0.0:1782759930.833678:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759930.833682:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75c00, rc 0) 00000100:00100000:0.0:1782759930.836635:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110724:x1869355197399040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3660us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759930.836651:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2338 00000100:00100000:1.0:1782759930.844795:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759930.845251:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399168 00000100:00100000:3.0:1782759930.845268:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399168 00000100:00100000:3.0:1782759930.845388:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 410 00000100:00100000:3.0:1782759930.845400:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198916c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110724:x1869355197399168:12345-192.168.204.31@tcp:37:lfs.0 00010000:00010000:0.0:1782759930.861123:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759930.862706:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198916c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110724:x1869355197399168:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 17296us (17916us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759930.862724:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 410 00000100:00100000:1.0:1782759930.889870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759930.890056:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399296 00000100:00100000:2.0:1782759930.890067:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399296 00000100:00100000:2.0:1782759930.890120:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2339 00000100:00100000:2.0:1782759930.890130:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110726:x1869355197399296:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759930.890152:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759930.890178:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12dc lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673cd expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890251:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890266:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890278:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890308:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890316:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890322:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890669:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890685:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.890693:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759930.891035:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759930.891040:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759930.891064:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891076:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891084:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891090:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891097:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891102:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759930.891108:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891114:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891126:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75300) 00010000:00010000:2.0:1782759930.891129:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759930.891140:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891146:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e12e3 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891161:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891167:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891173:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891178:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759930.891181:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891187:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891194:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff917191f75900) 00010000:00010000:2.0:1782759930.891196:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759930.891199:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891203:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e12ea lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891234:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e12dc lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673cd expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891263:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673cd expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759930.891271:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782759930.891273:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759930.891275:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759930.892298:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110726:x1869355197399296:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2151us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759930.892314:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2339 00000100:00100000:1.0:1782759930.926458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759930.926649:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399424 00000100:00100000:3.0:1782759930.926659:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399424 00000100:00100000:3.0:1782759930.926776:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2340 00000100:00100000:3.0:1782759930.926787:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110729:x1869355197399424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759930.926863:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759930.926888:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e12f8 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673d4 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.926958:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.926982:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.926993:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927005:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927011:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927018:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927364:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e130d lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927374:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e130d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927381:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e130d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759930.927477:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1782759930.927486:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759930.927570:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e130d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927583:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927590:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927598:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927603:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759930.927608:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927616:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927630:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759930.927633:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759930.927638:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927644:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e12ff lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927657:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927662:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927677:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927682:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759930.927685:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927691:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927699:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff9171908a1500) 00010000:00010000:3.0:1782759930.927701:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759930.927704:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927710:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1306 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927741:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e12f8 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673d4 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927757:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e130d lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673d4 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.927764:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1500) 00010000:00010000:3.0:1782759930.927766:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759930.927769:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc600, rc 0) 00000100:00100000:3.0:1782759930.927865:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+12:110729:x1869355197399424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1080us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759930.927882:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2340 00000100:00100000:1.0:1782759930.935405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759930.935523:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399552 00000100:00100000:0.0:1782759930.935534:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399552 00000100:00100000:0.0:1782759930.935635:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 194 00000100:00100000:0.0:1782759930.935645:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+12:2364:x1869355197399552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759930.935663:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759930.935688:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e130d lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673d4 expref: 12 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759930.935708:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1500) 00010000:00010000:0.0:1782759930.935712:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759930.935788:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+11:2364:x1869355197399552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 144us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759930.935815:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 194 00000020:00000080:2.0:1782759931.641918:0:162908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc4780c060 20000000:00000080:2.0:1782759931.641935:0:162908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082700800 uarg=0000000000000000 00010000:00010000:2.0:1782759931.642481:0:162908:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759931.642521:0:162908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782759931.642525:0:162908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759931.642538:0:162908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e12f1 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673cd expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759931.642568:0:162908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1500) 00010000:00010000:2.0:1782759931.642570:0:162908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759931.642574:0:162908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e12d5 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673c6 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759931.642602:0:162908:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 2 locks, left on hash table 0. 10000000:01000000:2.0:1782759931.642628:0:162908:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759931.642644:0:162908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759931.642668:0:162908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759931.642678:0:162908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759931.642724:0:162908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759931.642739:0:162908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 18 pid: 5794 timeout: 4100 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759931.642754:0:162908:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162908:1869355212105856:0@lo:104: 00000100:00100000:2.0:1782759931.642853:0:162908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759931.642904:0:162908:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719fe9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759931.643224:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105856 00000100:00100000:0.0:1782759931.643233:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105856 00000100:00100000:0.0:1782759931.643286:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1782759931.643298:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162908:x1869355212105856:12345-0@lo:104: 00010000:00010000:0.0:1782759931.643312:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759931.643384:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759931.643390:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:162908:x1869355212105856:12345-0@lo:104: Request processed in 96us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759931.643398:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00010000:00010000:1.0:1782759931.643460:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759931.643469:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643477:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759931.643480:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643496:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759931.643502:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759931.643508:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759931.643542:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643549:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759931.643575:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643582:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d74400/0xdd99f5c4777e127a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1281 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643596:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759931.643598:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759931.643599:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759931.643610:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212105984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759931.643644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759931.643681:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212105984 00000100:00100000:1.0:1782759931.643685:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212105984 00010000:00010000:1.0:1782759931.643704:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 19 pid: 5794 timeout: 4100 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759931.643724:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1782759931.643729:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212105984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759931.643745:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759931.643750:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 19 pid: 5794 timeout: 4100 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643760:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 19 pid: 5794 timeout: 4100 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643775:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643783:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643796:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643803:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643810:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643817:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643847:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759931.643850:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643858:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643876:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.643885:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759931.643909:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212105984:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759931.643916:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1782759931.643952:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212105984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759931.644183:0:162908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e1281 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e127a expref: 18 pid: 5794 timeout: 4100 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759931.644193:0:162908:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162908:1869355212105856:0@lo:104: 00010000:00010000:3.0:1782759931.644207:0:162908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759931.644215:0:162908:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759931.644221:0:162908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759931.644226:0:162908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e1314 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.886897:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759932.603188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759932.603245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759932.603279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759932.603299:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399680 00000100:00100000:1.0:1782759932.603305:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399808 00000100:00100000:1.0:1782759932.603309:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399808 00000100:00100000:0.0:1782759932.603310:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399680 00000100:00100000:1.0:1782759932.603360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2885 00000100:00100000:1.0:1782759932.603370:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:2362:x1869355197399808:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759932.603373:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3165 00000100:00100000:0.0:1782759932.603380:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197399680:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759932.603449:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197399680:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759932.603457:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3165 00000100:00100000:3.0:1782759932.605637:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197399936 00000100:00100000:3.0:1782759932.605650:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197399936 00000100:00100000:3.0:1782759932.605722:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2325 00000100:00100000:3.0:1782759932.605734:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197399936:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759932.611039:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:2362:x1869355197399808:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 7658us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759932.611057:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2885 00000100:00080000:1.0:1782759932.611108:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759932.611115:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759932.617420:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197399936:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 11677us (14162us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759932.617435:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2325 10000000:01000000:0.0:1782759932.779921:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759932.779931:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759932.779948:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759932.779997:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759932.780010:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759932.780034:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759932.780069:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212106112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759932.780159:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759932.780227:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917189643600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759932.780386:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106112 00000100:00100000:1.0:1782759932.780395:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106112 00000100:00100000:1.0:1782759932.780452:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:1.0:1782759932.780462:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212106112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759932.780476:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759932.780500:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e131b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759932.780527:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759932.780539:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759932.780550:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030e00, rc 0) 00000100:00100000:1.0:1782759932.780608:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212106112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759932.780614:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:3.0:1782759932.780848:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212106112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759932.780866:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759932.780886:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759932.780911:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759932.780916:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759932.780922:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759932.848288:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212106240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759932.848358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759932.848449:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212106368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759932.848473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759932.848510:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106240 00000100:00100000:2.0:1782759932.848518:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106240 00000100:00100000:2.0:1782759932.848559:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106368 00000100:00100000:2.0:1782759932.848562:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106368 00000100:00100000:0.0:1782759932.848567:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1782759932.848578:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212106240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759932.848681:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759932.852145:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212106240:12345-0@lo:400:kworker.0 Request processed in 3558us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759932.852161:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1782759932.852199:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:0.0:1782759932.852211:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212106368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.854124:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3306:x1869355212106368:12345-0@lo:400:kworker.0 Request processed in 1908us (5640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759932.854138:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:0.0:1782759932.854219:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212106240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.856817:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869355212106368:0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.858067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759932.858081:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212106496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.858144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759932.858207:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212106624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.858233:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759932.858245:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106496 00000100:00100000:0.0:1782759932.858278:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106624 00000100:00100000:0.0:1782759932.858285:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106624 00000100:00100000:3.0:1782759932.858361:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106496 00000100:00100000:3.0:1782759932.858394:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:3.0:1782759932.858402:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212106496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759932.858458:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212106496:12345-0@lo:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759932.858466:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00100000:3.0:1782759932.860008:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212106496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.860692:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:0.0:1782759932.860707:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212106624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.860791:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212106624:12345-0@lo:400:kworker.0 Request processed in 88us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759932.860798:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:3.0:1782759932.860951:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212106624:0@lo:400:kworker.0 00000100:00080000:0.0:1782759932.861903:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759932.861911:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759932.861970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759932.861984:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212106752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.862031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759932.862077:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106752 00000100:00100000:0.0:1782759932.862083:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106752 00000100:00100000:0.0:1782759932.862126:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:0.0:1782759932.862133:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212106752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759932.862177:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212106752:12345-0@lo:400:kworker.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759932.862183:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:0.0:1782759932.862229:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212106752:0@lo:400:kworker.0 00000100:00080000:0.0:1782759932.862247:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782759932.901184:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968224 is committed 00000004:00080000:1.0:1782759932.901207:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 135 committed 00000100:00100000:0.0:1782759932.902180:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212106880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782759932.902256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759932.902333:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212106880 00000100:00100000:3.0:1782759932.902342:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212106880 00000100:00100000:3.0:1782759932.902397:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1782759932.902407:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212106880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782759932.902628:0:126932:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759932.902632:0:126932:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb mtime from disk: 1782759925 -> 1782759925 00002000:00010000:3.0:1782759932.902648:0:126932:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb atime from disk: 1782759925 -> 1782759925 00002000:00010000:3.0:1782759932.902650:0:126932:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb ctime from disk: 1782759925 -> 1782759925 00002000:00010000:3.0:1782759932.902652:0:126932:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782759932.902757:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1869355212106880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 350us (500us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1782759932.902765:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000004:00080000:0.0:1782759932.903216:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170839c0000/2, rc 0, transno 4294967449 00000100:00100000:0.0:1782759932.903224:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212106880:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1782759932.908144:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759933.358227:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759933.358259:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212107008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759933.358344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759933.358400:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107008 00000100:00100000:2.0:1782759933.358412:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107008 00000100:00100000:2.0:1782759933.358468:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1782759933.358478:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212107008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759933.358520:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759933.358586:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212107008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759933.358594:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1782759933.359075:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212107008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759933.936503:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759934.533784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759934.533933:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197400192 00000100:00100000:3.0:1782759934.533945:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197400192 00000100:00100000:3.0:1782759934.534020:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2341 00000100:00100000:3.0:1782759934.534031:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110804:x1869355197400192:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759934.534089:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759934.534094:0:5802:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e12f1) 00010000:00010000:3.0:1782759934.534096:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759934.534182:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110804:x1869355197400192:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 152us (408us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759934.534190:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2341 00000100:00080000:3.0:1782759934.534231:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759934.557679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759934.557875:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197400448 00000100:00100000:0.0:1782759934.557892:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197400448 00000100:00100000:0.0:1782759934.557961:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2342 00000100:00100000:0.0:1782759934.557971:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110805:x1869355197400448:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759934.558026:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759934.558031:0:146757:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e12d5) 00010000:00010000:0.0:1782759934.558033:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759934.558127:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110805:x1869355197400448:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 157us (454us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759934.558136:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2342 00000100:00100000:3.0:1782759934.581934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759934.581991:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197400576 00000100:00100000:1.0:1782759934.582002:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197400576 00000100:00100000:1.0:1782759934.582145:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2343 00000100:00100000:1.0:1782759934.582157:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110807:x1869355197400576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759934.582183:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759934.582211:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e1329 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673db expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582383:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582398:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582410:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582424:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582509:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582517:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582923:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582933:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.582941:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759934.582980:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782759934.582985:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759934.583004:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.583026:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584663:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584679:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584686:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584692:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759934.584698:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584706:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584721:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:1.0:1782759934.584725:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759934.584730:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584736:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031800/0xdd99f5c4777e1330 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584755:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584762:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584783:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584788:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759934.584791:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584798:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584806:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171889c5200) 00010000:00010000:1.0:1782759934.584809:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759934.584812:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584817:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e1337 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584879:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e1329 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673db expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584896:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673db expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.584915:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:1.0:1782759934.584917:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759934.584920:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030000, rc 0) 00000100:00100000:1.0:1782759934.585005:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110807:x1869355197400576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2850us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759934.585022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2343 00000100:00100000:3.0:1782759934.619167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759934.619376:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197400704 00000100:00100000:0.0:1782759934.619386:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197400704 00000100:00100000:0.0:1782759934.619449:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2344 00000100:00100000:0.0:1782759934.619459:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110810:x1869355197400704:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759934.619480:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759934.619503:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1345 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673e2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.619580:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.619594:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.619607:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.619621:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.619628:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.619652:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620176:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e135a lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620188:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e135a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620197:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e135a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759934.620306:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782759934.620311:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782759934.620387:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e135a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620400:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620406:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620413:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620420:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759934.620424:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620658:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620672:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:1.0:1782759934.620681:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759934.620686:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620693:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e134c lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620707:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620713:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620730:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620736:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759934.620739:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620745:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620752:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917182dd1400) 00010000:00010000:1.0:1782759934.620754:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759934.620757:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620762:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e1353 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620805:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1345 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673e2 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620880:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e135a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673e2 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.620889:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:1.0:1782759934.620891:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759934.620894:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759934.620986:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110810:x1869355197400704:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1527us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759934.620995:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2344 00000100:00100000:3.0:1782759934.658452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759934.658613:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197400960 00000100:00100000:2.0:1782759934.658624:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197400960 00000100:00100000:2.0:1782759934.658690:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2345 00000100:00100000:2.0:1782759934.658703:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110812:x1869355197400960:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759934.658767:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759934.658799:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e133e lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673db expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759934.658817:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171889c5f00) 00010000:00010000:2.0:1782759934.658915:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759934.659000:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110812:x1869355197400960:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 300us (788us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759934.659008:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2345 00000100:00100000:0.0:1782759934.672940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759934.673055:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197401216 00000100:00100000:2.0:1782759934.673066:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197401216 00000100:00100000:2.0:1782759934.673128:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2346 00000100:00100000:2.0:1782759934.673138:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110813:x1869355197401216:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759934.673198:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759934.673250:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e135a lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673e2 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759934.673276:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff9171889c5e00) 00010000:00010000:2.0:1782759934.673286:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759934.673381:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110813:x1869355197401216:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 244us (450us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759934.673389:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2346 00000001:00080000:2.0:1782759934.937025:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967449 is committed 00010000:00010000:1.0:1782759934.960558:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759935.327747:0:163105:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd53a30780 20000000:00000080:1.0:1782759935.327767:0:163105:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917089299c00 uarg=0000000000000000 00010000:00010000:1.0:1782759935.331424:0:163105:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759935.331446:0:163105:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759935.331466:0:163105:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759935.331487:0:163105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759935.331505:0:163105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759935.331592:0:163105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759935.331634:0:163105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759935.331650:0:163105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 18 pid: 5793 timeout: 4103 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759935.331673:0:163105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163105:1869355212107136:0@lo:104: 00000100:00100000:1.0:1782759935.331736:0:163105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759935.331788:0:163105:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759935.331976:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107136 00000100:00100000:2.0:1782759935.331984:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107136 00000100:00100000:2.0:1782759935.332038:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1782759935.332049:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163105:x1869355212107136:12345-0@lo:104: 00010000:00010000:2.0:1782759935.332063:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759935.332140:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759935.332146:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163105:x1869355212107136:12345-0@lo:104: Request processed in 101us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759935.332154:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00010000:00010000:0.0:1782759935.332257:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759935.332265:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332273:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75200 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759935.332277:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332295:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759935.332303:0:163105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163105:1869355212107136:0@lo:104: 10000000:00010000:0.0:1782759935.332305:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759935.332315:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759935.332327:0:163105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332355:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332362:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759935.332392:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332400:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75200/0xdd99f5c4777e131b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1322 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332418:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759935.332425:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782759935.332427:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759935.332431:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759935.332440:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212107264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759935.332474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759935.332775:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107264 00000100:00100000:0.0:1782759935.332780:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107264 00010000:00010000:0.0:1782759935.332803:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 19 pid: 5793 timeout: 4103 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759935.332847:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1782759935.332854:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212107264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759935.332875:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759935.332881:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 19 pid: 5793 timeout: 4103 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332903:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 19 pid: 5793 timeout: 4103 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332916:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030e00/0xdd99f5c4777e1322 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e131b expref: 19 pid: 5793 timeout: 4103 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332928:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332936:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332948:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332955:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332962:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332974:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332979:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759935.332983:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.332989:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.333008:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.333018:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759935.333068:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212107264:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759935.333076:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1782759935.333167:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212107264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759935.333723:0:163105:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759935.333733:0:163105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759935.333739:0:163105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030800/0xdd99f5c4777e1361 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759935.921725:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759935.921803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759935.923953:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107392 00000100:00100000:1.0:1782759935.923969:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107392 00000100:00100000:1.0:1782759935.924075:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1782759935.924087:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212107392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759935.924128:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759935.924210:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212107392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759935.924218:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1782759935.924276:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967449 gen 2 00000004:00080000:1.0:1782759935.924282:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170839c0000, transno 4294967449 00000100:00100000:1.0:1782759935.924303:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212107392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759935.928567:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759935.980171:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759937.004252:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759937.196046:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759937.196055:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759937.196059:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759937.196116:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759937.196128:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759937.196139:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759937.196166:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212107520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759937.196236:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759937.196297:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082916480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759937.196846:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107520 00000100:00100000:2.0:1782759937.196863:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107520 00000100:00100000:2.0:1782759937.196919:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:2.0:1782759937.196928:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212107520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759937.196945:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759937.196960:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1368 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.196984:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.196996:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.197017:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90000, rc 0) 00000100:00100000:2.0:1782759937.197071:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212107520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759937.197078:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1782759937.197239:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212107520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759937.197256:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759937.197275:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759937.197298:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759937.197303:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759937.197310:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759937.723313:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759937.723358:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759937.723444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759937.723496:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197401344 00000100:00100000:3.0:1782759937.723507:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197401344 00000100:00100000:3.0:1782759937.723573:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3168 00000100:00100000:3.0:1782759937.723584:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197401344:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759937.723675:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197401344:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759937.723683:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3168 00000100:00100000:3.0:1782759937.723718:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197401472 00000100:00100000:3.0:1782759937.723722:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197401472 00000100:00100000:3.0:1782759937.723761:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2889 00000100:00100000:3.0:1782759937.723769:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197401472:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759937.723801:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197401472:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759937.723807:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2889 00000100:00100000:3.0:1782759937.723860:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197401600 00000100:00100000:3.0:1782759937.723864:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197401600 00000100:00100000:3.0:1782759937.723906:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2328 00000100:00100000:3.0:1782759937.723913:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197401600:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759937.723943:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197401600:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759937.723949:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2328 00000100:00080000:3.0:1782759937.724081:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759937.724086:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759937.966531:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759937.966556:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212107648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.966598:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212107776:0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.972067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759937.972143:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107776 00000100:00100000:3.0:1782759937.972163:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107776 00000100:00100000:3.0:1782759937.972223:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1782759937.972223:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212108288:0@lo:400:kworker.0 00000100:00100000:3.0:1782759937.972236:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212107776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.972296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759937.972308:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212107776:12345-0@lo:400:kworker.0 Request processed in 74us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759937.972318:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1782759937.972663:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212107776:0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.972684:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759937.972693:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212107904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.972918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759937.972977:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108288 00000100:00100000:0.0:1782759937.972982:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108288 00000100:00100000:3.0:1782759937.973002:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107904 00000100:00100000:3.0:1782759937.973008:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107904 00000100:00100000:0.0:1782759937.973029:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:0.0:1782759937.973038:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212108288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759937.973052:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1782759937.973061:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212107904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.973088:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212108288:12345-0@lo:400:kworker.0 Request processed in 50us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759937.973097:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:3.0:1782759937.973108:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212107904:12345-0@lo:400:kworker.0 Request processed in 48us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759937.973117:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00080000:0.0:1782759937.973128:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759937.973134:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759937.973160:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212107904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759937.973171:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212108288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759937.973952:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212108160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759937.974002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759937.974055:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759937.974065:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212108032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759937.974096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759937.974115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759937.974316:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108160 00000100:00100000:1.0:1782759937.974322:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108160 00000100:00100000:1.0:1782759937.974372:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:1.0:1782759937.974380:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212108160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759937.974422:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212108160:12345-0@lo:400:kworker.0 Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759937.974429:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00080000:0.0:1782759937.974746:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759937.975413:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212107648 00000100:00100000:1.0:1782759937.975421:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212107648 00000100:00100000:1.0:1782759937.975983:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:1.0:1782759937.975997:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212107648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759937.976087:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212107648:12345-0@lo:400:kworker.0 Request processed in 92us (9441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759937.976096:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:2.0:1782759937.976215:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212108160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759937.982195:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108032 00000100:00100000:1.0:1782759937.982210:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108032 00000100:00080000:2.0:1782759937.982278:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759937.982289:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1782759937.982301:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212108032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759937.982406:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212108032:12345-0@lo:400:kworker.0 Request processed in 108us (8309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759937.982413:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1782759937.982469:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212107648:0@lo:400:kworker.0 00000100:00100000:1.0:1782759937.982518:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212108032:0@lo:400:kworker.0 00010000:00010000:0.0:1782759938.030650:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759938.220243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759938.220355:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197401728 00000100:00100000:3.0:1782759938.220366:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197401728 00000100:00100000:3.0:1782759938.220430:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2347 00000100:00100000:3.0:1782759938.220441:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+5:110886:x1869355197401728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759938.220470:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759938.220498:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1376 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673e9 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.220580:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.220595:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.220607:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.220620:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.220627:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.220634:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221046:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221055:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221063:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759938.221101:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759938.221105:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759938.221126:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221147:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221157:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221163:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221169:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221175:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759938.221179:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221186:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221198:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782759938.221201:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759938.221206:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221211:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e137d lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221223:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221228:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221240:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221245:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759938.221248:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221254:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221261:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171908a1e00) 00010000:00010000:3.0:1782759938.221263:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759938.221266:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221271:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1384 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221302:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e1376 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673e9 expref: 7 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221317:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673e9 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.221324:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:3.0:1782759938.221326:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759938.221328:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759938.221391:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110886:x1869355197401728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 952us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759938.221413:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2347 00000100:00100000:3.0:1782759938.227015:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759938.227095:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197401984 00000100:00100000:1.0:1782759938.227106:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197401984 00000100:00100000:1.0:1782759938.227165:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2348 00000100:00100000:1.0:1782759938.227175:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110886:x1869355197401984:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759938.227233:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759938.227261:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e138b lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673e9 expref: 6 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.227278:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1a00) 00010000:00010000:1.0:1782759938.227289:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759938.227314:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.227328:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.227338:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759938.227772:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].61, 88 off12336 00000004:00080000:1.0:1782759938.227783:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4006630960171ns, next at 4007630957483ns, rc = 0 00000004:00010000:1.0:1782759938.227916:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072986d9f reply state 00000000886f13e6 transno 4294968225 ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759938.227927:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759938.228022:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110886:x1869355197401984:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 847us (1017us total) trans 4294968225 rc 0/0 00000100:00100000:1.0:1782759938.228029:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2348 00010000:00010000:1.0:1782759938.234429:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.234446:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.234467:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.234474:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180031a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759938.234478:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.234486:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.234503:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171889c5200) 00010000:00010000:1.0:1782759938.234506:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782759938.234511:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.234518:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031a00/0xdd99f5c4777e1392 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759938.270790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759938.271032:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197402112 00000100:00100000:0.0:1782759938.271043:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197402112 00000100:00100000:0.0:1782759938.271105:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2349 00000100:00100000:0.0:1782759938.271115:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:110887:x1869355197402112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759938.271142:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759938.271181:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1399 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673f0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271250:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271264:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271274:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271306:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271314:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271321:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271716:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e13ae lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271725:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e13ae lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271733:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e13ae lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759938.271865:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782759938.271869:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759938.271954:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e13ae lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271966:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271972:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271980:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.271996:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759938.272000:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272008:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272021:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917182dd1300) 00010000:00010000:0.0:1782759938.272024:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759938.272029:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272035:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e13a0 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272047:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272053:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272059:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272064:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759938.272067:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272073:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272091:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917182dd1a00) 00010000:00010000:0.0:1782759938.272093:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759938.272095:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272101:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13a7 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272142:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e1399 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673f0 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272158:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e13ae lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673f0 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.272165:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:0.0:1782759938.272167:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759938.272169:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75800, rc 0) 00000100:00100000:0.0:1782759938.272246:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110887:x1869355197402112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1131us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759938.272255:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2349 00000100:00100000:1.0:1782759938.279175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759938.279984:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197402368 00000100:00100000:3.0:1782759938.279996:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197402368 00000100:00100000:3.0:1782759938.280063:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2350 00000100:00100000:3.0:1782759938.280075:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110887:x1869355197402368:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759938.280144:0:146757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759938.280179:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e13ae lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673f0 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.280198:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1d00) 00010000:00010000:3.0:1782759938.280219:0:146757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759938.280244:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.280257:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.280266:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759938.280688:0:146757:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aedbe14a reply state 00000000b6ab23da transno 4294968226 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759938.280700:0:146757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759938.280773:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000100:00100000:3.0:1782759938.280918:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110887:x1869355197402368:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 843us (1752us total) trans 4294968226 rc 0/0 00000100:00100000:3.0:1782759938.280937:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2350 00010000:00010000:3.0:1782759938.286443:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.286460:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.286468:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.286589:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759938.286596:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.286606:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.286627:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759938.286631:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759938.286636:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.286643:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13b5 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x3:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759938.286751:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759938.286858:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197402624 00000100:00100000:2.0:1782759938.286870:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197402624 00000100:00100000:2.0:1782759938.286920:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2351 00000100:00100000:2.0:1782759938.286930:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:110887:x1869355197402624:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759938.286952:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759938.286970:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e13bc lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673f7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287047:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287066:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287101:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287116:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287125:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287131:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759938.287597:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782759938.287759:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287768:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287775:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287782:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759938.287785:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287792:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287804:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782759938.287807:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759938.287819:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287867:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e13c3 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287881:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287887:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287893:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287898:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759938.287901:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287907:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287915:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917191f75800) 00010000:00010000:2.0:1782759938.287917:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759938.287920:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287925:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e13ca lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287967:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e13bc lrc: 1/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673f7 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.287989:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782759938.287992:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759938.287996:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e13bc lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673f7 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.288008:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90800, rc 0) 00000100:00100000:2.0:1782759938.288075:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110887:x1869355197402624:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1145us (1328us total) trans 4294968227 rc 301/301 00000100:00100000:2.0:1782759938.288083:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2351 00000100:00100000:0.0:1782759938.295652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759938.295756:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197402880 00000100:00100000:3.0:1782759938.295768:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197402880 00000100:00100000:3.0:1782759938.295871:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 411 00000100:00100000:3.0:1782759938.295883:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+8:110887:x1869355197402880:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759938.296503:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110887:x1869355197402880:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 619us (862us total) trans 4294968228 rc 0/0 00000100:00100000:3.0:1782759938.296518:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 411 00000100:00100000:1.0:1782759938.304102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759938.307107:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403008 00000100:00100000:0.0:1782759938.307126:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403008 00000100:00100000:0.0:1782759938.307209:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2352 00000100:00100000:0.0:1782759938.307221:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:110887:x1869355197403008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759938.307251:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759938.307277:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e13d8 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf673fe expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.307389:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13df lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.307406:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13df lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.307418:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13df lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759938.307628:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782759938.307633:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759938.307720:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13df lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.307749:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e13d8 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673fe expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.307768:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13df lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673fe expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.307778:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1300) 00010000:00010000:0.0:1782759938.307782:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759938.307787:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75600, rc 0) 00000100:00100000:0.0:1782759938.312491:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110887:x1869355197403008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5258us (8386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759938.312505:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2352 00000100:00100000:1.0:1782759938.322873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759938.323311:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403136 00000100:00100000:3.0:1782759938.323322:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403136 00000100:00100000:3.0:1782759938.323417:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 412 00000100:00100000:3.0:1782759938.323427:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110887:x1869355197403136:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:3.0:1782759938.332012:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110887:x1869355197403136:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 8573us (9189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759938.332027:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 412 00000100:00100000:2.0:1782759938.363694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759938.364040:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403264 00000100:00100000:3.0:1782759938.364052:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403264 00000100:00100000:3.0:1782759938.364146:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2353 00000100:00100000:3.0:1782759938.364156:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+10:110889:x1869355197403264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759938.364178:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759938.364201:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13e6 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67405 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364262:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364277:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364288:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364299:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364332:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364339:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364673:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 3/1,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364682:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364689:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759938.364724:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759938.364728:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759938.364747:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364758:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364766:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364772:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364779:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364794:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759938.364798:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364806:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364818:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759938.364859:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759938.364864:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364871:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e13ed lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364883:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364889:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364895:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364901:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759938.364903:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364909:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364926:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xd62b37d5 (ffff9171908a1600) 00010000:00010000:3.0:1782759938.364929:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759938.364931:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364938:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e13f4 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364985:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e13e6 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67405 expref: 12 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.364999:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67405 expref: 11 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.365006:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782759938.365009:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759938.365011:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759938.365072:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110889:x1869355197403264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 918us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759938.365080:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2353 00000100:00100000:1.0:1782759938.424959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759938.425159:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403392 00000100:00100000:2.0:1782759938.425171:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403392 00000100:00100000:2.0:1782759938.425235:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2354 00000100:00100000:2.0:1782759938.425245:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+11:110892:x1869355197403392:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759938.425266:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759938.425288:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1402 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6740c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425353:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425368:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425379:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425410:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425417:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425423:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425766:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1417 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425777:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1417 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.425785:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1417 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759938.425948:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782759938.425952:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759938.426031:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1417 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426042:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426047:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426054:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426069:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759938.426074:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426081:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426094:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782759938.426098:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759938.426103:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426110:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1409 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426124:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426129:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426136:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426141:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759938.426143:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426149:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426168:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x1:0x0].0xf111c33b (ffff917191f75800) 00010000:00010000:2.0:1782759938.426171:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759938.426173:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426179:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1410 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426209:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1402 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6740c expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426221:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1417 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6740c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.426229:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782759938.426231:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759938.426233:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759938.426308:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+12:110892:x1869355197403392:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1063us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759938.426316:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2354 00000100:00100000:1.0:1782759938.446675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759938.446798:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403520 00000100:00100000:0.0:1782759938.446812:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403520 00000100:00100000:0.0:1782759938.446959:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:0.0:1782759938.446970:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+12:2363:x1869355197403520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759938.446989:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759938.447020:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1417 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6740c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.447047:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1300) 00010000:00010000:0.0:1782759938.447053:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759938.447131:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+11:2363:x1869355197403520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 162us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759938.447139:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 195 00000100:00100000:0.0:1782759938.476230:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759938.476256:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212108416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759938.476331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759938.476525:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108416 00000100:00100000:2.0:1782759938.476535:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108416 00000100:00100000:2.0:1782759938.476591:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1782759938.476600:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212108416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759938.476640:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759938.476695:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212108416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759938.476720:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:2.0:1782759938.476773:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212108416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759939.052863:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759940.077202:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782759941.039701:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4009442875960ns, next at 4010442873390ns, rc = 0 00000100:00100000:2.0:1782759941.039727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759941.039750:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212108544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759941.039878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759941.040129:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108544 00000100:00100000:0.0:1782759941.040138:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108544 00000100:00100000:0.0:1782759941.040224:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1782759941.040245:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212108544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759941.040288:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759941.040346:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212108544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759941.040353:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00080000:2.0:1782759941.045252:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759941.045345:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212108544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759941.103395:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759942.124332:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759942.844595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759942.844633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759942.844736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759942.844782:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403776 00000100:00100000:1.0:1782759942.844791:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403776 00000100:00100000:1.0:1782759942.844897:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2893 00000100:00100000:1.0:1782759942.844914:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+11:2363:x1869355197403776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759942.844999:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+11:2363:x1869355197403776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759942.845007:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2893 00000100:00080000:1.0:1782759942.845034:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759942.845801:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403648 00000100:00100000:0.0:1782759942.845809:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403648 00000100:00100000:0.0:1782759942.845869:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3170 00000100:00100000:0.0:1782759942.845884:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197403648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759942.845930:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197403648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759942.845939:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3170 00000100:00100000:2.0:1782759942.848191:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197403904 00000100:00100000:2.0:1782759942.848204:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197403904 00000100:00100000:0.0:1782759942.848702:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2331 00000100:00100000:0.0:1782759942.848718:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197403904:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759942.848846:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197403904:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 131us (4212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759942.848855:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2331 00000100:00080000:1.0:1782759942.848989:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759943.084547:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212109056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.084621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.084680:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782759943.084686:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212108672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.084716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.084759:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212109184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.084784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.084811:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917089149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212108800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.084860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.084883:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212109312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.084911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.084937:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759943.084945:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212108928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.084971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.085010:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109056 00000100:00100000:0.0:1782759943.085033:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109056 00000100:00100000:0.0:1782759943.085089:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109312 00000100:00100000:0.0:1782759943.085093:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109312 00000100:00100000:0.0:1782759943.085123:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1782759943.085135:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212109056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.085215:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212109056:12345-0@lo:400:kworker.0 Request processed in 82us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759943.085223:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1782759943.085442:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1782759943.085451:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212109312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.085498:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212109312:12345-0@lo:400:kworker.0 Request processed in 48us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759943.085505:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1782759943.085531:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109184 00000100:00100000:0.0:1782759943.085535:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109184 00000100:00100000:0.0:1782759943.085566:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108800 00000100:00100000:0.0:1782759943.085570:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108800 00000100:00100000:0.0:1782759943.085593:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108928 00000100:00100000:0.0:1782759943.085596:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108928 00000100:00100000:0.0:1782759943.085623:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:0.0:1782759943.085631:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212109184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.085672:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212109184:12345-0@lo:400:kworker.0 Request processed in 43us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759943.085679:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:0.0:1782759943.085694:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:0.0:1782759943.085699:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212108800:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759943.085715:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759943.085722:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759943.085725:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759943.085744:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212108800:12345-0@lo:400:kworker.0 Request processed in 32us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759943.085752:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1782759943.085763:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212108928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.085766:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1782759943.085811:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212108928:12345-0@lo:400:kworker.0 Request processed in 51us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759943.085851:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:0.0:1782759943.085869:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212108928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.085884:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212108800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759943.085902:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212109312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759943.085905:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212109184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759943.085924:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212109056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759943.085963:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212108672 00000100:00100000:3.0:1782759943.085968:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212108672 00000100:00100000:3.0:1782759943.085999:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1782759943.086005:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212108672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759943.086041:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212108672:12345-0@lo:400:kworker.0 Request processed in 36us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759943.086048:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1782759943.086084:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917089149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212108672:0@lo:400:kworker.0 00000001:00080000:1.0:1782759943.143141:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968225 is committed 00000004:00080000:1.0:1782759943.143158:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 136 committed 00000004:00080000:1.0:1782759943.143186:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 137 committed 00000001:00080000:1.0:1782759943.143191:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968227 is committed 00000001:00080000:1.0:1782759943.143197:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968228 is committed 00000100:00100000:2.0:1782759943.143983:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759943.146513:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212109440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782759943.146601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759943.146707:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109440 00000100:00100000:3.0:1782759943.146716:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109440 00000100:00100000:3.0:1782759943.146776:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1782759943.146786:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212109440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782759943.147102:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759943.147105:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb mtime from disk: 1782759925 -> 1782759925 00002000:00010000:3.0:1782759943.147108:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb atime from disk: 1782759925 -> 1782759925 00002000:00010000:3.0:1782759943.147110:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb ctime from disk: 1782759925 -> 1782759925 00002000:00010000:3.0:1782759943.147113:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x38:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782759943.150278:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869355212109440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3483us (3667us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1782759943.150295:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00010000:00010000:0.0:1782759943.150634:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782759943.150645:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170839c1500/2, rc 0, transno 4294967450 00000100:00100000:2.0:1782759943.150653:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212109440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782759943.606223:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212109568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759943.606320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759943.606504:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109568 00000100:00100000:1.0:1782759943.606512:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109568 00000100:00100000:1.0:1782759943.606567:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1782759943.606577:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212109568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759943.606613:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759943.606662:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212109568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759943.606669:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1782759943.607699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212109568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759944.173157:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759944.693805:0:163451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2f0eb090 20000000:00000080:2.0:1782759944.693942:0:163451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082701400 uarg=0000000000000000 00010000:00010000:2.0:1782759944.694611:0:163451:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759944.694645:0:163451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x3:0x0].0x0 (ffff917182dd1300) 00010000:00010000:2.0:1782759944.694648:0:163451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759944.694659:0:163451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e13df lrc: 0/0,0 mode: --/PR res: [0x200000419:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf673fe expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759944.694692:0:163451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x2:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:2.0:1782759944.694696:0:163451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759944.694720:0:163451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e13fb lrc: 0/0,0 mode: --/PR res: [0x200000419:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67405 expref: 5 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759944.694736:0:163451:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 2 locks, left on hash table 0. 10000000:01000000:2.0:1782759944.694758:0:163451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759944.694771:0:163451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759944.694782:0:163451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759944.694790:0:163451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759944.694912:0:163451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759944.694926:0:163451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 18 pid: 5794 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759944.694942:0:163451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163451:1869355212109696:0@lo:104: 00000100:00100000:2.0:1782759944.695159:0:163451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759944.695255:0:163451:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759944.695369:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109696 00000100:00100000:1.0:1782759944.695376:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109696 00000100:00100000:1.0:1782759944.695455:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1782759944.695472:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163451:x1869355212109696:12345-0@lo:104: 00010000:00010000:1.0:1782759944.695484:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759944.695586:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759944.695593:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163451:x1869355212109696:12345-0@lo:104: Request processed in 123us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759944.695599:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1782759944.695658:0:163451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163451:1869355212109696:0@lo:104: 00010000:00010000:2.0:1782759944.695676:0:163451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.695794:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759944.695801:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.695808:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759944.695811:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.695819:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759944.696002:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759944.696008:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759944.696124:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696131:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759944.696150:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696157:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1368 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e136f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696169:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759944.696171:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759944.696173:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759944.696290:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212109824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759944.696330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759944.696412:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109824 00000100:00100000:3.0:1782759944.696424:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109824 00010000:00010000:3.0:1782759944.696444:0:134476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 19 pid: 5794 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759944.696536:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1782759944.696544:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212109824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759944.696555:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759944.696561:0:134476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 19 pid: 5794 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696572:0:134476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 19 pid: 5794 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696584:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90000/0xdd99f5c4777e136f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1368 expref: 19 pid: 5794 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696597:0:134476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696605:0:134476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696620:0:134476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696628:0:134476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696635:0:134476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696641:0:134476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696653:0:134476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759944.696657:0:134476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696664:0:134476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696678:0:134476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696688:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759944.696736:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355212109824:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759944.696743:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1782759944.696774:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212109824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759944.696809:0:163451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696817:0:163451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759944.696844:0:163451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e141e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759945.203983:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759945.217755:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967450 is committed 00000100:00100000:3.0:1782759946.156301:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759946.156331:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212109952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759946.156407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759946.156565:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212109952 00000100:00100000:0.0:1782759946.156574:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212109952 00000100:00100000:0.0:1782759946.156638:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1782759946.156647:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212109952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759946.156702:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759946.156770:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212109952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759946.156778:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00080000:3.0:1782759946.157376:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759946.157409:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967450 gen 2 00000004:00080000:3.0:1782759946.157416:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170839c1500, transno 4294967450 00000100:00100000:3.0:1782759946.157441:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212109952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759946.224543:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759946.609769:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759946.609777:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759946.609782:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759946.609859:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759946.609871:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759946.609899:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759946.609924:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212110080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759946.609994:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759946.610044:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759946.610110:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110080 00000100:00100000:2.0:1782759946.610118:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110080 00000100:00100000:2.0:1782759946.610181:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1782759946.610199:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212110080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759946.610215:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759946.610228:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1425 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759946.610253:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759946.610263:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759946.610271:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782759946.610318:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212110080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759946.610325:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1782759946.610385:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212110080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759946.610399:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759946.610409:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759946.610428:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759946.610433:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759946.610440:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759947.255153:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759947.957774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759947.957851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759947.957887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759947.957919:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404288 00000100:00100000:2.0:1782759947.957939:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404288 00000100:00100000:2.0:1782759947.958002:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2334 00000100:00100000:2.0:1782759947.958013:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197404288:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759947.958092:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197404288:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759947.958110:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2334 00000100:00100000:2.0:1782759947.958137:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404160 00000100:00100000:2.0:1782759947.958141:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404160 00000100:00100000:2.0:1782759947.958173:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2897 00000100:00100000:2.0:1782759947.958179:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197404160:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759947.958207:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197404160:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759947.958214:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2897 00000100:00080000:2.0:1782759947.958229:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759947.958233:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759947.958736:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404032 00000100:00100000:3.0:1782759947.958742:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404032 00000100:00100000:3.0:1782759947.958793:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3173 00000100:00100000:3.0:1782759947.958801:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197404032:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759947.958867:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197404032:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 66us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759947.958873:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3173 00000100:00100000:0.0:1782759948.204308:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212110208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204394:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759948.204445:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212110720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759948.204499:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759948.204504:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212110592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759948.204562:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212110336:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759948.204601:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212110848:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759948.204654:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759948.204660:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212110464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759948.204712:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110208 00000100:00100000:0.0:1782759948.204720:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110208 00000100:00100000:0.0:1782759948.204765:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:0.0:1782759948.204772:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212110208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.204870:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212110208:12345-0@lo:400:kworker.0 Request processed in 97us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759948.204879:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000100:00100000:0.0:1782759948.204925:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110720 00000100:00100000:0.0:1782759948.204929:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110720 00000100:00080000:3.0:1782759948.205797:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759948.206139:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110336 00000100:00100000:0.0:1782759948.206146:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110336 00000100:00100000:0.0:1782759948.206166:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110464 00000100:00100000:0.0:1782759948.206175:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110464 00000100:00100000:0.0:1782759948.206208:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:0.0:1782759948.206220:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.206291:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212110720:12345-0@lo:400:kworker.0 Request processed in 75us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759948.206298:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:0.0:1782759948.206320:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1782759948.206325:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212110336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.206360:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212110336:12345-0@lo:400:kworker.0 Request processed in 34us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759948.206366:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1782759948.206380:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:0.0:1782759948.206386:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212110464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.206411:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212110464:12345-0@lo:400:kworker.0 Request processed in 26us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759948.206417:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:0.0:1782759948.206438:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110592 00000100:00100000:0.0:1782759948.206441:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110592 00000100:00100000:0.0:1782759948.206463:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110848 00000100:00100000:0.0:1782759948.206473:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110848 00000100:00100000:0.0:1782759948.206494:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:0.0:1782759948.206499:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212110592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759948.208115:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:2.0:1782759948.208132:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212110848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759948.208340:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212110848:12345-0@lo:400:kworker.0 Request processed in 212us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759948.208349:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00080000:2.0:1782759948.208913:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759948.208920:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759948.208924:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759948.209086:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212110592:12345-0@lo:400:kworker.0 Request processed in 2583us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759948.209096:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:0.0:1782759948.209686:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212110464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.209702:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212110336:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.209712:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212110848:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.210884:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212110592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.210902:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212110208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759948.210913:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212110720:0@lo:400:kworker.0 00010000:00010000:2.0:1782759948.268079:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759948.718383:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212110976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759948.718453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759948.720073:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212110976 00000100:00100000:3.0:1782759948.720085:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212110976 00000100:00100000:3.0:1782759948.724930:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1782759948.725686:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212110976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759948.725731:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759948.725819:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212110976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (7366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759948.725853:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1782759948.726151:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212110976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759949.292456:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759949.765740:0:163699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf2387700 20000000:00000080:0.0:1782759949.765758:0:163699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bb937000 uarg=0000000000000000 00010000:00010000:0.0:1782759949.766375:0:163699:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759949.766389:0:163699:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759949.766405:0:163699:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759949.766732:0:163699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.766763:0:163699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.766772:0:163699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.766814:0:163699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.767313:0:163699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 18 pid: 5796 timeout: 4118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759949.767331:0:163699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163699:1869355212111104:0@lo:104: 00000100:00100000:0.0:1782759949.767395:0:163699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759949.767663:0:163699:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759949.767776:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111104 00000100:00100000:2.0:1782759949.767784:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111104 00000100:00100000:2.0:1782759949.767856:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1782759949.767866:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163699:x1869355212111104:12345-0@lo:104: 00010000:00010000:2.0:1782759949.767880:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768031:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759949.768038:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163699:x1869355212111104:12345-0@lo:104: Request processed in 174us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759949.768046:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00010000:00010000:2.0:1782759949.768067:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759949.768073:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768080:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:2.0:1782759949.768085:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768098:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759949.768106:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759949.768112:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759949.768164:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768170:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759949.768194:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768200:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75600/0xdd99f5c4777e1425 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e142c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768216:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759949.768217:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759949.768219:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759949.768230:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212111232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759949.768259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759949.768296:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111232 00000100:00100000:2.0:1782759949.768301:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111232 00010000:00010000:2.0:1782759949.768318:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 19 pid: 5796 timeout: 4118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759949.768356:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1782759949.768362:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212111232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759949.768373:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759949.768378:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 19 pid: 5796 timeout: 4118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768387:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 19 pid: 5796 timeout: 4118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768403:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768417:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768429:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768435:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768440:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768446:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768450:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759949.768454:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768460:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768467:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759949.768475:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759949.768504:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212111232:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759949.768510:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1782759949.768542:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212111232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759949.768775:0:163699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91a00/0xdd99f5c4777e142c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1425 expref: 18 pid: 5796 timeout: 4118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759949.768787:0:163699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163699:1869355212111104:0@lo:104: 00010000:00010000:3.0:1782759949.768803:0:163699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759949.768846:0:163699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759949.768853:0:163699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759949.768859:0:163699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75c00/0xdd99f5c4777e1433 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.318091:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759950.768372:0:163748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2b308960 20000000:00000080:2.0:1782759950.768390:0:163748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917082703400 uarg=0000000000000000 00010000:00010000:2.0:1782759950.768907:0:163748:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759950.768925:0:163748:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759950.768946:0:163748:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759950.768967:0:163748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.768983:0:163748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.768994:0:163748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769001:0:163748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769008:0:163748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769014:0:163748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769020:0:163748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759950.769025:0:163748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769033:0:163748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769057:0:163748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769065:0:163748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759950.769072:0:163748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e143a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759951.149241:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759951.149248:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759951.149252:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759951.149304:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759951.149316:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759951.149327:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759951.149352:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212111360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759951.149424:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759951.149474:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759951.149949:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111360 00000100:00100000:2.0:1782759951.149957:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111360 00000100:00100000:2.0:1782759951.150005:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:2.0:1782759951.150015:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212111360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759951.150030:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759951.150043:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1441 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759951.150069:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759951.150080:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759951.150090:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91e00, rc 0) 00000100:00100000:2.0:1782759951.150156:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212111360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759951.150163:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00100000:0.0:1782759951.150679:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212111360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759951.150697:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.150706:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759951.150727:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759951.150732:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.150740:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759951.276441:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759951.276466:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212111488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759951.276553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759951.276744:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111488 00000100:00100000:2.0:1782759951.276772:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111488 00000100:00100000:2.0:1782759951.276865:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1782759951.276899:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212111488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759951.276941:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759951.276992:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212111488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759951.277000:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00080000:1.0:1782759951.279538:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759951.279621:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212111488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759951.342049:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759951.904110:0:163796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc3d98a80 20000000:00000080:1.0:1782759951.904128:0:163796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084d15800 uarg=0000000000000000 00010000:00010000:1.0:1782759951.904574:0:163796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759951.904592:0:163796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759951.904610:0:163796:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759951.904630:0:163796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759951.904652:0:163796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759951.904663:0:163796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759951.904710:0:163796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759951.904727:0:163796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 18 pid: 5796 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759951.904763:0:163796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163796:1869355212111616:0@lo:104: 00000100:00100000:1.0:1782759951.905274:0:163796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759951.905741:0:163796:0:(client.c:2701:ptlrpc_set_wait()) set ffff917084d5aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759951.908248:0:139369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759951.908278:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111616 00000100:00100000:1.0:1782759951.908339:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111616 00000100:00100000:1.0:1782759951.909143:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1782759951.909162:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917089299450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163796:x1869355212111616:12345-0@lo:104: 00010000:00010000:1.0:1782759951.909181:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759951.909420:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759951.909427:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917089299450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:163796:x1869355212111616:12345-0@lo:104: Request processed in 272us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759951.909435:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00010000:00010000:0.0:1782759951.909528:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759951.909536:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.909544:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759951.909548:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.909556:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759951.909573:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759951.909579:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759951.909622:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.909629:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759951.909650:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.909657:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcde00/0xdd99f5c4777e1441 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1448 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.909675:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759951.909677:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759951.909679:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759951.909707:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212111744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759951.909746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759951.909805:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111744 00000100:00100000:0.0:1782759951.909811:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111744 00010000:00010000:0.0:1782759951.909860:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 19 pid: 5796 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759951.909902:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1782759951.910095:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212111744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759951.910108:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759951.910114:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 19 pid: 5796 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910125:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 19 pid: 5796 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910142:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910150:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910165:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910172:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910178:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910194:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910200:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759951.910204:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910212:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910220:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759951.910231:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759951.910259:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212111744:12345-0@lo:103:ldlm_bl.0 Request processed in 351us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759951.910266:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1782759951.910376:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171bbe30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212111744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759951.910748:0:163796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1448 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1441 expref: 18 pid: 5796 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759951.910759:0:163796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163796:1869355212111616:0@lo:104: 00010000:00010000:3.0:1782759951.910774:0:163796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759951.910789:0:163796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759951.910794:0:163796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759951.910800:0:163796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e144f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759952.365769:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759953.078640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759953.078678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759953.078710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759953.078739:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404672 00000100:00100000:2.0:1782759953.078749:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404672 00000100:00100000:2.0:1782759953.078814:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2337 00000100:00100000:2.0:1782759953.078842:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197404672:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759953.078926:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197404672:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759953.078933:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2337 00000100:00100000:2.0:1782759953.078955:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404544 00000100:00100000:2.0:1782759953.078959:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404544 00000100:00100000:2.0:1782759953.078987:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2901 00000100:00100000:2.0:1782759953.078994:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197404544:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759953.079023:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197404544:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759953.079029:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2901 00000100:00080000:2.0:1782759953.079044:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759953.079048:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759953.079908:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404416 00000100:00100000:0.0:1782759953.079915:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404416 00000100:00100000:0.0:1782759953.079954:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3176 00000100:00100000:0.0:1782759953.079962:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197404416:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759953.080004:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197404416:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759953.080010:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3176 10000000:01000000:1.0:1782759953.138403:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759953.138413:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759953.138418:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759953.138475:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.138487:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.138498:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759953.138525:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212111872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759953.138623:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759953.138703:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759953.142178:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212111872 00000100:00100000:3.0:1782759953.142194:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212111872 00000100:00100000:3.0:1782759953.142261:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:3.0:1782759953.142273:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212111872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759953.142292:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759953.142317:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1456 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.142346:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.142358:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.142368:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759953.142447:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212111872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759953.142454:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:3.0:1782759953.142521:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212111872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759953.142550:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.142560:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759953.142583:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759953.142588:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.142594:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759953.324778:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212112384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759953.324789:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212112128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759953.325091:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212112000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759953.335335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759953.335428:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212112256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759953.335468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759953.335727:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112256 00000100:00100000:0.0:1782759953.335737:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112256 00000100:00100000:0.0:1782759953.335797:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:0.0:1782759953.335808:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212112256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759953.336008:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112384 00000100:00100000:3.0:1782759953.336013:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112384 00000100:00100000:3.0:1782759953.336049:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1782759953.336056:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212112384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759953.336107:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212112384:12345-0@lo:400:kworker.0 Request processed in 51us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759953.336114:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:0.0:1782759953.336321:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212112256:12345-0@lo:400:kworker.0 Request processed in 515us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759953.336327:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00080000:0.0:1782759953.336357:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759953.336361:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759953.336390:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212112384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759953.348788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759953.349121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759953.349161:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212112512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759953.349200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759953.349224:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112512 00000100:00100000:2.0:1782759953.349232:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112512 00000100:00100000:2.0:1782759953.349287:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:2.0:1782759953.349295:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212112512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759953.349348:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212112512:12345-0@lo:400:kworker.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759953.349355:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:2.0:1782759953.349399:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212112512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759953.349452:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112128 00000100:00100000:1.0:1782759953.349458:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112128 00000100:00100000:1.0:1782759953.349489:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112000 00000100:00100000:1.0:1782759953.349492:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112000 00000100:00100000:1.0:1782759953.349514:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:1.0:1782759953.349521:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212112128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759953.349642:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212112128:12345-0@lo:400:kworker.0 Request processed in 120us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759953.349649:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:1.0:1782759953.349669:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00080000:0.0:1782759953.349674:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759953.349676:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212112000:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759953.349682:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759953.349717:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212112000:12345-0@lo:400:kworker.0 Request processed in 42us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759953.349723:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1782759953.363149:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212112256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759953.371569:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212112128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759953.371655:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212112000:0@lo:400:kworker.0 00010000:00010000:3.0:1782759953.389091:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759953.848427:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212112640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759953.848516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759953.848699:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112640 00000100:00100000:3.0:1782759953.848708:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112640 00000100:00100000:3.0:1782759953.848758:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1782759953.848767:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212112640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759953.848806:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759953.848889:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212112640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759953.848896:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1782759953.849589:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212112640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759954.422303:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759955.436081:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759956.397357:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212112768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759956.397437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759956.397533:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112768 00000100:00100000:0.0:1782759956.397540:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112768 00000100:00100000:0.0:1782759956.398169:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1782759956.398194:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212112768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759956.398253:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782759956.398314:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212112768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (876us total) trans 0 rc 0/0 00000100:00080000:1.0:1782759956.398744:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759956.399088:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212112768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759956.402912:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00010000:00010000:3.0:1782759956.461674:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759957.488620:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759957.832194:0:163993:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64k: Nodemap enforces foreign_ops RBAC roles ========================================================== 15:05:54 (1782759954) 00000100:00100000:0.0:1782759958.197703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759958.201793:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404800 00000100:00100000:3.0:1782759958.201811:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404800 00000100:00100000:3.0:1782759958.201916:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3178 00000100:00100000:3.0:1782759958.201928:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197404800:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759958.202017:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197404800:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 91us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759958.202025:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3178 00000100:00100000:3.0:1782759958.202957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759958.202999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759958.203028:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405056 00000100:00100000:3.0:1782759958.203033:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405056 00000100:00100000:3.0:1782759958.203091:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2340 00000100:00100000:3.0:1782759958.203100:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197405056:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759958.203247:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197404928 00000100:00100000:0.0:1782759958.203253:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197404928 00000100:00100000:0.0:1782759958.203287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2905 00000100:00100000:0.0:1782759958.203295:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197404928:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759958.203338:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197404928:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759958.203346:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2905 00000100:00100000:3.0:1782759958.203716:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197405056:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 616us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759958.203725:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2340 00000100:00080000:3.0:1782759958.203745:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759958.204132:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759958.447229:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212113152:0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.447305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759958.447355:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759958.447362:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212113280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.447415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759958.447455:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113152 00000100:00100000:2.0:1782759958.447462:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113152 00000100:00100000:2.0:1782759958.447512:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:2.0:1782759958.447521:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212113152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.447574:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212113152:12345-0@lo:400:kworker.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759958.447582:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:2.0:1782759958.447625:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212113152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.447707:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212112896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.447760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759958.447793:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212113408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.447849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759958.447866:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759958.447872:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212113024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.447893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759958.447908:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212113536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.447948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782759958.447974:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759958.447985:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113408 00000100:00100000:3.0:1782759958.447989:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113408 00000100:00100000:3.0:1782759958.448017:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113024 00000100:00100000:3.0:1782759958.448019:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113024 00000100:00100000:3.0:1782759958.448038:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1782759958.448043:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212113408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.448080:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212113408:12345-0@lo:400:kworker.0 Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759958.448086:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1782759958.448100:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1782759958.448105:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212113024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.448131:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212113024:12345-0@lo:400:kworker.0 Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759958.448136:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00080000:3.0:1782759958.448152:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759958.448168:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212113024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759958.448179:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212113408:0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.448377:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212112896 00000100:00100000:2.0:1782759958.448381:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212112896 00000100:00100000:2.0:1782759958.448414:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:2.0:1782759958.448421:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212112896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.448469:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212112896:12345-0@lo:400:kworker.0 Request processed in 48us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759958.448474:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:2.0:1782759958.448521:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113280 00000100:00100000:2.0:1782759958.448524:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113280 00000100:00100000:2.0:1782759958.448554:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113536 00000100:00100000:2.0:1782759958.448557:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113536 00000100:00100000:2.0:1782759958.448575:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:2.0:1782759958.448581:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.448615:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212113280:12345-0@lo:400:kworker.0 Request processed in 35us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759958.448621:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00000100:00100000:2.0:1782759958.448632:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:2.0:1782759958.448638:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212113536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.448663:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212113536:12345-0@lo:400:kworker.0 Request processed in 25us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759958.448668:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00080000:2.0:1782759958.448688:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759958.448691:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759958.448706:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212113280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.448729:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212113536:0@lo:400:kworker.0 00000100:00100000:2.0:1782759958.448750:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212112896:0@lo:400:kworker.0 00010000:00010000:3.0:1782759958.515513:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759958.956272:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212113664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759958.956356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759958.956457:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113664 00000100:00100000:0.0:1782759958.956466:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113664 00000100:00100000:0.0:1782759958.956519:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1782759958.956527:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212113664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759958.956574:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782759958.960081:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212113664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3422us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759958.960102:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1782759958.963246:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212113664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759959.533177:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759960.556294:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759961.516712:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759961.516736:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212113792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759961.516819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759961.516921:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113792 00000100:00100000:2.0:1782759961.516929:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113792 00000100:00100000:2.0:1782759961.516980:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1782759961.516989:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212113792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759961.517037:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759961.517083:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212113792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759961.517090:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00080000:2.0:1782759961.517111:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759961.517148:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212113792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759961.580931:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759962.604050:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759963.318921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759963.318979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759963.319009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759963.319060:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405440 00000100:00100000:3.0:1782759963.319070:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405440 00000100:00100000:3.0:1782759963.319134:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2343 00000100:00100000:3.0:1782759963.319144:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197405440:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759963.319218:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197405440:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759963.319226:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2343 00000100:00080000:3.0:1782759963.319248:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759963.319275:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405312 00000100:00100000:3.0:1782759963.319279:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405312 00000100:00100000:3.0:1782759963.319311:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2909 00000100:00100000:3.0:1782759963.319317:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197405312:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759963.319358:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2362:x1869355197405312:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 40us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759963.319364:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2909 00000100:00080000:3.0:1782759963.319383:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759963.322076:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405184 00000100:00100000:0.0:1782759963.322092:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405184 00000100:00100000:0.0:1782759963.322152:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3180 00000100:00100000:0.0:1782759963.322162:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197405184:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759963.322232:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197405184:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759963.322239:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3180 00000100:00100000:3.0:1782759963.565738:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212113920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759963.565870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759963.565928:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212114432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759963.565958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759963.565986:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759963.565993:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212114048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759963.566032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759963.566052:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212114560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759963.566082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759963.566280:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114432 00000100:00100000:0.0:1782759963.566289:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114432 00000100:00100000:0.0:1782759963.566442:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114048 00000100:00100000:0.0:1782759963.566446:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114048 00000100:00100000:0.0:1782759963.566468:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:0.0:1782759963.566476:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212114432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759963.566555:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212114432:12345-0@lo:400:kworker.0 Request processed in 79us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759963.566563:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:0.0:1782759963.566591:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:0.0:1782759963.566597:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212114048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759963.566626:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212114048:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759963.566632:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:0.0:1782759963.566653:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212113920 00000100:00100000:0.0:1782759963.566657:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212113920 00000100:00100000:0.0:1782759963.566683:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:0.0:1782759963.566689:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212113920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759963.566719:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212113920:12345-0@lo:400:kworker.0 Request processed in 30us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759963.566725:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00100000:0.0:1782759963.566759:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212114304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759963.566786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759963.566808:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759963.566814:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212114176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759963.566862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759963.566893:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114176 00000100:00100000:0.0:1782759963.566907:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114176 00000100:00100000:0.0:1782759963.566935:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1782759963.566941:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212114176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759963.566978:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212114176:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759963.566984:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1782759963.567030:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212114176:0@lo:400:kworker.0 00000100:00080000:0.0:1782759963.567073:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759963.567087:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114560 00000100:00100000:0.0:1782759963.567090:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114560 00000100:00100000:2.0:1782759963.567748:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114304 00000100:00100000:2.0:1782759963.567755:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114304 00000100:00100000:2.0:1782759963.567788:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:2.0:1782759963.567798:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212114560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759963.567961:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212114560:12345-0@lo:400:kworker.0 Request processed in 164us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759963.567968:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:2.0:1782759963.567985:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:2.0:1782759963.567992:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212114304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759963.568040:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212114304:12345-0@lo:400:kworker.0 Request processed in 48us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759963.568046:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000100:00100000:2.0:1782759963.568078:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212114304:0@lo:400:kworker.0 00000100:00080000:1.0:1782759963.569094:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759963.569110:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759963.569814:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212114048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759963.569856:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212114560:0@lo:400:kworker.0 00000100:00100000:1.0:1782759963.569867:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212113920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759963.569879:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212114432:0@lo:400:kworker.0 00010000:00010000:2.0:1782759963.628993:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759964.018654:0:164286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe666f6c20 20000000:00000080:2.0:1782759964.018671:0:164286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbf5b800 uarg=0000000000000000 10000000:01000000:2.0:1782759964.019150:0:164286:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759964.019171:0:164286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.019188:0:164286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.019197:0:164286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.019234:0:164286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.019248:0:164286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 18 pid: 5796 timeout: 4132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759964.019262:0:164286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164286:1869355212114688:0@lo:104: 00000100:00100000:2.0:1782759964.019339:0:164286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759964.019394:0:164286:0:(client.c:2701:ptlrpc_set_wait()) set ffff91719097c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759964.020273:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114688 00000100:00100000:0.0:1782759964.020282:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114688 00000100:00100000:0.0:1782759964.020347:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1782759964.020357:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164286:x1869355212114688:12345-0@lo:104: 00010000:00010000:0.0:1782759964.020372:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020450:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759964.020456:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164286:x1869355212114688:12345-0@lo:104: Request processed in 102us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759964.020464:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00010000:00010000:0.0:1782759964.020496:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759964.020502:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020510:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759964.020514:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020539:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759964.020547:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759964.020554:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759964.020585:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020592:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759964.020611:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020619:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e1456 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e145d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020638:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759964.020641:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759964.020642:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759964.020662:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212114816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759964.020694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759964.020739:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114816 00000100:00100000:0.0:1782759964.020743:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114816 00010000:00010000:0.0:1782759964.020760:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 19 pid: 5796 timeout: 4132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759964.020782:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1782759964.020789:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212114816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759964.020806:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759964.020812:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 19 pid: 5796 timeout: 4132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020846:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 19 pid: 5796 timeout: 4132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020865:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020873:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020885:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020892:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020899:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020905:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020911:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759964.020915:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020921:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020939:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759964.020950:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759964.020979:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212114816:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759964.020986:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1782759964.021025:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212114816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759964.021538:0:164286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e145d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1456 expref: 18 pid: 5796 timeout: 4132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759964.021551:0:164286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164286:1869355212114688:0@lo:104: 00010000:00010000:3.0:1782759964.021567:0:164286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.021577:0:164286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.021584:0:164286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.021590:0:164286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91e00/0xdd99f5c4777e1464 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759964.084361:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212114944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759964.084436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759964.084516:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212114944 00000100:00100000:3.0:1782759964.084525:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212114944 00000100:00100000:3.0:1782759964.084566:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1782759964.084575:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212114944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759964.084613:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759964.084655:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212114944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759964.084674:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1782759964.084721:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212114944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759964.653706:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759964.916497:0:164334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeffcf3450 20000000:00000080:3.0:1782759964.916520:0:164334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928e000 uarg=0000000000000000 10000000:01000000:3.0:1782759964.918010:0:164334:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759964.918040:0:164334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918060:0:164334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918072:0:164334:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918080:0:164334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918086:0:164334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918093:0:164334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918100:0:164334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759964.918104:0:164334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918112:0:164334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918143:0:164334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918152:0:164334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759964.918158:0:164334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e146b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759965.299407:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759965.299416:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759965.299438:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759965.299485:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759965.299498:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759965.299511:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759965.299542:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212115072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759965.299656:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759965.299888:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d62e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759965.300034:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115072 00000100:00100000:3.0:1782759965.300042:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115072 00000100:00100000:3.0:1782759965.300097:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182 00000100:00100000:3.0:1782759965.300108:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212115072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759965.300126:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759965.300142:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1472 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759965.300166:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759965.300176:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759965.300185:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759965.300238:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212115072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.300245:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182 00000100:00100000:2.0:1782759965.300364:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212115072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759965.300380:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759965.300389:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759965.300409:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759965.300414:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759965.300420:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759965.680408:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759966.641621:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759966.641672:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212115200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759966.641754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759966.641845:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115200 00000100:00100000:3.0:1782759966.641853:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115200 00000100:00100000:3.0:1782759966.641912:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1782759966.641922:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212115200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759966.641959:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759966.642002:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212115200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759966.642009:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1782759966.642061:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170839c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212115200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759966.643440:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759966.702959:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759967.740315:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759967.852873:0:164481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeac8aa180 20000000:00000080:3.0:1782759967.852890:0:164481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928d400 uarg=0000000000000000 10000000:01000000:3.0:1782759967.853422:0:164481:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759967.853444:0:164481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759967.853463:0:164481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759967.853471:0:164481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759967.853508:0:164481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759967.853520:0:164481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 18 pid: 5793 timeout: 4136 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759967.853547:0:164481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164481:1869355212115328:0@lo:104: 00000100:00100000:3.0:1782759967.854301:0:164481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759967.854467:0:164481:0:(client.c:2701:ptlrpc_set_wait()) set ffff9170833dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759967.859396:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115328 00000100:00100000:2.0:1782759967.859425:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115328 00000100:00100000:2.0:1782759967.859476:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1782759967.859485:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164481:x1869355212115328:12345-0@lo:104: 00010000:00010000:2.0:1782759967.859504:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759967.859733:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759967.859740:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164481:x1869355212115328:12345-0@lo:104: Request processed in 256us (5442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759967.859748:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00010000:00010000:0.0:1782759967.859770:0:7496:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759967.859776:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759967.859784:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759967.859789:0:7496:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759967.859799:0:7496:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759967.859806:0:7496:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759967.859812:0:7496:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759967.859880:0:7496:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759967.859887:0:7496:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759967.859923:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759967.859930:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b91400/0xdd99f5c4777e1472 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1479 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759967.859949:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759967.859951:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759967.860099:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212115456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759967.860148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759967.860177:0:164481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164481:1869355212115328:0@lo:104: 00000100:00100000:1.0:1782759967.860201:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115456 00000100:00100000:1.0:1782759967.860205:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115456 00010000:00010000:3.0:1782759967.860211:0:164481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860223:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 19 pid: 5793 timeout: 4136 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759967.860264:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1782759967.860270:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212115456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759967.860281:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759967.860287:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 19 pid: 5793 timeout: 4136 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860297:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 19 pid: 5793 timeout: 4136 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860312:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e1479 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1472 expref: 19 pid: 5793 timeout: 4136 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860326:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860345:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759967.860359:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759967.860365:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860371:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860379:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860386:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860391:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759967.860395:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860402:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759967.860459:0:164481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860459:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759967.860467:0:164481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 2/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759967.860470:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759967.860473:0:164481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1480 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759967.860508:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355212115456:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759967.860515:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1782759967.860743:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212115456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759968.436993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759968.437113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759968.437156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759968.437169:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405568 00000100:00100000:3.0:1782759968.437185:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405824 00000100:00100000:1.0:1782759968.437187:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405568 00000100:00100000:3.0:1782759968.437191:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405824 00000100:00100000:1.0:1782759968.437254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3183 00000100:00100000:3.0:1782759968.437261:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2346 00000100:00100000:1.0:1782759968.437267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197405568:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759968.437274:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197405824:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759968.437349:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197405824:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759968.437357:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2346 00000100:00080000:3.0:1782759968.437383:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759968.438028:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405696 00000100:00100000:2.0:1782759968.438036:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405696 00000100:00080000:0.0:1782759968.438088:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759968.438094:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2913 00000100:00100000:2.0:1782759968.438103:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197405696:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759968.442526:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197405568:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 5248us (5399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.442541:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3183 00000100:00100000:2.0:1782759968.442658:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197405696:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 4552us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759968.442669:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2913 00000020:00000080:3.0:1782759968.602195:0:164529:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdcaaed780 20000000:00000080:3.0:1782759968.602211:0:164529:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff91708928e000 uarg=0000000000000000 10000000:01000000:3.0:1782759968.602512:0:164529:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759968.602534:0:164529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602552:0:164529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602632:0:164529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602640:0:164529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602647:0:164529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602654:0:164529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602660:0:164529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759968.602664:0:164529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602671:0:164529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602684:0:164529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602692:0:164529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759968.602707:0:164529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e1487 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759968.684128:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212115712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759968.684258:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212116224:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759968.684314:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782759968.684320:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212115584:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759968.684370:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212116096:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684391:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759968.684417:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212115840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759968.684460:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759968.684465:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212115968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759968.684516:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115712 00000100:00100000:1.0:1782759968.684524:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115712 00000100:00100000:1.0:1782759968.684647:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116096 00000100:00100000:1.0:1782759968.684651:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116096 00000100:00100000:1.0:1782759968.684858:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115840 00000100:00100000:1.0:1782759968.684862:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115840 00000100:00100000:1.0:1782759968.684900:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:1.0:1782759968.684909:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212115712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.684967:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212115712:12345-0@lo:400:kworker.0 Request processed in 59us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.684973:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:1.0:1782759968.684997:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1782759968.685003:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212116096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.685030:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212116096:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.685036:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1782759968.685047:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:1.0:1782759968.685052:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212115840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.685082:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212115840:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.685088:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:1.0:1782759968.685108:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116224 00000100:00100000:1.0:1782759968.685111:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116224 00000100:00100000:1.0:1782759968.685138:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115968 00000100:00100000:1.0:1782759968.685141:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115968 00000100:00100000:1.0:1782759968.685161:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:1.0:1782759968.685168:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.685199:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212116224:12345-0@lo:400:kworker.0 Request processed in 31us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.685205:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:1.0:1782759968.685216:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:1.0:1782759968.685222:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212115968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.685282:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212115968:12345-0@lo:400:kworker.0 Request processed in 60us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.685289:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00100000:1.0:1782759968.685312:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212115584 00000100:00100000:1.0:1782759968.685316:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212115584 00000100:00100000:1.0:1782759968.685341:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1782759968.685347:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212115584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.685377:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3308:x1869355212115584:12345-0@lo:400:kworker.0 Request processed in 31us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759968.685384:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00080000:1.0:1782759968.685426:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759968.685430:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759968.685433:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759968.690175:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212115968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.690193:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212115840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.690244:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212115584:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.690260:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212116096:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.690273:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212115712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759968.690284:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212116224:0@lo:400:kworker.0 00010000:00010000:2.0:1782759968.748109:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759969.010035:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759969.010046:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:0.0:1782759969.010052:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759969.010471:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.010484:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.010495:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759969.010521:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212116352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759969.010733:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759969.010883:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082901a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759969.011074:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116352 00000100:00100000:1.0:1782759969.011083:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116352 00000100:00100000:1.0:1782759969.011168:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:1.0:1782759969.011178:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212116352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759969.011193:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759969.011221:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e148e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.011256:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.011268:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.011277:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030c00, rc 0) 00000100:00100000:1.0:1782759969.011324:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212116352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759969.011332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:2.0:1782759969.011415:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212116352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759969.011433:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.011441:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759969.011461:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759969.011466:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.011480:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759969.197168:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759969.197194:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212116480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759969.197281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759969.197574:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116480 00000100:00100000:3.0:1782759969.197582:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116480 00000100:00100000:3.0:1782759969.197636:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1782759969.197647:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212116480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759969.197683:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759969.197742:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212116480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759969.197749:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1782759969.197882:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212116480:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759969.542159:0:164578:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7a092fd0 20000000:00000080:2.0:1782759969.542177:0:164578:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171bbf5a800 uarg=0000000000000000 10000000:01000000:2.0:1782759969.542663:0:164578:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759969.542696:0:164578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.542714:0:164578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.542721:0:164578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.542759:0:164578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.542774:0:164578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 18 pid: 5796 timeout: 4137 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759969.542789:0:164578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164578:1869355212116608:0@lo:104: 00000100:00100000:2.0:1782759969.542874:0:164578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759969.542926:0:164578:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171813773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759969.542929:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116608 00000100:00100000:3.0:1782759969.542936:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116608 00000100:00100000:3.0:1782759969.543109:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1782759969.543120:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164578:x1869355212116608:12345-0@lo:104: 00010000:00010000:3.0:1782759969.543132:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.543198:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759969.543204:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164578:x1869355212116608:12345-0@lo:104: Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759969.543211:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00010000:00010000:1.0:1782759969.543266:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759969.543273:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759969.543274:0:164578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164578:1869355212116608:0@lo:104: 00010000:00010000:1.0:1782759969.543287:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759969.543292:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.543298:0:164578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.543301:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759969.543314:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759969.543329:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759969.543366:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.543373:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759969.543401:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.543408:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7d75c00/0xdd99f5c4777e148e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1495 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759969.543411:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212116736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759969.543423:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759969.543425:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759969.543426:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759969.543443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759969.543501:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116736 00000100:00100000:0.0:1782759969.543507:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116736 00010000:00010000:0.0:1782759969.543527:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 19 pid: 5796 timeout: 4137 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759969.543558:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1782759969.543565:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212116736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759969.543577:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759969.543581:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 19 pid: 5796 timeout: 4137 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.543591:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 19 pid: 5796 timeout: 4137 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544085:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e1495 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e148e expref: 19 pid: 5796 timeout: 4137 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544101:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544110:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544124:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544130:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544138:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544153:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544159:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759969.544163:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544172:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544196:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.544207:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759969.544251:0:164578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.544272:0:164578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.544279:0:164578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91400/0xdd99f5c4777e149c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759969.544689:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355212116736:12345-0@lo:103:ldlm_bl.0 Request processed in 1123us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759969.544697:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1782759969.545504:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212116736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759969.780990:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759970.412098:0:164626:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcff7165d0 20000000:00000080:1.0:1782759970.412116:0:164626:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084e21000 uarg=0000000000000000 10000000:01000000:1.0:1782759970.412344:0:164626:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759970.412366:0:164626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412383:0:164626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412395:0:164626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412403:0:164626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412420:0:164626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412428:0:164626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412434:0:164626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030c00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759970.412439:0:164626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412446:0:164626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412460:0:164626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412469:0:164626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.412475:0:164626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030c00/0xdd99f5c4777e14a3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759970.797017:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759970.797026:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:3.0:1782759970.797030:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759970.797073:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.797096:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.797106:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759970.797133:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212116864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759970.797236:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.797290:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b7d623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759970.797879:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116864 00000100:00100000:1.0:1782759970.797888:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116864 00000100:00100000:1.0:1782759970.797942:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:1.0:1782759970.797952:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212116864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759970.797966:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759970.797981:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e14aa expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.798033:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.798043:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.798053:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031400, rc 0) 00000100:00100000:1.0:1782759970.798127:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212116864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759970.798135:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:1.0:1782759970.798204:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212116864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759970.798221:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.798230:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759970.798250:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759970.798255:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.798262:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.801077:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759971.267282:0:164675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff25d61a40 20000000:00000080:3.0:1782759971.267301:0:164675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b3228400 uarg=0000000000000000 00010000:00010000:3.0:1782759971.268734:0:164675:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759971.268751:0:164675:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759971.268765:0:164675:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759971.268784:0:164675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.268802:0:164675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.268811:0:164675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.269016:0:164675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.269032:0:164675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 18 pid: 5793 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759971.269067:0:164675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164675:1869355212116992:0@lo:104: 00000100:00100000:3.0:1782759971.269130:0:164675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759971.269249:0:164675:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708183d600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759971.272999:0:73865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212116992 00000100:00100000:1.0:1782759971.273017:0:73865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212116992 00000100:00100000:0.0:1782759971.273208:0:73865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1782759971.273220:0:73865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164675:x1869355212116992:12345-0@lo:104: 00010000:00010000:0.0:1782759971.273239:0:73865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759971.273348:0:73865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759971.273356:0:73865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164675:x1869355212116992:12345-0@lo:104: Request processed in 138us (4225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759971.273364:0:73865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00010000:00010000:1.0:1782759971.273428:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759971.273448:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273456:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759971.273460:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273470:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759971.273477:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759971.273483:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759971.273535:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273542:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759971.273564:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273571:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171b7dcc600/0xdd99f5c4777e14aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14b1 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273590:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759971.273592:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759971.273594:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759971.273613:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212117120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759971.273649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759971.273692:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117120 00000100:00100000:1.0:1782759971.273701:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117120 00010000:00010000:1.0:1782759971.273720:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 19 pid: 5793 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759971.273742:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1782759971.273748:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212117120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759971.273771:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759971.273778:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 19 pid: 5793 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273789:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 19 pid: 5793 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273806:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.273814:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.276132:0:164675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031400/0xdd99f5c4777e14b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e14aa expref: 19 pid: 5793 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759971.276153:0:164675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164675:1869355212116992:0@lo:104: 00010000:00010000:3.0:1782759971.278771:0:164675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.279001:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.279010:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.279018:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.279026:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.279033:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759971.279054:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.279063:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.284714:0:164675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759971.284733:0:164675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.287656:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.287676:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcdc00/0xdd99f5c4777e14b8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759971.287700:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759971.288033:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212117120:12345-0@lo:103:ldlm_bl.0 Request processed in 14279us (14378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759971.288053:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1782759971.289335:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212117120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759971.756025:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759971.756059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212117248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759971.756131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759971.756330:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117248 00000100:00100000:3.0:1782759971.756339:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117248 00000100:00100000:3.0:1782759971.756404:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1782759971.756424:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212117248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759971.756462:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759971.756524:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212117248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759971.756542:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1782759971.756732:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212117248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759971.756791:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759971.822199:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759972.463918:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759972.463928:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759972.463933:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759972.463980:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759972.463994:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759972.464006:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759972.464035:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212117376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759972.464103:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759972.464155:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171aa023e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759972.464201:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117376 00000100:00100000:0.0:1782759972.464210:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117376 00000100:00100000:0.0:1782759972.464270:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:0.0:1782759972.464279:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212117376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759972.464294:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759972.464308:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e14bf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759972.464331:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759972.464341:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759972.464351:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75200, rc 0) 00000100:00100000:0.0:1782759972.464407:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212117376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759972.464414:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00100000:2.0:1782759972.466116:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212117376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759972.466151:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759972.466173:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759972.466197:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759972.466203:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759972.466211:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759972.843990:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759973.556005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759973.556051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759973.556154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759973.556540:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197405952 00000100:00100000:1.0:1782759973.556558:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197405952 00000100:00100000:1.0:1782759973.556612:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3188 00000100:00100000:1.0:1782759973.556623:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197405952:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759973.556697:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197405952:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 75us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.556704:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3188 00000100:00100000:1.0:1782759973.556748:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406080 00000100:00100000:1.0:1782759973.556753:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406080 00000100:00100000:1.0:1782759973.556797:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2917 00000100:00100000:1.0:1782759973.556805:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197406080:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759973.556860:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197406080:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 56us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.556867:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2917 00000100:00100000:0.0:1782759973.558726:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406208 00000100:00100000:0.0:1782759973.558738:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406208 00000100:00100000:0.0:1782759973.558806:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2349 00000100:00100000:0.0:1782759973.558817:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197406208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759973.558894:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197406208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.558902:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2349 00000100:00080000:0.0:1782759973.559174:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759973.559179:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759973.805279:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212117504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.805301:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212117632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.807425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759973.807519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759973.807586:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212118016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.807630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759973.808158:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212118144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.808190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759973.808222:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212117760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.808247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759973.808267:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759973.808273:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212117888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.808294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759973.808459:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118144 00000100:00100000:0.0:1782759973.808467:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118144 00000100:00100000:0.0:1782759973.808515:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117888 00000100:00100000:0.0:1782759973.808518:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117888 00000100:00100000:0.0:1782759973.808542:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1782759973.808551:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212118144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.808613:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212118144:12345-0@lo:400:kworker.0 Request processed in 62us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.808620:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1782759973.808637:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:0.0:1782759973.808643:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212117888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.808674:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212117888:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.808680:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00080000:0.0:1782759973.808694:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759973.808697:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759973.808898:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117632 00000100:00100000:0.0:1782759973.808903:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117632 00000100:00100000:0.0:1782759973.808930:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118016 00000100:00100000:0.0:1782759973.808933:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118016 00000100:00100000:0.0:1782759973.808952:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117760 00000100:00100000:0.0:1782759973.808955:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117760 00000100:00100000:0.0:1782759973.808986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1782759973.808992:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212117632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.809025:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3306:x1869355212117632:12345-0@lo:400:kworker.0 Request processed in 34us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.809031:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1782759973.809042:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:0.0:1782759973.809048:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212118016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.809090:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212118016:12345-0@lo:400:kworker.0 Request processed in 42us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.809096:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:0.0:1782759973.809107:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:0.0:1782759973.809113:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212117760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.809155:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212117760:12345-0@lo:400:kworker.0 Request processed in 42us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.809161:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:0.0:1782759973.809185:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212117504 00000100:00100000:0.0:1782759973.809188:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212117504 00000100:00100000:0.0:1782759973.809211:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:0.0:1782759973.809218:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212117504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759973.809251:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212117504:12345-0@lo:400:kworker.0 Request processed in 34us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.809258:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00080000:0.0:1782759973.809295:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759973.809446:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869355212117632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759973.810358:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212118016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759973.810373:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212117504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.810707:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212118144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.810752:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212117888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759973.810766:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212117760:0@lo:400:kworker.0 00010000:00010000:0.0:1782759973.872000:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759974.316135:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759974.316164:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212118272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759974.316250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759974.316320:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118272 00000100:00100000:1.0:1782759974.316329:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118272 00000100:00100000:1.0:1782759974.316388:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1782759974.316400:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212118272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759974.316567:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759974.318599:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212118272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2191us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759974.318612:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:3.0:1782759974.321142:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212118272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759974.323261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759974.323349:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406336 00000100:00100000:1.0:1782759974.323358:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406336 00000100:00100000:1.0:1782759974.323414:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2355 00000100:00100000:1.0:1782759974.323424:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:111896:x1869355197406336:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759974.323444:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759974.323519:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e14cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67413 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323578:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323592:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323630:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323654:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323662:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323668:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323982:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323990:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.323997:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324003:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759974.324008:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324016:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324029:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759974.324033:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.324038:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324051:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030c00/0xdd99f5c4777e14d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324065:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324071:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324077:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324082:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759974.324086:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324092:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324100:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff9171889c5600) 00010000:00010000:1.0:1782759974.324103:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.324106:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324112:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030000/0xdd99f5c4777e14db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324156:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e14cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67413 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324179:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171889c5b00) 00010000:00010000:1.0:1782759974.324181:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.324185:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180031400/0xdd99f5c4777e14cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67413 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.324198:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031400, rc 0) 00000100:00100000:1.0:1782759974.324267:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:111896:x1869355197406336:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 844us (1017us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759974.324275:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2355 00000100:00100000:2.0:1782759974.332453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759974.332524:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406592 00000100:00100000:0.0:1782759974.332547:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406592 00000100:00100000:0.0:1782759974.332608:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2356 00000100:00100000:0.0:1782759974.332629:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:111896:x1869355197406592:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759974.332692:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759974.332697:0:5803:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e0f78) 00010000:00010000:0.0:1782759974.332699:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759974.333028:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.333046:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.333059:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.333071:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.333079:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.333085:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759974.334303:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x4:0x0]: returning size 512 00010000:00010000:0.0:1782759974.334317:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.334326:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.334333:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.334347:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759974.334352:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.334360:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.334376:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1000) 00010000:00010000:0.0:1782759974.334379:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759974.334383:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759974.334390:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e14e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759974.334406:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d315aa48 reply state 000000005992fdac transno 4294968229 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759974.334415:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759974.334515:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:111896:x1869355197406592:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1894us (2068us total) trans 4294968229 rc 0/0 00000100:00100000:0.0:1782759974.334522:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2356 00010000:00010000:2.0:1782759974.339440:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.339459:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.339469:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.339476:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759974.339483:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.339494:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.339514:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff917182dd1c00) 00010000:00010000:2.0:1782759974.339517:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.339522:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.339530:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e14e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.892344:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759975.919318:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759976.002525:0:164919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9ef26680 20000000:00000080:3.0:1782759976.002542:0:164919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b3229000 uarg=0000000000000000 00010000:00010000:3.0:1782759976.004988:0:164919:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759976.005012:0:164919:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759976.005029:0:164919:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759976.005052:0:164919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759976.005070:0:164919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759976.005080:0:164919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759976.005129:0:164919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759976.005145:0:164919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 18 pid: 5796 timeout: 4144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759976.005160:0:164919:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164919:1869355212118400:0@lo:104: 00000100:00100000:3.0:1782759976.005230:0:164919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759976.005283:0:164919:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082a75600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759976.005417:0:139369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118400 00000100:00100000:2.0:1782759976.005425:0:139369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118400 00000100:00100000:2.0:1782759976.005472:0:139369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1782759976.005481:0:139369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164919:x1869355212118400:12345-0@lo:104: 00010000:00010000:2.0:1782759976.005494:0:139369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759976.005562:0:139369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759976.005569:0:139369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:164919:x1869355212118400:12345-0@lo:104: Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759976.005577:0:139369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1782759976.005671:0:164919:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164919:1869355212118400:0@lo:104: 00010000:00010000:0.0:1782759976.005693:0:164919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.005787:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759976.005795:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.005803:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759976.005808:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.005816:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759976.005853:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759976.005858:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759976.005886:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.005892:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759976.005923:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.005931:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e14bf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.005947:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759976.005949:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759976.005950:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759976.005993:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759976.006005:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212118528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759976.006038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759976.006121:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118528 00000100:00100000:1.0:1782759976.006125:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118528 00010000:00010000:1.0:1782759976.006145:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 19 pid: 5796 timeout: 4144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759976.006177:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1782759976.006184:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212118528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759976.006195:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759976.006201:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 19 pid: 5796 timeout: 4144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006210:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 19 pid: 5796 timeout: 4144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006223:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e14c6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e14bf expref: 19 pid: 5796 timeout: 4144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006236:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006245:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006267:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006275:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006282:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006288:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006294:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd400 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759976.006297:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006304:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006314:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759976.006323:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759976.006356:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3307:x1869355212118528:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759976.006362:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1782759976.006391:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212118528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759976.006447:0:164919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759976.006455:0:164919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759976.006462:0:164919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7dcd400/0xdd99f5c4777e14f0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759976.876161:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759976.876187:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212118656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759976.876260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759976.877566:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118656 00000100:00100000:3.0:1782759976.877581:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118656 00000100:00100000:3.0:1782759976.877649:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1782759976.877660:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212118656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759976.877710:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759976.877782:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212118656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759976.877789:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00080000:0.0:1782759976.878496:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759976.878542:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212118656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759976.941384:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759977.135997:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759977.136006:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759977.136011:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759977.136062:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759977.136083:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759977.136094:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759977.136120:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212118784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759977.136199:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759977.136278:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917183e309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759977.136438:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118784 00000100:00100000:1.0:1782759977.136446:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118784 00000100:00100000:1.0:1782759977.136520:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:1.0:1782759977.136528:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212118784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759977.136542:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759977.136555:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e14f7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759977.136580:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759977.136591:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759977.136600:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180031a00, rc 0) 00000100:00100000:1.0:1782759977.136650:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212118784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759977.136657:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:2.0:1782759977.136785:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9171b77c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212118784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759977.136800:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759977.136809:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759977.136855:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759977.136861:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759977.136875:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759977.965460:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759978.686608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759978.686643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759978.686687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759978.686732:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406976 00000100:00100000:2.0:1782759978.686742:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406976 00000100:00100000:2.0:1782759978.686804:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2352 00000100:00100000:2.0:1782759978.686816:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197406976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759978.686917:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197406976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 103us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759978.686925:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2352 00000100:00100000:0.0:1782759978.687197:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406848 00000100:00100000:0.0:1782759978.687202:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406848 00000100:00100000:0.0:1782759978.687244:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2921 00000100:00100000:0.0:1782759978.687251:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197406848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759978.687294:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2362:x1869355197406848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 44us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759978.687300:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2921 00000100:00080000:0.0:1782759978.687317:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759978.687322:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759978.687495:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197406720 00000100:00100000:3.0:1782759978.687500:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197406720 00000100:00100000:3.0:1782759978.687576:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3191 00000100:00100000:3.0:1782759978.687584:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197406720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759978.687616:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2362:x1869355197406720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.687622:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3191 00000100:00100000:3.0:1782759978.935088:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212118912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759978.935258:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212119424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759978.935313:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759978.935318:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212119296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759978.935370:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212119040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759978.935412:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212119552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759978.935452:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759978.935457:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212119168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759978.935528:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212118912 00000100:00100000:3.0:1782759978.935536:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212118912 00000100:00100000:3.0:1782759978.935582:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:3.0:1782759978.935591:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212118912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935640:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212118912:12345-0@lo:400:kworker.0 Request processed in 50us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.935648:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00100000:3.0:1782759978.935722:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119424 00000100:00100000:3.0:1782759978.935726:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119424 00000100:00100000:3.0:1782759978.935759:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119040 00000100:00100000:3.0:1782759978.935762:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119040 00000100:00100000:3.0:1782759978.935777:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119168 00000100:00100000:3.0:1782759978.935780:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119168 00000100:00100000:3.0:1782759978.935799:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1782759978.935805:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212119424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935866:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3306:x1869355212119424:12345-0@lo:400:kworker.0 Request processed in 59us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.935872:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1782759978.935884:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1782759978.935890:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212119040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935920:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212119040:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.935926:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1782759978.935938:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:3.0:1782759978.935944:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170839c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212119168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.935972:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170839c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3307:x1869355212119168:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.935984:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:3.0:1782759978.936003:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119296 00000100:00100000:3.0:1782759978.936007:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119296 00000100:00100000:3.0:1782759978.936031:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119552 00000100:00100000:3.0:1782759978.936047:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119552 00000100:00100000:3.0:1782759978.936072:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:3.0:1782759978.936078:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212119296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936109:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212119296:12345-0@lo:400:kworker.0 Request processed in 32us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.936115:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:3.0:1782759978.936125:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:3.0:1782759978.936131:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212119552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936158:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212119552:12345-0@lo:400:kworker.0 Request processed in 27us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759978.936163:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00080000:3.0:1782759978.936273:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759978.936278:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759978.936280:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759978.936323:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212119296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936333:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212118912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936343:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869355212119424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936471:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869355212119168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936480:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212119040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759978.936489:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212119552:0@lo:400:kworker.0 00000001:00080000:3.0:1782759978.981600:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968229 is committed 00010000:00010000:1.0:1782759978.988076:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759979.437177:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212119680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759979.437255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759979.437395:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119680 00000100:00100000:1.0:1782759979.437404:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119680 00000100:00100000:1.0:1782759979.437466:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1782759979.437476:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212119680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759979.437515:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759979.437574:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212119680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759979.437583:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1782759979.437679:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212119680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759979.779873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759979.779952:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197407104 00000100:00100000:3.0:1782759979.779962:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197407104 00000100:00100000:3.0:1782759979.780037:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2357 00000100:00100000:3.0:1782759979.780049:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+5:111989:x1869355197407104:12345-192.168.204.31@tcp:101:create_foreign_.0 00010000:00010000:3.0:1782759979.780074:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759979.780103:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6741a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.780185:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e150c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.780202:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e150c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.780216:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e150c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759979.780454:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1782759979.780459:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1782759979.780613:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e150c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.780639:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6741a expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.780654:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e150c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6741a expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.780671:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1400) 00010000:00010000:3.0:1782759979.780674:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759979.780678:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:3.0:1782759979.780749:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:111989:x1869355197407104:12345-192.168.204.31@tcp:101:create_foreign_.0 Request processed in 702us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759979.780757:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2357 00000100:00100000:2.0:1782759979.783789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759979.783986:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197407360 00000100:00100000:3.0:1782759979.783996:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197407360 00000100:00100000:3.0:1782759979.784113:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2358 00000100:00100000:3.0:1782759979.784126:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:111989:x1869355197407360:12345-192.168.204.31@tcp:101:create_foreign_.0 00010000:00010000:3.0:1782759979.784156:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759979.784184:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67421 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.784272:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.784288:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.784299:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.784314:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.784320:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.784334:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759979.784876:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x4:0x0]: returning size 7680 00010000:00010000:3.0:1782759979.785076:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785086:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785094:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785100:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759979.785104:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785112:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785127:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1400) 00010000:00010000:3.0:1782759979.785130:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759979.785134:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785140:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e151a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785151:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785167:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785173:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785178:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759979.785181:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785188:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785196:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff9171908a1c00) 00010000:00010000:3.0:1782759979.785198:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759979.785201:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785207:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785251:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1513 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67421 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785261:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1400) 00010000:00010000:3.0:1782759979.785263:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759979.785267:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67421 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.785276:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcdc00, rc 0) 00000100:00100000:3.0:1782759979.785349:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:111989:x1869355197407360:12345-192.168.204.31@tcp:101:create_foreign_.0 Request processed in 1226us (1570us total) trans 4294968230 rc 301/301 00000100:00100000:3.0:1782759979.785357:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2358 00000100:00100000:1.0:1782759979.792000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759979.792089:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197407616 00000100:00100000:3.0:1782759979.792103:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197407616 00000100:00100000:3.0:1782759979.792203:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2359 00000100:00100000:3.0:1782759979.792215:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+7:111989:x1869355197407616:12345-192.168.204.31@tcp:36:create_foreign_.0 00000100:00100000:3.0:1782759979.792366:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+7:111989:x1869355197407616:12345-192.168.204.31@tcp:36:create_foreign_.0 Request processed in 153us (374us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759979.792374:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2359 00000100:00100000:1.0:1782759979.801998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759979.802050:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197407872 00000100:00100000:2.0:1782759979.802061:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197407872 00000100:00100000:2.0:1782759979.802124:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 413 00000100:00100000:2.0:1782759979.802134:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:111989:x1869355197407872:12345-192.168.204.31@tcp:35:create_foreign_.0 00000100:00100000:2.0:1782759979.802593:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+8:111989:x1869355197407872:12345-192.168.204.31@tcp:35:create_foreign_.0 Request processed in 458us (602us total) trans 4294968231 rc 0/0 00000100:00100000:2.0:1782759979.802601:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 413 00000100:00100000:1.0:1782759979.810919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759979.811012:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197408000 00000100:00100000:2.0:1782759979.811032:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197408000 00000100:00100000:2.0:1782759979.811084:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2360 00000100:00100000:2.0:1782759979.811094:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+8:111493:x1869355197408000:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1782759979.811118:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759979.811138:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e152f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67428 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.811200:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.811215:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.811226:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.811240:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.811247:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.811254:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814058:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1544 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814079:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1544 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814102:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1544 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759979.814202:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x4:0x0]: returning size 7680 00000004:00200000:2.0:1782759979.814207:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759979.814286:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1544 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814301:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814307:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814314:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814319:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759979.814324:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814331:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814344:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1400) 00010000:00010000:2.0:1782759979.814347:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759979.814352:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814357:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814379:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814385:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814391:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814395:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759979.814398:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814404:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814411:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff917191f75100) 00010000:00010000:2.0:1782759979.814413:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759979.814416:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814421:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e153d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814457:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e152f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67428 expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814471:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1544 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67428 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.814489:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759979.814492:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759979.814494:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782759979.814578:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+9:111493:x1869355197408000:12345-192.168.204.31@tcp:101:bash.0 Request processed in 3484us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759979.814588:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2360 00000100:00100000:0.0:1782759979.818924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759979.819718:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197408128 00000100:00100000:2.0:1782759979.819729:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197408128 00000100:00100000:2.0:1782759979.819799:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2361 00000100:00100000:2.0:1782759979.819810:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+9:111493:x1869355197408128:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1782759979.819849:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759979.819870:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e154b lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6742f expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.819944:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.819959:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.819971:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.819986:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.819993:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820032:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820299:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820308:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820314:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820321:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759979.820325:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820332:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820345:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759979.820349:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759979.820352:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820359:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1552 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820371:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820376:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820388:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820394:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759979.820397:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820403:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820412:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0xbb4b5341 (ffff917191f75300) 00010000:00010000:2.0:1782759979.820414:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759979.820417:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820422:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90800/0xdd99f5c4777e1559 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820456:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e154b lrc: 1/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6742f expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820681:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759979.820685:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759979.820690:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e154b lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6742f expref: 10 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759979.820700:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782759979.820812:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+9:111493:x1869355197408128:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1003us (1900us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759979.820846:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2361 00000100:00100000:2.0:1782759979.849623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759979.849762:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197408384 00000100:00100000:3.0:1782759979.849773:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197408384 00000100:00100000:3.0:1782759979.849866:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2362 00000100:00100000:3.0:1782759979.849886:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+9:111990:x1869355197408384:12345-192.168.204.31@tcp:101:create_foreign_.500 00010000:00010000:3.0:1782759979.849908:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759979.849929:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67436 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.850311:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1567 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.850328:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1567 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.850340:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1567 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759979.850354:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x4:0x0]: returning size 7680 00010000:00010000:3.0:1782759979.850565:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67436 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.850663:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1567 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67436 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759979.850672:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782759979.850674:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782759979.850677:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782759979.850748:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+11:111990:x1869355197408384:12345-192.168.204.31@tcp:101:create_foreign_.500 Request processed in 873us (1135us total) trans 4294968232 rc 0/0 00000100:00100000:3.0:1782759979.850756:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2362 00000100:00100000:3.0:1782759979.863814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759979.863877:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197408640 00000100:00100000:3.0:1782759979.863887:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197408640 00000100:00100000:3.0:1782759979.863936:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2363 00000100:00100000:3.0:1782759979.863945:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+11:111990:x1869355197408640:12345-192.168.204.31@tcp:36:create_foreign_.500 00000100:00100000:3.0:1782759979.864071:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+11:111990:x1869355197408640:12345-192.168.204.31@tcp:36:create_foreign_.500 Request processed in 126us (267us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759979.864078:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2363 00000100:00100000:0.0:1782759979.873809:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759979.874163:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197408768 00000100:00100000:0.0:1782759979.874173:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197408768 00000100:00100000:0.0:1782759979.874234:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2364 00000100:00100000:0.0:1782759979.874243:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+11:111493:x1869355197408768:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1782759979.874273:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759979.874292:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1575 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6743d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.874976:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 3/1,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.874993:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.875005:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.875072:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.875081:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.875088:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.876968:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.876984:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.876991:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.876997:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759979.877010:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877028:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877045:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782759979.877048:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759979.877053:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877060:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e157c lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877073:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877079:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877084:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877090:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759979.877092:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877418:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877432:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x4e415e1b (ffff917182dd1500) 00010000:00010000:0.0:1782759979.877435:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759979.877444:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877451:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e1583 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877496:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1575 lrc: 1/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6743d expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877508:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782759979.877511:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759979.877515:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1575 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6743d expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759979.877525:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74c00, rc 0) 00000100:00100000:0.0:1782759979.878239:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+11:111493:x1869355197408768:12345-192.168.204.31@tcp:101:bash.0 Request processed in 3992us (4435us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759979.878251:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2364 00010000:00010000:3.0:1782759980.017855:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759980.752365:0:165165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffabec88e0 20000000:00000080:0.0:1782759980.752386:0:165165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7ca3400 uarg=0000000000000000 00010000:00010000:0.0:1782759980.753259:0:165165:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1782759980.753296:0:165165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1400) 00010000:00010000:0.0:1782759980.753300:0:165165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759980.753312:0:165165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e150c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6741a expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753338:0:165165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782759980.753341:0:165165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759980.753345:0:165165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1544 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67428 expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753366:0:165165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75900) 00010000:00010000:0.0:1782759980.753368:0:165165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782759980.753373:0:165165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd600/0xdd99f5c4777e1567 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67436 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753387:0:165165:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 3 locks, left on hash table 0. 10000000:01000000:0.0:1782759980.753406:0:165165:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759980.753420:0:165165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753437:0:165165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753444:0:165165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753481:0:165165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759980.753495:0:165165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 18 pid: 5796 timeout: 4149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759980.753510:0:165165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165165:1869355212119808:0@lo:104: 00000100:00100000:0.0:1782759980.753576:0:165165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759980.753720:0:165165:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082748e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759980.754212:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119808 00000100:00100000:2.0:1782759980.754221:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119808 00000100:00100000:2.0:1782759980.754302:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1782759980.754313:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:165165:x1869355212119808:12345-0@lo:104: 00010000:00010000:2.0:1782759980.754326:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759980.754397:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759980.754404:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:165165:x1869355212119808:12345-0@lo:104: Request processed in 93us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759980.754410:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1782759980.754483:0:165165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165165:1869355212119808:0@lo:104: 00010000:00010000:1.0:1782759980.754503:0:165165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754557:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759980.754564:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754572:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:3.0:1782759980.754576:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754594:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759980.754601:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759980.754607:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759980.754643:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754649:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759980.754668:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754685:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9171c0b90400/0xdd99f5c4777e14f7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e14fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754701:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759980.754703:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759980.754705:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759980.754717:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212119936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759980.754748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759980.754790:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212119936 00000100:00100000:3.0:1782759980.754794:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212119936 00010000:00010000:3.0:1782759980.754811:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 19 pid: 5796 timeout: 4149 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759980.754859:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1782759980.754866:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212119936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759980.754882:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759980.754888:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 19 pid: 5796 timeout: 4149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754899:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 19 pid: 5796 timeout: 4149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754912:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180031a00/0xdd99f5c4777e14fe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e14f7 expref: 19 pid: 5796 timeout: 4149 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754934:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754943:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754958:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754965:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754972:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754978:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.754983:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:3.0:1782759980.754987:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.755013:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.755024:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759980.755033:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759980.755063:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212119936:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759980.755070:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1782759980.755100:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212119936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759980.755344:0:165165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759980.755352:0:165165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759980.755358:0:165165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d74200/0xdd99f5c4777e158a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759981.036036:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759981.997895:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212120064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759981.997987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759981.998114:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120064 00000100:00100000:3.0:1782759981.998123:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120064 00000100:00100000:3.0:1782759981.998185:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1782759981.998196:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212120064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759981.998237:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782759981.998303:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212120064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759981.998310:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00080000:1.0:1782759981.998538:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759981.998582:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212120064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759982.060163:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759982.508217:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759982.508226:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759982.508232:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759982.508281:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759982.508293:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759982.508306:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759982.508425:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212120192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759982.508496:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759982.508640:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120192 00000100:00100000:0.0:1782759982.508649:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120192 00000100:00100000:0.0:1782759982.508718:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193 00000100:00100000:0.0:1782759982.508728:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212120192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759982.508751:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759982.508767:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1591 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759982.508793:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759982.508806:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759982.508816:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75200, rc 0) 00000100:00100000:0.0:1782759982.508893:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212120192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759982.508901:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193 00000100:00100000:1.0:1782759982.509226:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082f26780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759982.509249:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212120192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759982.509265:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759982.509274:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759982.509291:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759982.509296:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759982.509304:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759983.088864:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759983.802841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759983.802877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759983.802901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759983.803071:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197409152 00000100:00100000:0.0:1782759983.803082:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197409152 00000100:00100000:0.0:1782759983.803142:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2355 00000100:00100000:0.0:1782759983.803154:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197409152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759983.803231:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197409152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 81us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759983.803238:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2355 00000100:00080000:0.0:1782759983.803272:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759983.803482:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197408896 00000100:00100000:3.0:1782759983.803487:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197408896 00000100:00100000:3.0:1782759983.803518:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3194 00000100:00100000:3.0:1782759983.803525:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197408896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759983.803559:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197408896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759983.803576:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3194 00000100:00100000:3.0:1782759983.803606:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197409024 00000100:00100000:3.0:1782759983.803610:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197409024 00000100:00100000:3.0:1782759983.803640:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2925 00000100:00100000:3.0:1782759983.803646:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+8:2364:x1869355197409024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759983.803677:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171b77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+8:2364:x1869355197409024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759983.803684:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2925 00000100:00080000:3.0:1782759983.803756:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759984.046341:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212120576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759984.046341:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212120448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759984.046433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759984.046490:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759984.046499:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212120704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.046500:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120576 00000100:00100000:3.0:1782759984.046511:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120576 00000100:00100000:1.0:1782759984.046528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759984.046623:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212120320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759984.046660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759984.046698:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212120832:0@lo:400:kworker.0 00000100:00080000:3.0:1782759984.046707:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759984.046722:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120704 00000100:00100000:3.0:1782759984.046726:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120704 00000100:00100000:1.0:1782759984.046734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759984.046768:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1782759984.046778:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212120704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.046862:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212120704:12345-0@lo:400:kworker.0 Request processed in 85us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759984.046870:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1782759984.046897:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120832 00000100:00100000:3.0:1782759984.046900:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120832 00000100:00100000:3.0:1782759984.046928:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:3.0:1782759984.046947:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212120576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.046980:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212120576:12345-0@lo:400:kworker.0 Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759984.046986:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:3.0:1782759984.047006:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1782759984.047013:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212120832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.047049:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212120832:12345-0@lo:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759984.047055:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1782759984.047075:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120320 00000100:00100000:3.0:1782759984.047078:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120320 00000100:00100000:3.0:1782759984.047099:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:3.0:1782759984.047105:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212120320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.047137:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212120320:12345-0@lo:400:kworker.0 Request processed in 31us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759984.047143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00080000:3.0:1782759984.047189:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759984.047193:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759984.047233:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212120320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.047249:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212120832:0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.047288:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212120704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759984.047301:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212120576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759984.047892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759984.047923:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212120960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759984.047960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759984.047995:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120448 00000100:00100000:0.0:1782759984.048009:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120448 00000100:00100000:0.0:1782759984.048046:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:0.0:1782759984.048054:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212120448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759984.048093:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3308:x1869355212120448:12345-0@lo:400:kworker.0 Request processed in 39us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759984.048098:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:0.0:1782759984.048119:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212120960 00000100:00100000:0.0:1782759984.048122:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212120960 00000100:00100000:0.0:1782759984.048157:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:0.0:1782759984.048163:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759984.048193:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869355212120448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759984.048202:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212120960:12345-0@lo:400:kworker.0 Request processed in 37us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759984.048210:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170818cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212120960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759984.048211:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00080000:0.0:1782759984.048237:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782759984.103760:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968231 is committed 00000001:00080000:3.0:1782759984.103776:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968232 is committed 00010000:00010000:1.0:1782759984.111244:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759984.494567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759984.495763:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197409408 00000100:00100000:3.0:1782759984.495775:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197409408 00000100:00100000:3.0:1782759984.495847:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2365 00000100:00100000:3.0:1782759984.495858:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:112073:x1869355197409408:12345-192.168.204.31@tcp:36:create_foreign_.0 00010000:00010000:3.0:1782759984.498524:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 3/0,1 mode: --/CW res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.498553:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.498565:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.498579:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.498585:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.498590:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759984.499864:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x7:0x0]: returning size 512 00010000:00010000:3.0:1782759984.499879:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.499889:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 2/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.499896:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.499902:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759984.499906:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.499914:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 4/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.502880:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff9171908a1300) 00010000:00010000:3.0:1782759984.502883:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759984.502891:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 2/0,0 mode: --/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.502898:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e159f lrc: 0/0,0 mode: --/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759984.502937:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031c4fd4b reply state 00000000456371e5 transno 4294968233 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759984.502947:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759984.503210:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112073:x1869355197409408:12345-192.168.204.31@tcp:36:create_foreign_.0 Request processed in 7349us (8647us total) trans 4294968233 rc 0/0 00000100:00100000:3.0:1782759984.503219:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2365 00010000:00010000:0.0:1782759984.506455:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.506471:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.506478:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.506484:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759984.506489:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.506497:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.506531:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0xd8f104ef (ffff9171908a1b00) 00010000:00010000:0.0:1782759984.506534:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759984.506539:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.506545:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e15a6 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759984.533788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759984.533886:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197409536 00000100:00100000:0.0:1782759984.533897:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197409536 00000100:00100000:0.0:1782759984.533970:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2366 00000100:00100000:0.0:1782759984.533981:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:112074:x1869355197409536:12345-192.168.204.31@tcp:101:parse_foreign_d.0 00010000:00010000:0.0:1782759984.534008:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759984.534033:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15ad lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67444 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534101:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 3/1,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534116:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534129:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534143:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 3/1,0 mode: --/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534150:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534165:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534323:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e15c2 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534333:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e15c2 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534340:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e15c2 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759984.534378:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x7:0x0]: returning size 512 00000004:00200000:0.0:1782759984.534384:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 36 MDT count 1 00000004:00010000:0.0:1782759984.534421:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e15c2 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534433:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534440:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534446:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534451:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759984.534455:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534461:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534478:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:0.0:1782759984.534481:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759984.534486:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534492:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e15b4 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534505:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534511:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534517:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534522:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759984.534525:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534531:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534538:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0xd8f104ef (ffff917182dd1800) 00010000:00010000:0.0:1782759984.534540:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759984.534543:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 2/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534548:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15bb lrc: 0/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534588:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15ad lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67444 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534602:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e15c2 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67444 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.534608:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x7:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:0.0:1782759984.534610:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759984.534613:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74400, rc 0) 00000100:00100000:0.0:1782759984.534685:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112074:x1869355197409536:12345-192.168.204.31@tcp:101:parse_foreign_d.0 Request processed in 705us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759984.534692:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2366 00000100:00100000:0.0:1782759984.539484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759984.539599:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197409664 00000100:00100000:2.0:1782759984.539609:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197409664 00000100:00100000:2.0:1782759984.539672:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 414 00000100:00100000:2.0:1782759984.539684:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112074:x1869355197409664:12345-192.168.204.31@tcp:49:parse_foreign_d.0 00000100:00100000:2.0:1782759984.539817:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112074:x1869355197409664:12345-192.168.204.31@tcp:49:parse_foreign_d.0 Request processed in 136us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759984.539867:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 414 00000100:00100000:0.0:1782759984.546133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759984.546263:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197409792 00000100:00100000:2.0:1782759984.546274:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197409792 00000100:00100000:2.0:1782759984.546345:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 415 00000100:00100000:2.0:1782759984.546367:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917198915450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112074:x1869355197409792:12345-192.168.204.31@tcp:49:parse_foreign_d.0 00000100:00100000:2.0:1782759984.546509:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917198915450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112074:x1869355197409792:12345-192.168.204.31@tcp:49:parse_foreign_d.0 Request processed in 144us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759984.546517:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 415 00000100:00100000:0.0:1782759984.556107:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759984.556131:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212121088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759984.556200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759984.556421:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121088 00000100:00100000:2.0:1782759984.556429:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121088 00000100:00100000:2.0:1782759984.556478:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1782759984.556487:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212121088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759984.556523:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1782759984.556608:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212121088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759984.556614:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:0.0:1782759984.560365:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212121088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759984.574080:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759984.574129:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410048 00000100:00100000:0.0:1782759984.574139:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410048 00000100:00100000:0.0:1782759984.574248:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2367 00000100:00100000:0.0:1782759984.574260:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112076:x1869355197410048:12345-192.168.204.31@tcp:36:create_foreign_.500 00010000:00010000:0.0:1782759984.574425:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 3/0,1 mode: --/CW res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.574442:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.574462:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.574526:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,1 mode: --/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.574534:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.574541:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759984.575572:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x8:0x0]: returning size 512 00010000:00010000:0.0:1782759984.575587:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.575596:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 2/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.575916:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.575931:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759984.575936:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 3/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.575945:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 4/0,0 mode: CW/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.575961:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917182dd1c00) 00010000:00010000:0.0:1782759984.575964:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759984.575977:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 2/0,0 mode: --/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759984.575983:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75c00/0xdd99f5c4777e15c9 lrc: 0/0,0 mode: --/CW res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759984.576003:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019c5bff6 reply state 00000000fc647b12 transno 4294968234 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759984.576013:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759984.576118:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112076:x1869355197410048:12345-192.168.204.31@tcp:36:create_foreign_.500 Request processed in 1856us (2041us total) trans 4294968234 rc 0/0 00000100:00100000:0.0:1782759984.576126:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2367 00010000:00010000:1.0:1782759984.578432:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759984.578448:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759984.578457:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759984.578462:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759984.578468:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759984.578476:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759984.578494:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0xeb6b0b51 (ffff917182dd1800) 00010000:00010000:1.0:1782759984.578497:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759984.578501:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 2/0,0 mode: --/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759984.578507:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75600/0xdd99f5c4777e15d0 lrc: 0/0,0 mode: --/PW res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759984.596999:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759984.597041:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410176 00000100:00100000:3.0:1782759984.597051:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410176 00000100:00100000:3.0:1782759984.597107:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2368 00000100:00100000:3.0:1782759984.597126:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+8:112077:x1869355197410176:12345-192.168.204.31@tcp:101:parse_foreign_d.0 00010000:00010000:3.0:1782759984.597156:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759984.597183:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e15d7 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6744b expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597251:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 3/1,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597266:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597285:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597299:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597305:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597310:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597415:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e15ec lrc: 3/1,0 mode: --/PR res: [0x200000419:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597423:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e15ec lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597430:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e15ec lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759984.597471:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0x8:0x0]: returning size 512 00000004:00200000:3.0:1782759984.597476:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 36 MDT count 1 00000004:00010000:3.0:1782759984.597505:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e15ec lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597518:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597525:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597543:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597549:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcd000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759984.597553:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597560:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597573:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff9171908a1300) 00010000:00010000:3.0:1782759984.597576:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759984.597581:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597586:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e15de lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597615:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597622:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597627:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597631:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcde00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782759984.597634:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597650:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597659:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0xeb6b0b51 (ffff9171908a1e00) 00010000:00010000:3.0:1782759984.597662:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759984.597665:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597671:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcde00/0xdd99f5c4777e15e5 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597703:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e15d7 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6744b expref: 10 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597718:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e15ec lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6744b expref: 9 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759984.597725:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x8:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782759984.597727:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759984.597729:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcc200, rc 0) 00000100:00100000:3.0:1782759984.597792:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112077:x1869355197410176:12345-192.168.204.31@tcp:101:parse_foreign_d.0 Request processed in 675us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759984.597799:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2368 00000100:00100000:1.0:1782759984.606593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759984.607148:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410304 00000100:00100000:3.0:1782759984.607161:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410304 00000100:00100000:3.0:1782759984.607217:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 416 00000100:00100000:3.0:1782759984.607227:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112077:x1869355197410304:12345-192.168.204.31@tcp:49:parse_foreign_d.0 00000100:00100000:3.0:1782759984.607392:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112077:x1869355197410304:12345-192.168.204.31@tcp:49:parse_foreign_d.0 Request processed in 167us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759984.607401:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 416 00000100:00100000:1.0:1782759984.615756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759984.620204:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410432 00000100:00100000:2.0:1782759984.620218:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410432 00000100:00100000:2.0:1782759984.620295:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 417 00000100:00100000:2.0:1782759984.620306:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112077:x1869355197410432:12345-192.168.204.31@tcp:49:parse_foreign_d.0 00000100:00100000:2.0:1782759984.620451:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112077:x1869355197410432:12345-192.168.204.31@tcp:49:parse_foreign_d.0 Request processed in 147us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759984.620460:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 417 00010000:00010000:3.0:1782759985.133303:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759985.440688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759985.440755:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410688 00000100:00100000:1.0:1782759985.440766:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410688 00000100:00100000:1.0:1782759985.440861:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2369 00000100:00100000:1.0:1782759985.440873:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170830e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112087:x1869355197410688:12345-192.168.204.31@tcp:36:create_foreign_.0 00000100:00100000:1.0:1782759985.441023:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170830e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+9:112087:x1869355197410688:12345-192.168.204.31@tcp:36:create_foreign_.0 Request processed in 153us (344us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759985.441031:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2369 00000100:00080000:3.0:1782759985.441095:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759985.457013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759985.459726:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410816 00000100:00100000:2.0:1782759985.459738:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410816 00000100:00100000:2.0:1782759985.459797:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2370 00000100:00100000:2.0:1782759985.459806:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+9:111493:x1869355197410816:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1782759985.459846:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759985.459873:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e15f3 lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67452 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.459955:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 3/1,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.459968:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.459978:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460034:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 3/1,0 mode: --/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460041:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460046:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460119:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 3/1,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460126:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 2/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460132:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460137:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759985.460141:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 3/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460156:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 4/0,0 mode: CR/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460168:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782759985.460171:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759985.460175:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 2/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460181:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e15fa lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460192:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460197:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460203:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.460219:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759985.461447:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.461457:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.461471:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0xaa0d5278 (ffff917191f75f00) 00010000:00010000:2.0:1782759985.461474:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759985.461477:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 2/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.461490:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e1601 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x4:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.461529:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e15f3 lrc: 1/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67452 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.461540:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x4:0x0].0x0 (ffff917191f75100) 00010000:00010000:2.0:1782759985.461542:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759985.461546:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e15f3 lrc: 0/0,0 mode: --/CR res: [0x200000419:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67452 expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759985.461853:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782759985.461943:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+9:111493:x1869355197410816:12345-192.168.204.31@tcp:101:bash.0 Request processed in 2136us (5228us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759985.461952:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2370 00010000:00010000:3.0:1782759986.158398:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759987.117084:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759987.117119:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212121216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759987.117187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759987.117328:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121216 00000100:00100000:2.0:1782759987.117338:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121216 00000100:00100000:2.0:1782759987.117411:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1782759987.117422:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212121216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759987.117462:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759987.117515:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170818ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212121216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759987.117522:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1782759987.117567:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212121216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759987.117642:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759987.180482:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759988.204231:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759988.920571:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759988.920718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759988.920785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759988.920877:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411200 00000100:00100000:0.0:1782759988.920888:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411200 00000100:00100000:1.0:1782759988.920930:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411072 00000100:00100000:1.0:1782759988.920936:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411072 00000100:00100000:0.0:1782759988.920970:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2358 00000100:00100000:0.0:1782759988.920983:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708914b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197411200:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759988.920987:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2929 00000100:00100000:1.0:1782759988.920999:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+9:2363:x1869355197411072:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759988.921069:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+9:2363:x1869355197411072:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00080000:2.0:1782759988.921078:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759988.921078:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2929 00000100:00080000:2.0:1782759988.921084:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759988.921522:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708914b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2363:x1869355197411200:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 541us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759988.921529:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2358 00000100:00100000:3.0:1782759988.923484:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197410944 00000100:00100000:3.0:1782759988.923496:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197410944 00000100:00100000:3.0:1782759988.923612:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3196 00000100:00100000:3.0:1782759988.923622:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197410944:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759988.923698:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c276a8fc-707b-4100-a499-42c8469183db+10:2363:x1869355197410944:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 76us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759988.923706:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3196 00000100:00100000:2.0:1782759989.169294:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212121600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759989.169465:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759989.169471:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212121728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759989.169528:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121600 00000100:00100000:2.0:1782759989.169535:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121600 00000100:00100000:2.0:1782759989.169589:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1782759989.169598:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212121600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169654:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212121600:12345-0@lo:400:kworker.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759989.169661:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1782759989.169684:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121728 00000100:00100000:2.0:1782759989.169687:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121728 00000100:00100000:2.0:1782759989.169716:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1782759989.169722:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212121728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169750:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212121728:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759989.169756:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00080000:2.0:1782759989.169771:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759989.169775:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759989.169803:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212121728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169815:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212121600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169891:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212121344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759989.169955:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212121856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.169975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759989.169992:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782759989.169998:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212121472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759989.170034:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212121984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759989.170079:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121344 00000100:00100000:2.0:1782759989.170083:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121344 00000100:00100000:2.0:1782759989.170107:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1782759989.170114:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212121344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170148:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3307:x1869355212121344:12345-0@lo:400:kworker.0 Request processed in 34us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759989.170153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1782759989.170177:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121856 00000100:00100000:2.0:1782759989.170180:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121856 00000100:00100000:2.0:1782759989.170206:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121472 00000100:00100000:2.0:1782759989.170209:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121472 00000100:00100000:2.0:1782759989.170225:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:2.0:1782759989.170230:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212121856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170258:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3307:x1869355212121856:12345-0@lo:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759989.170264:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:2.0:1782759989.170274:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759989.170279:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212121472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170316:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+8:3307:x1869355212121472:12345-0@lo:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759989.170323:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00080000:2.0:1782759989.170342:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759989.170358:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869355212121472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170367:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfd399a3-a1a2-417f-89de-b443f9e395e0:3307:1869355212121344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759989.170375:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869355212121856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759989.176925:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212121984 00000100:00100000:0.0:1782759989.176952:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212121984 00000100:00100000:0.0:1782759989.177028:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:0.0:1782759989.177040:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212121984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759989.177148:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212121984:12345-0@lo:400:kworker.0 Request processed in 111us (7093us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759989.177167:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00080000:0.0:1782759989.177304:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759989.177346:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212121984:0@lo:400:kworker.0 00000001:00080000:3.0:1782759989.221786:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968234 is committed 00010000:00010000:0.0:1782759989.228092:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759989.684064:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759989.684097:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212122112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759989.684192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759989.684263:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122112 00000100:00100000:3.0:1782759989.684271:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122112 00000100:00100000:3.0:1782759989.684320:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1782759989.684329:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212122112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759989.684367:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782759989.684412:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869355212122112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759989.684433:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1782759989.684485:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170830e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869355212122112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759990.252052:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759991.276210:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759991.557602:0:165654:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd58b251d0 20000000:00000080:3.0:1782759991.557699:0:165654:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171879e1c00 uarg=0000000000000000 00010000:00010000:2.0:1782759991.565078:0:165654:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759991.565118:0:165654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x7:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:2.0:1782759991.565122:0:165654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759991.565134:0:165654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e15c2 lrc: 0/0,0 mode: --/PR res: [0x200000419:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67444 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.565157:0:165654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0x8:0x0].0x0 (ffff9171908a1500) 00010000:00010000:2.0:1782759991.565160:0:165654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759991.565164:0:165654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e15ec lrc: 0/0,0 mode: --/PR res: [0x200000419:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6744b expref: 5 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.565178:0:165654:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 2 locks, left on hash table 0. 10000000:01000000:2.0:1782759991.565210:0:165654:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759991.565223:0:165654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.565236:0:165654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.565245:0:165654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.565298:0:165654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.565553:0:165654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 18 pid: 5796 timeout: 4159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759991.565569:0:165654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165654:1869355212122240:0@lo:104: 00000100:00100000:2.0:1782759991.566426:0:165654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759991.566604:0:165654:0:(client.c:2701:ptlrpc_set_wait()) set ffff917082c90540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759991.567470:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759991.567491:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122240 00000100:00100000:3.0:1782759991.567498:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122240 00000100:00100000:3.0:1782759991.567545:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1782759991.567554:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:165654:x1869355212122240:12345-0@lo:104: 00010000:00010000:3.0:1782759991.567570:0:5783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759991.567656:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759991.567662:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:165654:x1869355212122240:12345-0@lo:104: Request processed in 109us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759991.567669:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1782759991.567944:0:165654:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165654:1869355212122240:0@lo:104: 00010000:00010000:2.0:1782759991.567973:0:165654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.569069:0:5788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759991.569093:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.569104:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030000 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:1.0:1782759991.569108:0:5788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.569119:0:5788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759991.569126:0:5788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759991.569132:0:5788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759991.569229:0:5788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.569236:0:5788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759991.569270:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.569277:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030000/0xdd99f5c4777e1591 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1598 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.569306:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759991.569307:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759991.569309:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759991.569559:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759991.569582:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212122368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759991.569717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759991.569974:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122368 00000100:00100000:1.0:1782759991.569981:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122368 00010000:00010000:1.0:1782759991.570011:0:5785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 19 pid: 5796 timeout: 4159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759991.570099:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1782759991.570109:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212122368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759991.570122:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759991.570127:0:5785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 19 pid: 5796 timeout: 4159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570139:0:5785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 19 pid: 5796 timeout: 4159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570167:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1598 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e1591 expref: 19 pid: 5796 timeout: 4159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570181:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570189:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570205:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570212:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570219:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570225:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570241:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:1.0:1782759991.570245:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570254:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570269:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759991.570279:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759991.570282:0:165654:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759991.570368:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3305:x1869355212122368:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759991.570376:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1782759991.570762:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212122368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759991.571548:0:165654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759991.571556:0:165654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90800/0xdd99f5c4777e1608 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759992.236027:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759992.236069:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212122496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759992.236645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759992.237360:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122496 00000100:00100000:1.0:1782759992.237374:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122496 00000100:00100000:1.0:1782759992.237524:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1782759992.237538:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212122496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759992.237593:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782759992.237678:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212122496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759992.237686:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1782759992.237888:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212122496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759992.237925:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759992.300984:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759992.416173:0:165703:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff64e6f140 20000000:00000080:0.0:1782759992.416197:0:165703:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b312e400 uarg=0000000000000000 00010000:00010000:0.0:1782759992.416617:0:165703:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759992.416635:0:165703:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759992.416654:0:165703:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759992.416674:0:165703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416690:0:165703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416701:0:165703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416708:0:165703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416715:0:165703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416722:0:165703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416729:0:165703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75600 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759992.416734:0:165703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416755:0:165703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416780:0:165703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416789:0:165703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759992.416795:0:165703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e160f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759993.325163:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759993.381768:0:165751:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff77c63910 20000000:00000080:2.0:1782759993.381786:0:165751:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9171b7831000 uarg=0000000000000000 00010000:00010000:2.0:1782759993.382722:0:165751:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759993.382741:0:165751:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759993.382772:0:165751:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759993.382813:0:165751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.385997:0:165751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386015:0:165751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386022:0:165751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386029:0:165751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386037:0:165751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386043:0:165751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90e00 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:2.0:1782759993.386047:0:165751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386053:0:165751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386067:0:165751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386074:0:165751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759993.386081:0:165751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90e00/0xdd99f5c4777e1616 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759993.388021:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759993.388030:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:1.0:1782759993.388036:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759993.388163:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759993.388176:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759993.388188:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759993.388219:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212122624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759993.388286:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759993.388452:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122624 00000100:00100000:0.0:1782759993.388461:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122624 00000100:00100000:0.0:1782759993.388521:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:0.0:1782759993.388531:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212122624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759993.388545:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759993.388558:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e161d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759993.388561:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181a240 going to sleep for 11 seconds 00010000:00010000:0.0:1782759993.388588:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759993.388599:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759993.388608:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75400, rc 0) 00000100:00100000:0.0:1782759993.388663:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212122624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759993.388686:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1782759993.389148:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212122624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759993.389165:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759993.389175:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759993.389193:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759993.389198:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759993.389205:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759994.046661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759994.046697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759994.047904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759994.047945:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411584 00000100:00100000:3.0:1782759994.047955:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411584 00000100:00100000:3.0:1782759994.048014:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2361 00000100:00100000:3.0:1782759994.048024:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197411584:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759994.048158:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197411584:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759994.048174:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2361 00000100:00080000:3.0:1782759994.048197:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759994.049223:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411328 00000100:00100000:0.0:1782759994.049233:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411328 00000100:00100000:0.0:1782759994.049274:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3199 00000100:00100000:0.0:1782759994.049282:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197411328:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759994.049349:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2364:x1869355197411328:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 67us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759994.049356:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3199 00000100:00100000:1.0:1782759994.056271:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411456 00000100:00100000:1.0:1782759994.056299:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411456 00000100:00100000:1.0:1782759994.056402:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2933 00000100:00100000:1.0:1782759994.056415:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197411456:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759994.056515:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2363:x1869355197411456:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 102us (9816us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759994.056524:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2933 00000100:00080000:3.0:1782759994.057024:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759994.287303:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212122752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.287382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759994.287436:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212123264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.287464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759994.287493:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759994.287498:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212123136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.287525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759994.287558:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122752 00000100:00100000:0.0:1782759994.288299:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212122880:0@lo:400:kworker.0 00000100:00100000:0.0:1782759994.288342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759994.288373:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212123392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759994.288397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759994.288418:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759994.288425:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212123008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759994.288449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759994.288483:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123136 00000100:00100000:0.0:1782759994.288489:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123136 00000100:00100000:0.0:1782759994.288550:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123392 00000100:00100000:0.0:1782759994.288553:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123392 00000100:00080000:3.0:1782759994.288688:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759994.288693:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759994.288773:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122752 00000100:00100000:1.0:1782759994.288792:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123264 00000100:00100000:1.0:1782759994.288795:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123264 00000100:00100000:1.0:1782759994.288844:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212122880 00000100:00100000:1.0:1782759994.288847:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212122880 00000100:00100000:1.0:1782759994.288864:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123008 00000100:00100000:1.0:1782759994.288866:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123008 00000100:00100000:1.0:1782759994.288890:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:1.0:1782759994.288902:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212123264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.288973:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3308:x1869355212123264:12345-0@lo:400:kworker.0 Request processed in 72us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759994.288981:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00100000:1.0:1782759994.289003:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:1.0:1782759994.289021:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212122880:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759994.289582:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759994.291224:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212122880:12345-0@lo:400:kworker.0 Request processed in 2201us (2879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759994.291442:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:0.0:1782759994.291456:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212123136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759994.291519:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212123136:12345-0@lo:400:kworker.0 Request processed in 69us (3992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759994.291526:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:0.0:1782759994.291544:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:0.0:1782759994.291561:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212123392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759994.291596:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212123392:12345-0@lo:400:kworker.0 Request processed in 36us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759994.291602:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:2.0:1782759994.296803:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:2.0:1782759994.296852:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212123008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759994.296977:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1869355212123008:12345-0@lo:400:kworker.0 Request processed in 138us (8526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759994.297659:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:1.0:1782759994.297911:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869355212123008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.297927:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212122880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.297940:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212123392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.298316:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212123136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.298329:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869355212123264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.298415:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1782759994.298425:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212122752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759994.298492:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917193325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3308:x1869355212122752:12345-0@lo:400:kworker.0 Request processed in 68us (11110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759994.298499:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1782759994.298542:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917082717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfd399a3-a1a2-417f-89de-b443f9e395e0:3308:1869355212122752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759994.303065:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00010000:00010000:1.0:1782759994.350581:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759994.506886:0:165801:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda6f83470 20000000:00000080:1.0:1782759994.506909:0:165801:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff917084e22800 uarg=0000000000000000 00010000:00010000:1.0:1782759994.508520:0:165801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759994.508539:0:165801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759994.508558:0:165801:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759994.508580:0:165801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759994.508610:0:165801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759994.508619:0:165801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759994.508668:0:165801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759994.508686:0:165801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 18 pid: 5796 timeout: 4162 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759994.508703:0:165801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165801:1869355212123520:0@lo:104: 00000100:00100000:2.0:1782759994.511722:0:165801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759994.511871:0:165801:0:(client.c:2701:ptlrpc_set_wait()) set ffff91708181ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759994.512030:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123520 00000100:00100000:1.0:1782759994.512061:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123520 00000100:00100000:1.0:1782759994.512129:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1782759994.512139:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:165801:x1869355212123520:12345-0@lo:104: 00010000:00010000:1.0:1782759994.512157:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759994.512231:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759994.512238:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfd399a3-a1a2-417f-89de-b443f9e395e0+3:165801:x1869355212123520:12345-0@lo:104: Request processed in 101us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759994.512245:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1782759994.512410:0:165801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165801:1869355212123520:0@lo:104: 00010000:00010000:3.0:1782759994.512435:0:165801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.512496:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759994.512504:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.512511:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc1cbdc20) 10000000:00010000:0.0:1782759994.512515:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.512524:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759994.512532:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759994.512537:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759994.512582:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.512590:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759994.512619:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.512627:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff917180030600/0xdd99f5c4777e161d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd99f5c4777e1624 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.512647:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759994.512664:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759994.512666:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759994.512715:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212123648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759994.512769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759994.513037:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123648 00000100:00100000:0.0:1782759994.513050:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123648 00010000:00010000:0.0:1782759994.513077:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 19 pid: 5796 timeout: 4162 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759994.513110:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1782759994.513120:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3306:x1869355212123648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759994.513132:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759994.513137:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 19 pid: 5796 timeout: 4162 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513149:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 19 pid: 5796 timeout: 4162 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513166:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171b7d75400/0xdd99f5c4777e1624 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd99f5c4777e161d expref: 19 pid: 5796 timeout: 4162 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513180:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513191:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513207:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513214:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513221:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513237:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513243:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc16a4ce0) 00010000:00010000:0.0:1782759994.513247:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513254:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513266:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759994.513277:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759994.513325:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:3306:x1869355212123648:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759994.513332:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1782759994.513366:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfd399a3-a1a2-417f-89de-b443f9e395e0:3306:1869355212123648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759994.513598:0:165801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759994.513607:0:165801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759994.513613:0:165801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030800/0xdd99f5c4777e162b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759994.802993:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212123776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759994.803205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759994.803293:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123776 00000100:00100000:1.0:1782759994.803316:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123776 00000100:00100000:1.0:1782759994.803366:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782759994.803375:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212123776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759994.803414:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1782759994.803464:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212123776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759994.803472:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1782759994.803527:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9170810e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212123776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759995.374261:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759995.885738:0:5798:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759995.885747:0:5798:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91719fc04d40 from 1 10000000:01000000:2.0:1782759995.885752:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759995.885802:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759995.885815:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759995.885849:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759995.885879:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212123904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759995.885979:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759995.886047:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff9171b3461b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759995.886160:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212123904 00000100:00100000:3.0:1782759995.886169:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212123904 00000100:00100000:3.0:1782759995.886222:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:3.0:1782759995.887394:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+18:5798:x1869355212123904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759995.887414:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759995.887433:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e1639 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd99f5c4777e1632 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759995.887460:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e1639 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd99f5c4777e1632 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759995.887472:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcde00/0xdd99f5c4777e1639 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd99f5c4777e1632 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759995.887481:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcde00, rc 0) 00000100:00100000:3.0:1782759995.887549:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:5798:x1869355212123904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759995.887683:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfd399a3-a1a2-417f-89de-b443f9e395e0:5798:1869355212123904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759995.887713:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1639 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759995.887722:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd99f5c4777e1639 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759995.887745:0:5798:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759995.887750:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1639 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759995.887758:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9171c0b90800/0xdd99f5c4777e1632 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd99f5c4777e1639 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759995.895400:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00010000:00010000:1.0:1782759996.396990:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759997.365316:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759997.365339:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212124032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759997.365412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759997.365929:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124032 00000100:00100000:2.0:1782759997.365938:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124032 00000100:00100000:2.0:1782759997.366000:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1782759997.366009:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171bb52b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212124032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759997.366046:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782759997.366096:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171bb52b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212124032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759997.366104:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1782759997.366328:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212124032:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759997.367946:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759997.420092:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759998.444633:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759999.158902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.158961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.158999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.159041:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411968 00000100:00100000:3.0:1782759999.159052:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411968 00000100:00100000:3.0:1782759999.159112:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2364 00000100:00100000:3.0:1782759999.159122:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197411968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759999.159206:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197411968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759999.159213:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2364 00000100:00080000:3.0:1782759999.159231:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759999.159294:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411840 00000100:00100000:2.0:1782759999.159299:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411840 00000100:00100000:0.0:1782759999.159313:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197411712 00000100:00100000:0.0:1782759999.159319:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197411712 00000100:00100000:2.0:1782759999.159359:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2937 00000100:00100000:2.0:1782759999.159367:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197411840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00080000:1.0:1782759999.159374:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759999.159400:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2361:x1869355197411840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759999.159407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2937 00000100:00100000:0.0:1782759999.163248:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3202 00000100:00100000:0.0:1782759999.163270:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197411712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759999.163744:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197411712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 482us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.163752:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3202 00000100:00100000:0.0:1782759999.406518:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212124160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.406603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759999.406666:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212124672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.406693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759999.406723:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782759999.406728:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212124288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.406748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759999.406765:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708182b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212124800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.406787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759999.406816:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212124544:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.406853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759999.406873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759999.406878:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212124416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.406899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759999.406998:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124160 00000100:00100000:0.0:1782759999.407014:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124160 00000100:00100000:0.0:1782759999.407057:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:0.0:1782759999.407066:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212124160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407115:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212124160:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.407122:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:0.0:1782759999.407156:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124672 00000100:00100000:0.0:1782759999.407160:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124672 00000100:00100000:0.0:1782759999.407214:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124288 00000100:00100000:0.0:1782759999.407218:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124288 00000100:00100000:0.0:1782759999.407235:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124416 00000100:00100000:0.0:1782759999.407238:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124416 00000100:00100000:0.0:1782759999.407256:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:0.0:1782759999.407269:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407303:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212124672:12345-0@lo:400:kworker.0 Request processed in 35us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.407309:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:0.0:1782759999.407321:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:0.0:1782759999.407326:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212124288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407354:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212124288:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.407359:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:0.0:1782759999.407370:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:0.0:1782759999.407376:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407404:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212124416:12345-0@lo:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.407410:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:0.0:1782759999.407430:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124800 00000100:00100000:0.0:1782759999.407434:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124800 00000100:00100000:0.0:1782759999.407455:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124544 00000100:00100000:0.0:1782759999.407458:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124544 00000100:00100000:0.0:1782759999.407477:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1782759999.407483:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212124800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407512:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212124800:12345-0@lo:400:kworker.0 Request processed in 29us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.407517:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1782759999.407527:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:0.0:1782759999.407532:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212124544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407558:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212124544:12345-0@lo:400:kworker.0 Request processed in 26us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.407571:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:0.0:1782759999.407626:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212124416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407650:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212124544:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407811:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212124288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407842:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708182b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212124800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407853:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212124160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759999.407863:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212124672:0@lo:400:kworker.0 00000100:00080000:1.0:1782759999.408068:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759999.408072:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759999.408074:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759999.469610:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759999.530595:0:165998:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 65: lfs find -printf %La and --attrs support ========================================================== 15:06:37 (1782759997) 00000100:00100000:3.0:1782759999.699059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.699098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759999.703070:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197412096 00000100:00100000:0.0:1782759999.703085:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197412096 00000100:00100000:0.0:1782759999.703132:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197412352 00000100:00100000:0.0:1782759999.703135:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197412352 00000100:00100000:0.0:1782759999.703158:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2371 00000100:00100000:0.0:1782759999.703168:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197412096:12345-192.168.204.31@tcp:41:mkdir.0 00000004:00000024:0.0:1782759999.703212:0:7487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2250506240 avail 2248409088 00000100:00100000:0.0:1782759999.703862:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2361:x1869355197412096:12345-192.168.204.31@tcp:41:mkdir.0 Request processed in 692us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.703871:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2371 00000100:00100000:0.0:1782759999.703896:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2372 00000100:00100000:0.0:1782759999.703905:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:112769:x1869355197412352:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759999.703943:0:7487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759999.703947:0:7487:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie dd99f5c4777e150c) 00010000:00010000:0.0:1782759999.703957:0:7487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759999.704233:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.704250:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.704343:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.704379:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.704386:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.704392:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759999.714493:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782759999.714515:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.714526:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.714535:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.714930:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782759999.714936:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.714960:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.714979:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:0.0:1782759999.714982:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759999.714987:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.714994:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1640 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759999.715015:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1fb0253 reply state 000000004a2a6030 transno 4294968235 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759999.715025:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759999.715135:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112769:x1869355197412352:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 11227us (16030us total) trans 4294968235 rc 0/0 00000100:00100000:0.0:1782759999.715144:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2372 00010000:00010000:1.0:1782759999.718602:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.718621:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.718640:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.718646:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759999.718650:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.718658:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.718689:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff917182dd1300) 00010000:00010000:1.0:1782759999.718692:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759999.718697:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.718703:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e1647 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759999.745693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759999.746069:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197412480 00000100:00100000:0.0:1782759999.746082:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197412480 00000100:00100000:0.0:1782759999.746154:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2373 00000100:00100000:0.0:1782759999.746164:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:112772:x1869355197412480:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759999.746190:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759999.746214:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e164e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67459 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.747651:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74600/0xdd99f5c4777e1655 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.747695:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74600/0xdd99f5c4777e1655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.747708:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74600/0xdd99f5c4777e1655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759999.747792:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1782759999.747797:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1782759999.747869:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74600/0xdd99f5c4777e1655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.747902:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e164e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67459 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.747921:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74600/0xdd99f5c4777e1655 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67459 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.747929:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:0.0:1782759999.747933:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759999.747936:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74600, rc 0) 00000100:00100000:0.0:1782759999.748639:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112772:x1869355197412480:12345-192.168.204.31@tcp:101:touch.0 Request processed in 2463us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.748649:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2373 00000100:00100000:0.0:1782759999.755114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759999.755352:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197412608 00000100:00100000:2.0:1782759999.755376:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197412608 00000100:00100000:2.0:1782759999.755455:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2374 00000100:00100000:2.0:1782759999.755468:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+7:112772:x1869355197412608:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:2.0:1782759999.755640:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759999.755666:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e165c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67460 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.755730:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.755746:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.755758:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.755773:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.755779:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.755785:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756076:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1671 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756226:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1671 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756234:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1671 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759999.756275:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xa:0x0]: returning size 512 00000004:00200000:2.0:1782759999.756279:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759999.756304:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1671 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756316:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756323:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756330:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756336:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759999.756341:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756348:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756359:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:2.0:1782759999.756369:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759999.756374:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756380:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e1663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756394:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756400:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756468:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756548:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759999.756551:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756558:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756568:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff917191f75300) 00010000:00010000:2.0:1782759999.756571:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759999.756573:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756578:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e166a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756613:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e165c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67460 expref: 9 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756648:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1671 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67460 expref: 8 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.756656:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759999.756659:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759999.756661:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782759999.756744:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+8:112772:x1869355197412608:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1278us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759999.757955:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2374 00000100:00100000:0.0:1782759999.770394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.770569:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197412864 00000100:00100000:3.0:1782759999.770580:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197412864 00000100:00100000:3.0:1782759999.770652:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2375 00000100:00100000:3.0:1782759999.770663:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+8:112772:x1869355197412864:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782759999.770686:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759999.770721:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1678 lrc: 2/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67467 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759999.770909:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 3/0,1 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759999.770925:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 3/0,1 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759999.770937:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 3/0,1 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.771776:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,1 mode: --/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.771791:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.771800:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759999.774312:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38:0x0], index 1: 0 00010000:00010000:2.0:1782759999.774706:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e168d lrc: 3/1,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.774722:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e168d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.774735:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e168d lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.774778:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 3/0,1 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.774798:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 2/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.774806:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 3/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.774812:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759999.774817:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 3/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.775017:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 4/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.775031:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759999.775034:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759999.775039:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 2/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.775046:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e167f lrc: 0/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759999.775061:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4c45d28 reply state 00000000538fe3f2 transno 4294968236 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759999.775069:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759999.775241:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1678 lrc: 0/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67467 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.775260:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e168d lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67467 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.775279:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75800) 00010000:00010000:2.0:1782759999.775282:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759999.775284:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782759999.775396:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+11:112772:x1869355197412864:12345-192.168.204.31@tcp:101:touch.0 Request processed in 4733us (5010us total) trans 4294968236 rc 0/0 00000100:00100000:2.0:1782759999.775544:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2375 00010000:00010000:1.0:1782759999.777089:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.777103:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.777110:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.777115:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759999.777120:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.777127:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.777144:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff917191f75300) 00010000:00010000:1.0:1782759999.777146:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759999.777150:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 2/0,0 mode: --/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.777156:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1686 lrc: 0/0,0 mode: --/PW res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759999.784256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.784456:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197413120 00000100:00100000:3.0:1782759999.784468:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197413120 00000100:00100000:3.0:1782759999.784652:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2376 00000100:00100000:3.0:1782759999.784665:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+10:112772:x1869355197413120:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:3.0:1782759999.784735:0:19544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759999.784766:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e168d lrc: 0/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67467 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759999.784787:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75800) 00010000:00010000:3.0:1782759999.784799:0:19544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759999.784885:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,1 mode: --/PW res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759999.784899:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759999.784908:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759999.785085:0:19544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae95bcb8 reply state 00000000c71077dd transno 4294968237 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759999.785095:0:19544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759999.785200:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+11:112772:x1869355197413120:12345-192.168.204.31@tcp:36:touch.0 Request processed in 537us (955us total) trans 4294968237 rc 0/0 00000100:00100000:3.0:1782759999.785208:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2376 00000100:00100000:2.0:1782759999.791149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1782759999.791233:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.791246:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 2/0,0 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.791263:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.791270:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcdc00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759999.791275:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.791283:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 4/0,0 mode: PW/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.791302:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff9171908a1600) 00010000:00010000:1.0:1782759999.791305:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759999.791308:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 2/0,0 mode: --/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.791313:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e169b lrc: 0/0,0 mode: --/PW res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759999.791517:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197413248 00000100:00100000:0.0:1782759999.791526:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197413248 00000100:00100000:0.0:1782759999.791750:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2377 00000100:00100000:0.0:1782759999.791761:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+10:112772:x1869355197413248:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759999.791789:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759999.791807:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e16a2 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6746e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.792313:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e16a2 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6746e expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.792330:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e16a2 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6746e expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.792348:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917182dd1700) 00010000:00010000:0.0:1782759999.792350:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759999.792353:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75000, rc 0) 00000100:00100000:0.0:1782759999.792421:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+11:112772:x1869355197413248:12345-192.168.204.31@tcp:101:touch.0 Request processed in 663us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759999.792428:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2377 00000100:00100000:1.0:1782759999.796639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782759999.796778:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197413376 00000100:00100000:3.0:1782759999.796791:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197413376 00000100:00100000:3.0:1782759999.796878:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1056 00000100:00100000:3.0:1782759999.796889:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1869355197413376:12345-192.168.204.31@tcp:8:touch.0 00010000:00080000:3.0:1782759999.796927:0:6597:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 95d4477b-602f-4eb6-8798-a97fbce0e608@192.168.204.31@tcp t0 exp 0000000000000000 cur 4068 last 0 00000020:00000080:3.0:1782759999.796971:0:6597:0:(genops.c:1406:class_connect()) connect: client 95d4477b-602f-4eb6-8798-a97fbce0e608, cookie 0xdd99f5c4777e16a9 00002000:00100000:3.0:1782759999.796984:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95d4477b-602f-4eb6-8798-a97fbce0e608/ffff9170836ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782759999.797009:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782759999.797252:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782759999.797286:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9170836cd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759999.797361:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2360:x1869355197413376:12345-192.168.204.31@tcp:8:touch.0 Request processed in 472us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759999.797369:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1056 00000100:00100000:3.0:1782759999.804490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759999.804994:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197413504 00000100:00100000:0.0:1782759999.805008:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197413504 00000100:00100000:0.0:1782759999.805091:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:0.0:1782759999.805103:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917191923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+6:0:x1869355197413504:12345-192.168.204.31@tcp:2:touch.0 00000100:00080000:1.0:1782759999.805465:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782759999.850843:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967436 is committed 00000001:00100000:1.0:1782759999.851257:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000100:00100000:0.0:1782759999.851502:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917191923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+5:0:x1869355197413504:12345-192.168.204.31@tcp:2:touch.0 Request processed in 46395us (47016us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1782759999.851514:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1057 00000100:00100000:2.0:1782759999.858103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759999.858217:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197413760 00000100:00100000:1.0:1782759999.858231:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197413760 00000100:00100000:1.0:1782759999.858318:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 418 00000100:00100000:1.0:1782759999.858330:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+11:112772:x1869355197413760:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782759999.858776:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+12:112772:x1869355197413760:12345-192.168.204.31@tcp:35:touch.0 Request processed in 447us (684us total) trans 4294968238 rc 0/0 00000100:00100000:1.0:1782759999.858799:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 418 00000100:00100000:1.0:1782759999.893316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759999.894299:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197414016 00000100:00100000:0.0:1782759999.894479:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197414016 00000100:00100000:0.0:1782759999.894743:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2378 00000100:00100000:0.0:1782759999.894755:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+12:112773:x1869355197414016:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:0.0:1782759999.894789:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759999.894950:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e16b0 lrc: 2/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67475 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.895374:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 3/0,1 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.895490:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.895505:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.895522:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,1 mode: --/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.895529:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.895537:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759999.898028:0:7487:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39:0x0], index 0: 0 00010000:00010000:1.0:1782759999.898251:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e16c5 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898269:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e16c5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898292:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e16c5 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898334:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 3/0,1 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898342:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 2/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898348:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 3/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898353:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759999.898357:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 3/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898364:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 4/0,0 mode: CW/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898378:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff917191f75900) 00010000:00010000:1.0:1782759999.898381:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759999.898387:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 2/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898392:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16b7 lrc: 0/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759999.898406:0:7487:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9907d00 reply state 000000002828ec96 transno 4294968239 ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759999.898415:0:7487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759999.898460:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e16b0 lrc: 0/0,0 mode: --/CW res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67475 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898478:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e16c5 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67475 expref: 14 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.898485:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:1.0:1782759999.898487:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759999.898490:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030e00, rc 0) 00000100:00100000:1.0:1782759999.898597:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+15:112773:x1869355197414016:12345-192.168.204.31@tcp:101:touch.0 Request processed in 3844us (5305us total) trans 4294968239 rc 0/0 00000100:00100000:1.0:1782759999.898606:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2378 00000100:00100000:3.0:1782759999.909737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782759999.909908:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197414272 00000100:00100000:0.0:1782759999.909919:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197414272 00000100:00100000:0.0:1782759999.909979:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2379 00000100:00100000:0.0:1782759999.909991:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+15:112773:x1869355197414272:12345-192.168.204.31@tcp:36:touch.0 00010000:00010000:0.0:1782759999.910064:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759999.910122:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030e00/0xdd99f5c4777e16c5 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67475 expref: 15 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.910144:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5d00) 00010000:00010000:0.0:1782759999.910157:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759999.910218:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,1 mode: --/PW res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.910232:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759999.910241:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759999.912013:0:5801:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb2bcaea reply state 00000000e3cfea62 transno 4294968240 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759999.912032:0:5801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759999.912095:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.912108:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 2/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.912117:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.912123:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917180030800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759999.912129:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.912138:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 4/0,0 mode: PW/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.912154:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff9171889c5500) 00010000:00010000:1.0:1782759999.912158:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759999.912171:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 2/0,0 mode: --/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.912178:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030800/0xdd99f5c4777e16be lrc: 0/0,0 mode: --/PW res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759999.912232:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+15:112773:x1869355197414272:12345-192.168.204.31@tcp:36:touch.0 Request processed in 2239us (2503us total) trans 4294968240 rc 0/0 00000100:00100000:0.0:1782759999.912243:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2379 00010000:00010000:1.0:1782759999.915727:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.915751:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.915759:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.915765:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782759999.915771:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.915780:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.915803:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1000) 00010000:00010000:1.0:1782759999.915807:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759999.915813:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 2/0,0 mode: --/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.915818:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e16d3 lrc: 0/0,0 mode: --/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759999.916324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759999.917051:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197414400 00000100:00100000:1.0:1782759999.917060:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197414400 00000100:00100000:1.0:1782759999.917124:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2380 00000100:00100000:2.0:1782759999.917132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759999.917147:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+14:112773:x1869355197414400:12345-192.168.204.31@tcp:101:touch.0 00000100:00100000:2.0:1782759999.917148:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212124928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759999.917172:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759999.917191:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16da lrc: 2/0,0 mode: --/CR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6747c expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759999.917201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759999.917265:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212124928 00000100:00100000:2.0:1782759999.917269:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212124928 00000100:00100000:2.0:1782759999.917296:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:2.0:1782759999.917303:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212124928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759999.917318:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00010000:00010000:1.0:1782759999.917359:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16da lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6747c expref: 15 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759999.917369:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212124928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759999.917375:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00010000:00010000:1.0:1782759999.917376:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16da lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6747c expref: 15 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759999.917398:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:1.0:1782759999.917402:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759999.917405:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917180030600, rc 0) 00000100:00100000:1.0:1782759999.917591:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95d4477b-602f-4eb6-8798-a97fbce0e608+15:112773:x1869355197414400:12345-192.168.204.31@tcp:101:touch.0 Request processed in 444us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759999.917598:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2380 00000100:00100000:0.0:1782759999.917737:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91719fc17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212124928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759999.926302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759999.926447:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197414528 00000100:00100000:1.0:1782759999.926458:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197414528 00000100:00100000:1.0:1782759999.926521:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00100000:1.0:1782759999.926532:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+6:2364:x1869355197414528:12345-192.168.204.31@tcp:2:touch.0 00000100:00100000:0.0:1782759999.927290:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+7:2364:x1869355197414528:12345-192.168.204.31@tcp:2:touch.0 Request processed in 755us (995us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1782759999.927301:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1058 00000100:00100000:2.0:1782759999.935036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782759999.935539:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197414784 00000100:00100000:1.0:1782759999.935551:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197414784 00000100:00100000:1.0:1782759999.935697:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 419 00000100:00100000:1.0:1782759999.935709:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+15:112773:x1869355197414784:12345-192.168.204.31@tcp:35:touch.0 00000100:00100000:1.0:1782759999.936426:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+16:112773:x1869355197414784:12345-192.168.204.31@tcp:35:touch.0 Request processed in 717us (1404us total) trans 4294968241 rc 0/0 00000100:00100000:1.0:1782759999.936447:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 419 00000100:00100000:3.0:1782759999.979703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759999.979865:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197414912 00000100:00100000:2.0:1782759999.979888:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197414912 00000100:00100000:2.0:1782759999.980119:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2381 00000100:00100000:2.0:1782759999.980129:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+16:112774:x1869355197414912:12345-192.168.204.31@tcp:101:chattr.0 00010000:00010000:2.0:1782759999.980162:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759999.980195:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e16e1 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67483 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980266:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980402:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980417:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980436:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980444:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980451:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980707:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980717:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.980725:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759999.981050:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:2.0:1782759999.981055:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782759999.981103:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981126:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981136:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981215:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981224:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981230:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759999.981234:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981242:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981256:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff917191f75900) 00010000:00010000:2.0:1782759999.981260:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759999.981265:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981272:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e16e8 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981357:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981364:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981376:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981382:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782759999.981385:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981391:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981400:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917191f75500) 00010000:00010000:2.0:1782759999.981403:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759999.981406:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981412:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e16ef lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981449:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90400/0xdd99f5c4777e16e1 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67483 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981464:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67483 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.981471:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:2.0:1782759999.981473:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759999.981475:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91600, rc 0) 00000100:00100000:2.0:1782759999.981701:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+17:112774:x1869355197414912:12345-192.168.204.31@tcp:101:chattr.0 Request processed in 1571us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759999.981720:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2381 00000100:00100000:0.0:1782759999.997071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782759999.997428:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197415040 00000100:00100000:2.0:1782759999.997441:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197415040 00000100:00100000:2.0:1782759999.997509:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1059 00000100:00100000:2.0:1782759999.997520:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:2362:x1869355197415040:12345-192.168.204.31@tcp:101:chattr.0 00010000:00010000:2.0:1782759999.997539:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759999.997560:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e16fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6748a expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759999.997587:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x6a42c23f, atime: 0x6a42c23f, ctime: 0x6a42c23f, blocks: 0x1 00010000:00010000:2.0:1782759999.997610:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=4068s v=(0 0) 00010000:00010000:2.0:1782759999.997615:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759999.997635:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e16fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6748a expref: 8 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.997654:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e16fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6748a expref: 8 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759999.997668:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782759999.997733:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+8:2362:x1869355197415040:12345-192.168.204.31@tcp:101:chattr.0 Request processed in 215us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759999.997740:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1059 00000100:00100000:3.0:1782760000.003653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760000.004198:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197415296 00000100:00100000:2.0:1782760000.004208:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197415296 00000100:00100000:2.0:1782760000.004395:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2382 00000100:00100000:2.0:1782760000.004407:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+17:112774:x1869355197415296:12345-192.168.204.31@tcp:101:chattr.0 00010000:00010000:2.0:1782760000.004437:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760000.004462:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1704 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67491 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.004561:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e170b lrc: 3/1,0 mode: --/CR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.004578:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e170b lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.004590:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e170b lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760000.004601:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00010000:00010000:2.0:1782760000.004754:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1704 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67491 expref: 20 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.004773:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e170b lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67491 expref: 19 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.004782:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:2.0:1782760000.004786:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782760000.004789:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782760000.004918:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95d4477b-602f-4eb6-8798-a97fbce0e608+19:112774:x1869355197415296:12345-192.168.204.31@tcp:101:chattr.0 Request processed in 512us (1274us total) trans 4294968242 rc 0/0 00000100:00100000:2.0:1782760000.004925:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2382 00000100:00100000:3.0:1782760000.012475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760000.012777:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197415424 00000100:00100000:2.0:1782760000.012789:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197415424 00000100:00100000:2.0:1782760000.013184:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 420 00000100:00100000:2.0:1782760000.013210:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+19:112774:x1869355197415424:12345-192.168.204.31@tcp:33:chattr.0 00000100:00100000:2.0:1782760000.013364:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d4477b-602f-4eb6-8798-a97fbce0e608+19:112774:x1869355197415424:12345-192.168.204.31@tcp:33:chattr.0 Request processed in 157us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760000.013372:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 420 00000100:00100000:1.0:1782760000.020391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760000.020506:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197415680 00000100:00100000:0.0:1782760000.020517:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197415680 00000100:00100000:0.0:1782760000.020616:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2383 00000100:00100000:0.0:1782760000.020637:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+19:112774:x1869355197415680:12345-192.168.204.31@tcp:36:chattr.0 00010000:00010000:0.0:1782760000.020702:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782760000.020743:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e16f6 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67483 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760000.020767:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:0.0:1782760000.020773:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782760000.020799:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,1 mode: --/PW res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760000.020816:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760000.020894:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782760000.021127:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be9aa883 reply state 000000005fd07f96 transno 4294968243 ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782760000.021151:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782760000.021257:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+20:112774:x1869355197415680:12345-192.168.204.31@tcp:36:chattr.0 Request processed in 632us (877us total) trans 4294968243 rc 0/0 00000100:00100000:0.0:1782760000.021264:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2383 00000100:00100000:3.0:1782760000.023601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1782760000.024146:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,1 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.024160:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 2/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.024167:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.024173:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760000.024178:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 3/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.024186:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 4/0,0 mode: PW/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.024202:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:2.0:1782760000.024205:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760000.024209:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 2/0,0 mode: --/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760000.024216:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1719 lrc: 0/0,0 mode: --/PW res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782760000.024567:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197415808 00000100:00100000:1.0:1782760000.024577:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197415808 00000100:00100000:1.0:1782760000.024754:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1060 00000100:00100000:1.0:1782760000.024765:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+8:2361:x1869355197415808:12345-192.168.204.31@tcp:2:chattr.0 00002000:00010000:1.0:1782760000.025154:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782760000.025157:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1782759999 -> 1782759999 00002000:00010000:1.0:1782760000.025160:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 1782759999 -> 1782759999 00002000:00010000:1.0:1782760000.025162:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1782759999 -> 1782759999 00002000:00010000:1.0:1782760000.025164:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782760000.025226:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+9:2361:x1869355197415808:12345-192.168.204.31@tcp:2:chattr.0 Request processed in 462us (1632us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1782760000.025233:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1060 00010000:00010000:0.0:1782760000.494962:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782760001.521140:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782760001.544172:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967452 is committed 00000100:00100000:2.0:1782760002.257963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.258204:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197416064 00000100:00100000:3.0:1782760002.258216:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197416064 00000100:00100000:3.0:1782760002.258306:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 421 00000100:00080000:1.0:1782760002.258306:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782760002.258319:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+19:112801:x1869355197416064:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:3.0:1782760002.258588:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95d4477b-602f-4eb6-8798-a97fbce0e608+20:112801:x1869355197416064:12345-192.168.204.31@tcp:35:umount.0 Request processed in 260us (624us total) trans 4294968244 rc 0/0 00000100:00100000:3.0:1782760002.258597:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 421 00000100:00100000:2.0:1782760002.261777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.262290:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197416320 00000100:00100000:1.0:1782760002.262302:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197416320 00000100:00100000:1.0:1782760002.262363:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 422 00000100:00100000:1.0:1782760002.262374:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+20:112801:x1869355197416320:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:1.0:1782760002.262909:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+21:112801:x1869355197416320:12345-192.168.204.31@tcp:35:umount.0 Request processed in 535us (1141us total) trans 4294968245 rc 0/0 00000100:00100000:1.0:1782760002.262917:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 422 00000100:00100000:2.0:1782760002.267628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.267746:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197416576 00000100:00100000:0.0:1782760002.267757:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197416576 00000100:00100000:0.0:1782760002.267815:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 423 00000100:00100000:0.0:1782760002.267849:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+21:112801:x1869355197416576:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:0.0:1782760002.268321:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+22:112801:x1869355197416576:12345-192.168.204.31@tcp:35:umount.0 Request processed in 496us (706us total) trans 4294968246 rc 0/0 00000100:00100000:0.0:1782760002.268330:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 423 00000100:00100000:3.0:1782760002.271906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.272027:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197416832 00000100:00100000:1.0:1782760002.272040:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197416832 00000100:00100000:1.0:1782760002.272111:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 424 00000100:00100000:1.0:1782760002.272137:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+22:112801:x1869355197416832:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:1.0:1782760002.272428:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+23:112801:x1869355197416832:12345-192.168.204.31@tcp:35:umount.0 Request processed in 293us (529us total) trans 4294968247 rc -1/-1 00000100:00100000:1.0:1782760002.272437:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 424 00000100:00100000:2.0:1782760002.294171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.294213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.294254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.294348:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197417088 00000100:00100000:1.0:1782760002.294359:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197417088 00000100:00100000:1.0:1782760002.294410:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197417216 00000100:00100000:1.0:1782760002.294414:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197417216 00000100:00100000:1.0:1782760002.294438:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:1.0:1782760002.294448:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c276a8fc-707b-4100-a499-42c8469183db+11:2361:x1869355197417088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782760002.294464:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782760002.294483:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90c00/0xdd99f5c4777e0ead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672ae expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.294501:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782760002.294551:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c276a8fc-707b-4100-a499-42c8469183db+10:2361:x1869355197417088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.294559:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 196 00000100:00100000:1.0:1782760002.294590:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 197 00000100:00100000:1.0:1782760002.294597:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917186c17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c276a8fc-707b-4100-a499-42c8469183db+9:2361:x1869355197417216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782760002.294604:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782760002.294613:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b91c00/0xdd99f5c4777e0eb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672d8 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.294622:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782760002.294642:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917186c17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c276a8fc-707b-4100-a499-42c8469183db+8:2361:x1869355197417216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.294666:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 197 00000100:00100000:0.0:1782760002.295194:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197416960 00000100:00100000:0.0:1782760002.295201:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197416960 00000100:00100000:0.0:1782760002.295251:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1061 00000100:00100000:0.0:1782760002.295259:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2360:x1869355197416960:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1782760002.295286:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777e16a9 00000100:00080000:0.0:1782760002.295295:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9170836cd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782760002.295335:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967436 00000100:00100000:0.0:1782760002.295630:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d4477b-602f-4eb6-8798-a97fbce0e608+2:2360:x1869355197416960:12345-192.168.204.31@tcp:9:umount.0 Request processed in 371us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.295638:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1061 00010000:00010000:0.0:1782760002.295664:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782760002.295673:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782760002.298720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.298799:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197417344 00000100:00100000:3.0:1782760002.298808:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197417344 00000100:00100000:3.0:1782760002.298910:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00100000:3.0:1782760002.298921:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c276a8fc-707b-4100-a499-42c8469183db+8:2362:x1869355197417344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782760002.298936:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782760002.299145:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff917180030200/0xdd99f5c4777e0ebb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672df expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.299161:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782760002.299218:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c276a8fc-707b-4100-a499-42c8469183db+7:2362:x1869355197417344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 298us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.299225:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 198 00000100:00100000:0.0:1782760002.300680:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.300787:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197417728 00000100:00100000:2.0:1782760002.300794:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197417728 00000100:00100000:2.0:1782760002.300887:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1062 00000100:00100000:2.0:1782760002.300911:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+7:2360:x1869355197417728:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1782760002.300939:0:9120:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777e0fcc 00000020:00010000:2.0:1782760002.301085:0:9120:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917082ef6000: total 0 00000100:00080000:2.0:1782760002.301091:0:9120:0:(import.c:65:import_set_state_nolock()) ffff917082ef5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782760002.301134:0:9120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967452 00000100:00100000:2.0:1782760002.301395:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+5:2360:x1869355197417728:12345-192.168.204.31@tcp:9:umount.0 Request processed in 492us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760002.301402:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1062 00000020:00010000:1.0:1782760002.302470:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917082ef6000: total 0 00010000:00010000:1.0:1782760002.302477:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782760002.302517:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917082ef6000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782760002.302587:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd79f7d/0xdd99f5c4777e1019 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6733a expref: 4 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.302627:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f07f17c/0xdd99f5c4777e16fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6748a expref: 3 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.302649:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917082ef6000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782760002.302660:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782760002.302662:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782760002.302664:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782760002.302733:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782760002.311699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.312418:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197419136 00000100:00100000:0.0:1782760002.312429:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197419136 00000100:00100000:0.0:1782760002.312539:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2384 00000100:00100000:0.0:1782760002.312549:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+23:2360:x1869355197419136:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:0.0:1782760002.312599:0:7487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777e0ec2 00000020:00010000:0.0:1782760002.312609:0:7487:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91708297c800: total 0 00000100:00080000:0.0:1782760002.312613:0:7487:0:(import.c:65:import_set_state_nolock()) ffff91708297d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782760002.312639:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968247 00000020:00010000:3.0:1782760002.313014:0:7496:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91708297c800: total 0 00010000:00010000:3.0:1782760002.313072:0:7496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91708297c800, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1782760002.313111:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00000100:00100000:0.0:1782760002.313114:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d4477b-602f-4eb6-8798-a97fbce0e608+22:2360:x1869355197419136:12345-192.168.204.31@tcp:39:umount.0 Request processed in 564us (1422us total) trans 4294968248 rc 0/0 00010000:00010000:3.0:1782760002.313117:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00000100:00100000:0.0:1782760002.313125:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2384 00010000:00010000:3.0:1782760002.313141:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e170b lrc: 0/0,0 mode: --/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67491 expref: 21 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.313163:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff917191f75900) 00010000:00010000:3.0:1782760002.313165:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782760002.313169:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1671 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67460 expref: 20 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.313187:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff9171889c5c00) 00010000:00010000:3.0:1782760002.313189:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782760002.313193:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917180030600/0xdd99f5c4777e16da lrc: 0/0,0 mode: --/CR res: [0x200000419:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6747c expref: 19 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.313209:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917182dd1700) 00010000:00010000:3.0:1782760002.313211:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782760002.313215:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75000/0xdd99f5c4777e16a2 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6746e expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.313231:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917182dd1900) 00010000:00010000:3.0:1782760002.313234:0:7496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782760002.313238:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74600/0xdd99f5c4777e1655 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67459 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.313264:0:7496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91708297c800, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1782760002.313281:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782760002.313292:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782760002.313295:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782760002.333943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.334894:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197419392 00000100:00100000:3.0:1782760002.334906:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197419392 00000100:00100000:3.0:1782760002.334993:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3204 00000100:00100000:3.0:1782760002.335003:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+7:2360:x1869355197419392:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:3.0:1782760002.335048:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdd99f5c4777e0e9f 00000020:00010000:3.0:1782760002.335056:0:5794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff917082d3c000: total 0 00000100:00080000:3.0:1782760002.335060:0:5794:0:(import.c:65:import_set_state_nolock()) ffff917082d38800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1782760002.335135:0:5788:0:(genops.c:1928:obd_stale_export_get()) Get export ffff917082d3c000: total 0 00000100:00100000:3.0:1782760002.335163:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c276a8fc-707b-4100-a499-42c8469183db+3:2360:x1869355197419392:12345-192.168.204.31@tcp:251:umount.0 Request processed in 161us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.335174:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3204 00010000:00010000:1.0:1782760002.335193:0:5788:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff917082d3c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782760002.335239:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9171c0b90600/0xdd99f5c4777e0ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf672a7 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.335258:0:5788:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff917082d3c000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782760002.335268:0:5788:0:(genops.c:906:class_export_put()) final put ffff917082d3c000/c276a8fc-707b-4100-a499-42c8469183db 00010000:00010000:1.0:1782760002.335342:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782760002.335345:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782760002.335347:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782760002.335492:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917082d3c000/c276a8fc-707b-4100-a499-42c8469183db for MGS 00000020:00000080:3.0:1782760002.335532:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082d38800 for MGS 00000100:00100000:3.0:1782760002.476226:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782760002.476250:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212125056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782760002.476323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782760002.476373:0:17964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125056 00000100:00100000:1.0:1782760002.476384:0:17964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125056 00000100:00080000:2.0:1782760002.476442:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782760002.476461:0:17964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:1.0:1782760002.476485:0:17964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212125056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782760002.476532:0:17964:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782760002.476598:0:17964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869355212125056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.476605:0:17964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:3.0:1782760002.476643:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869355212125056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782760002.506615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.506746:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197419520 00000100:00100000:0.0:1782760002.506758:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197419520 00000100:00100000:0.0:1782760002.506812:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3205 00000100:00100000:0.0:1782760002.506850:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1869355197419520:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782760002.506882:0:5793:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 94643b7b-438a-4447-ad1a-fe740051622c@192.168.204.31@tcp t0 exp 0000000000000000 cur 4070 last 0 00000020:00000080:0.0:1782760002.507092:0:5793:0:(genops.c:1406:class_connect()) connect: client 94643b7b-438a-4447-ad1a-fe740051622c, cookie 0xdd99f5c4777e1720 00000100:00080000:0.0:1782760002.507143:0:5793:0:(import.c:65:import_set_state_nolock()) ffff917082978800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782760002.507220:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+5:2360:x1869355197419520:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 399us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.507228:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3205 00000100:00100000:2.0:1782760002.524296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.524405:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197419648 00000100:00100000:0.0:1782760002.524416:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197419648 00000100:00100000:0.0:1782760002.524478:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3206 00000100:00100000:0.0:1782760002.524489:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+5:112814:x1869355197419648:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782760002.524527:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782760002.524543:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf674a6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760002.524588:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674a6 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760002.524600:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75200/0xdd99f5c4777e1727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674a6 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760002.524610:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75200, rc 0) 00000100:00100000:0.0:1782760002.524669:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+6:112814:x1869355197419648:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 182us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.524676:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3206 00000100:00100000:2.0:1782760002.534094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.534192:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197419776 00000100:00100000:0.0:1782760002.534202:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197419776 00000100:00100000:0.0:1782760002.534256:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3207 00000100:00100000:0.0:1782760002.534267:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+6:112814:x1869355197419776:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782760002.534539:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+6:112814:x1869355197419776:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 273us (454us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782760002.534548:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3207 00000100:00100000:1.0:1782760002.536963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.537103:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197419904 00000100:00100000:3.0:1782760002.537112:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197419904 00000100:00100000:3.0:1782760002.537170:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3208 00000100:00100000:3.0:1782760002.537180:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+6:112814:x1869355197419904:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782760002.537199:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760002.537218:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e172e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf674ad expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.537253:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674ad expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.537264:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7dcd600/0xdd99f5c4777e172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674ad expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.537291:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd600, rc 0) 00000100:00100000:3.0:1782760002.537350:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+7:112814:x1869355197419904:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 171us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.537358:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3208 00000100:00100000:2.0:1782760002.539246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.539363:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420032 00000100:00100000:3.0:1782760002.539371:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420032 00000100:00100000:3.0:1782760002.539425:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3209 00000100:00100000:3.0:1782760002.539434:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+7:112814:x1869355197420032:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782760002.539777:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+8:112814:x1869355197420032:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 343us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.539786:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3209 00010000:00010000:3.0:1782760002.540118:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782760002.545762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.545884:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420160 00000100:00100000:0.0:1782760002.545991:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420160 00000100:00100000:0.0:1782760002.546051:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3210 00000100:00100000:0.0:1782760002.546060:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+8:112814:x1869355197420160:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782760002.546595:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+8:112814:x1869355197420160:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 533us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.546610:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3210 00000100:00100000:0.0:1782760002.551211:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.551437:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420288 00000100:00100000:1.0:1782760002.551449:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420288 00000100:00100000:1.0:1782760002.551498:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3211 00000100:00100000:1.0:1782760002.551507:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+8:112833:x1869355197420288:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782760002.552150:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+8:112833:x1869355197420288:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 640us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.552160:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3211 00000100:00100000:2.0:1782760002.565125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.565226:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420416 00000100:00100000:0.0:1782760002.565238:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420416 00000100:00100000:0.0:1782760002.565299:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3212 00000100:00100000:0.0:1782760002.565309:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+8:112833:x1869355197420416:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782760002.565627:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+8:112833:x1869355197420416:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 317us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.565635:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3212 00000100:00100000:2.0:1782760002.575319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.578064:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420544 00000100:00100000:3.0:1782760002.578086:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420544 00000100:00100000:3.0:1782760002.578181:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3213 00000100:00100000:3.0:1782760002.578192:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+8:112833:x1869355197420544:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782760002.578485:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+8:112833:x1869355197420544:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 294us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.578494:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3213 00000100:00100000:1.0:1782760002.584946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.585101:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420672 00000100:00100000:0.0:1782760002.585113:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420672 00000100:00100000:0.0:1782760002.585176:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3214 00000100:00100000:0.0:1782760002.585187:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+8:112814:x1869355197420672:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782760002.585207:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782760002.585223:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e1735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf674d7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760002.585253:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e1735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674d7 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760002.585266:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171b7d75600/0xdd99f5c4777e1735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674d7 expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760002.585276:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d75600, rc 0) 00000100:00100000:0.0:1782760002.585341:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+9:112814:x1869355197420672:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 156us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.585365:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3214 00000100:00100000:2.0:1782760002.594226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.594341:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420800 00000100:00100000:1.0:1782760002.594351:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420800 00000100:00100000:1.0:1782760002.594413:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3215 00000100:00100000:1.0:1782760002.594422:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+9:112814:x1869355197420800:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782760002.594448:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782760002.594472:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782760002.594476:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782760002.594479:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782760002.594481:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782760002.606027:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+9:112814:x1869355197420800:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 11593us (11802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.606058:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3215 00000100:00100000:0.0:1782760002.609784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.609983:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197420928 00000100:00100000:3.0:1782760002.609994:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197420928 00000100:00100000:2.0:1782760002.610242:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3216 00000100:00100000:2.0:1782760002.610253:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+9:112814:x1869355197420928:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782760002.610296:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760002.610313:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e173c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf674de expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.610338:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e173c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674de expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.610347:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9171c0b90400/0xdd99f5c4777e173c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf674de expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.610354:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90400, rc 0) 00000100:00100000:2.0:1782760002.610405:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+10:112814:x1869355197420928:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 155us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760002.610410:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3216 00000100:00100000:2.0:1782760002.616474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.616624:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421056 00000100:00100000:1.0:1782760002.616635:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421056 00000100:00100000:1.0:1782760002.616696:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3217 00000100:00100000:1.0:1782760002.616706:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+10:112814:x1869355197421056:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782760002.617049:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94643b7b-438a-4447-ad1a-fe740051622c+10:112814:x1869355197421056:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 343us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.617058:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3217 00000100:00100000:3.0:1782760002.621512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.621703:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421184 00000100:00100000:2.0:1782760002.621715:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421184 00000100:00100000:2.0:1782760002.621871:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3218 00000100:00100000:2.0:1782760002.621882:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+10:112814:x1869355197421184:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782760002.622191:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+10:112814:x1869355197421184:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 311us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760002.622199:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3218 00000100:00100000:2.0:1782760002.626311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.626547:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421312 00000100:00100000:0.0:1782760002.626788:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421312 00000100:00100000:0.0:1782760002.627039:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3219 00000100:00100000:0.0:1782760002.627051:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+10:112838:x1869355197421312:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782760002.627381:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94643b7b-438a-4447-ad1a-fe740051622c+10:112838:x1869355197421312:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 330us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.627390:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3219 00000100:00100000:3.0:1782760002.631333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.631443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421440 00000100:00100000:2.0:1782760002.631454:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421440 00000100:00100000:2.0:1782760002.631519:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3220 00000100:00100000:2.0:1782760002.631529:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+10:112838:x1869355197421440:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782760002.632136:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94643b7b-438a-4447-ad1a-fe740051622c+10:112838:x1869355197421440:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 606us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760002.632145:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3220 00000100:00100000:3.0:1782760002.637994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.638375:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421568 00000100:00100000:0.0:1782760002.638385:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421568 00000100:00100000:0.0:1782760002.638436:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2385 00000100:00100000:0.0:1782760002.638444:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1869355197421568:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782760002.638476:0:5801:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 6c0ec5a4-d5fe-4115-a75b-183a59675c7a@192.168.204.31@tcp t0 exp 0000000000000000 cur 4071 last 0 00000020:00000080:0.0:1782760002.638523:0:5801:0:(genops.c:1406:class_connect()) connect: client 6c0ec5a4-d5fe-4115-a75b-183a59675c7a, cookie 0xdd99f5c4777e1743 00000004:00100000:0.0:1782760002.638651:0:5801:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782760002.638856:0:5801:0:(import.c:65:import_set_state_nolock()) ffff91708297c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782760002.639466:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:2360:x1869355197421568:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1018us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.639477:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2385 00000100:00100000:0.0:1782760002.646939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.647366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.647429:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421696 00000100:00100000:0.0:1782760002.647441:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421696 00000100:00100000:0.0:1782760002.647592:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421824 00000100:00100000:0.0:1782760002.647596:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421824 00000100:00100000:3.0:1782760002.647614:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2386 00000100:00100000:3.0:1782760002.647629:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:0:x1869355197421696:12345-192.168.204.31@tcp:41:mount.lustre.0 00000100:00080000:2.0:1782760002.647634:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1782760002.647678:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2250506240 avail 2248409088 00000100:00100000:0.0:1782760002.647726:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2387 00000100:00100000:0.0:1782760002.647734:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112814:x1869355197421824:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782760002.647750:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2250506240 avail 2248409088 00000100:00100000:3.0:1782760002.647765:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:0:x1869355197421696:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 141us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.647773:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112814:x1869355197421824:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.647774:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2386 00000100:00100000:0.0:1782760002.647779:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2387 00000100:00100000:0.0:1782760002.652820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.653289:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197421952 00000100:00100000:1.0:1782760002.653300:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197421952 00000100:00100000:1.0:1782760002.653373:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2388 00000100:00100000:1.0:1782760002.653387:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:112814:x1869355197421952:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782760002.654318:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:112814:x1869355197421952:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 929us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.654330:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2388 00000100:00100000:2.0:1782760002.661900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.661961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1782760002.662162:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422080 00000100:00100000:1.0:1782760002.662173:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422080 00000100:00100000:1.0:1782760002.662227:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422208 00000100:00100000:1.0:1782760002.662231:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422208 00000100:00100000:1.0:1782760002.662256:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1063 00000100:00100000:1.0:1782760002.662264:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708324b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355197422080:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782760002.662299:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 6c0ec5a4-d5fe-4115-a75b-183a59675c7a@192.168.204.31@tcp t0 exp 0000000000000000 cur 4071 last 0 00000020:00000080:1.0:1782760002.662331:0:6599:0:(genops.c:1406:class_connect()) connect: client 6c0ec5a4-d5fe-4115-a75b-183a59675c7a, cookie 0xdd99f5c4777e174a 00002000:00100000:1.0:1782760002.662342:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6c0ec5a4-d5fe-4115-a75b-183a59675c7a/ffff917082ef7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782760002.662371:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782760002.662495:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782760002.662529:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082ef2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782760002.662676:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708324b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:2360:x1869355197422080:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 410us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.662684:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1063 00000100:00100000:1.0:1782760002.662703:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1064 00000100:00100000:1.0:1782760002.662708:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1869355197422208:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782760002.662724:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 6c0ec5a4-d5fe-4115-a75b-183a59675c7a@192.168.204.31@tcp t0 exp 0000000000000000 cur 4071 last 0 00000020:00000080:1.0:1782760002.662742:0:6599:0:(genops.c:1406:class_connect()) connect: client 6c0ec5a4-d5fe-4115-a75b-183a59675c7a, cookie 0xdd99f5c4777e1751 00002000:00100000:1.0:1782760002.662751:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6c0ec5a4-d5fe-4115-a75b-183a59675c7a/ffff917082ef4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782760002.662771:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782760002.663229:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782760002.663248:0:6599:0:(import.c:65:import_set_state_nolock()) ffff917082ef0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782760002.663283:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:2360:x1869355197422208:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 573us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760002.663291:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1064 00000100:00100000:2.0:1782760002.665188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.665805:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422336 00000100:00100000:0.0:1782760002.665820:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422336 00000100:00100000:0.0:1782760002.666064:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 425 00000100:00100000:0.0:1782760002.666075:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:112814:x1869355197422336:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782760002.666178:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000100:00100000:0.0:1782760002.666292:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:112814:x1869355197422336:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 218us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.666301:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 425 00000100:00100000:3.0:1782760002.802508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.802736:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422464 00000100:00100000:2.0:1782760002.802748:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422464 00000100:00100000:2.0:1782760002.802880:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2389 00000100:00100000:2.0:1782760002.803025:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:112855:x1869355197422464:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:2.0:1782760002.803048:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760002.803072:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67508 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.803138:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e175f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.803152:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e175f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.803176:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e175f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760002.803242:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1782760002.803246:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1782760002.803271:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e175f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.803317:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67508 expref: 8 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.803337:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e175f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67508 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.803346:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75600) 00010000:00010000:2.0:1782760002.803350:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782760002.803353:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90c00, rc 0) 00000100:00100000:2.0:1782760002.803427:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112855:x1869355197422464:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 531us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760002.803434:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2389 00000100:00100000:1.0:1782760002.829675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760002.830037:0:135215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422592 00000100:00100000:0.0:1782760002.830047:0:135215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422592 00000100:00100000:0.0:1782760002.830109:0:135215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:0.0:1782760002.830120:0:135215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112855:x1869355197422592:12345-192.168.204.31@tcp:700:mkdir.0 00000100:00100000:0.0:1782760002.830210:0:135215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112855:x1869355197422592:12345-192.168.204.31@tcp:700:mkdir.0 Request processed in 92us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760002.830218:0:135215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:0.0:1782760002.833003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.833149:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422848 00000100:00100000:2.0:1782760002.833160:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422848 00000100:00100000:2.0:1782760002.833220:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2390 00000100:00100000:2.0:1782760002.833231:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112855:x1869355197422848:12345-192.168.204.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782760002.833284:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782760002.833310:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e175f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67508 expref: 7 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.833327:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75600) 00010000:00010000:2.0:1782760002.833336:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782760002.833416:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.833429:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.833456:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.833470:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.833477:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.833483:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760002.834560:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000041a:0x1:0x0]: returning size 1024 00010000:00010000:2.0:1782760002.834583:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.834592:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.834599:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.834605:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760002.834609:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.834616:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.834629:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff917191f75400) 00010000:00010000:2.0:1782760002.834633:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760002.834645:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.834651:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1766 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782760002.834669:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000858c578d reply state 000000001441250c transno 4294968249 ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782760002.834679:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782760002.836463:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91708182a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+8:112855:x1869355197422848:12345-192.168.204.31@tcp:36:mkdir.0 Request processed in 3224us (3459us total) trans 4294968249 rc 0/0 00000100:00100000:2.0:1782760002.836476:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2390 00010000:00010000:1.0:1782760002.839306:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.839324:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.839333:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.839359:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:1.0:1782760002.839363:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.839371:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.839389:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4ab1b53 (ffff917191f75d00) 00010000:00010000:1.0:1782760002.839392:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782760002.839396:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782760002.839402:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e176d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782760002.875465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.875616:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197422976 00000100:00100000:3.0:1782760002.875628:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197422976 00000100:00100000:3.0:1782760002.875693:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2391 00000100:00100000:3.0:1782760002.875703:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:112862:x1869355197422976:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782760002.875956:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760002.875981:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6750f expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.876044:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e177b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.876060:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e177b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.876072:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e177b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760002.876134:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1782760002.876138:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760002.876160:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e177b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.876205:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcdc00/0xdd99f5c4777e1774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6750f expref: 9 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.876224:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd400/0xdd99f5c4777e177b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6750f expref: 8 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.876233:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782760002.876236:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782760002.876240:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7dcd400, rc 0) 00000100:00100000:3.0:1782760002.876308:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+8:112862:x1869355197422976:12345-192.168.204.31@tcp:101:touch.0 Request processed in 606us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.876316:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2391 00000100:00100000:0.0:1782760002.880640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.880713:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197423104 00000100:00100000:3.0:1782760002.880733:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197423104 00000100:00100000:3.0:1782760002.880798:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2392 00000100:00100000:3.0:1782760002.880808:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+8:112862:x1869355197423104:12345-192.168.204.31@tcp:101:touch.0 00010000:00010000:3.0:1782760002.880861:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760002.881239:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67516 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881300:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881314:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881324:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881353:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881360:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881366:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881482:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce200/0xdd99f5c4777e1797 lrc: 3/1,0 mode: --/PR res: [0x20000041a:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881491:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce200/0xdd99f5c4777e1797 lrc: 3/1,0 mode: PR/PR res: [0x20000041a:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881498:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce200/0xdd99f5c4777e1797 lrc: 3/1,0 mode: PR/PR res: [0x20000041a:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760002.881532:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000041a:0x1:0x0]: returning size 1024 00000004:00200000:3.0:1782760002.881536:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760002.881563:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce200/0xdd99f5c4777e1797 lrc: 3/1,0 mode: PR/PR res: [0x20000041a:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881587:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881593:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881600:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881617:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.881621:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881630:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881643:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782760002.881646:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.881651:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881657:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc600/0xdd99f5c4777e1789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881670:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881676:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881682:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881687:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7dcc200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.881689:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881695:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881713:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4ab1b53 (ffff9171908a1a00) 00010000:00010000:3.0:1782760002.881728:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.881732:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881738:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcc200/0xdd99f5c4777e1790 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881767:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7dcd000/0xdd99f5c4777e1782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67516 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881780:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce200/0xdd99f5c4777e1797 lrc: 3/0,0 mode: PR/PR res: [0x20000041a:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67516 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.881787:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041a:0x1:0x0].0x0 (ffff9171908a1e00) 00010000:00010000:3.0:1782760002.881790:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782760002.881792:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce200, rc 0) 00000100:00100000:3.0:1782760002.882029:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+9:112862:x1869355197423104:12345-192.168.204.31@tcp:101:touch.0 Request processed in 1222us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.882040:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2392 00000100:00100000:1.0:1782760002.970308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.970413:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197423232 00000100:00100000:3.0:1782760002.970424:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197423232 00000100:00100000:3.0:1782760002.970488:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2393 00000100:00100000:3.0:1782760002.970499:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+9:112868:x1869355197423232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782760002.970520:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760002.970540:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e179e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6751d expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970628:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970645:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970658:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970673:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970680:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970687:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970810:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e17b3 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970819:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e17b3 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970866:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e17b3 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760002.970901:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xa:0x0]: returning size 512 00000004:00200000:3.0:1782760002.970905:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760002.970931:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e17b3 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970956:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970963:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970970:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970976:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcee00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.970980:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.970988:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971000:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:3.0:1782760002.971004:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.971009:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971025:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971039:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971045:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971049:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971060:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfe00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.971063:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971069:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971078:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff9171908a1a00) 00010000:00010000:3.0:1782760002.971080:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.971083:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971089:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971120:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e179e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6751d expref: 11 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971134:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfc00/0xdd99f5c4777e17b3 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6751d expref: 10 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.971142:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760002.971144:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782760002.971147:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcfc00, rc 0) 00000100:00100000:3.0:1782760002.971209:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+10:112868:x1869355197423232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 711us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.971218:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2393 00000100:00100000:2.0:1782760002.977728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.977797:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197423488 00000100:00100000:3.0:1782760002.977844:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197423488 00000100:00100000:2.0:1782760002.977988:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2394 00000100:00100000:2.0:1782760002.978000:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+10:112868:x1869355197423488:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782760002.978033:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760002.978057:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17ba lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67524 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978136:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978151:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978162:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978177:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978192:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978200:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978304:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978311:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978318:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978324:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760002.978329:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978337:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978349:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760002.978352:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760002.978357:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978362:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e17c1 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978375:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978386:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978391:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978396:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760002.978399:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978405:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978412:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff917191f75400) 00010000:00010000:2.0:1782760002.978415:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760002.978417:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978423:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17c8 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978452:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17ba lrc: 1/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67524 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978461:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760002.978463:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782760002.978466:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17ba lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67524 expref: 11 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.978485:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90c00, rc 0) 00000100:00100000:2.0:1782760002.978555:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+10:112868:x1869355197423488:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 556us (838us total) trans 0 rc 301/301 00000100:00100000:2.0:1782760002.978573:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2394 00000100:00100000:0.0:1782760002.987757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760002.988574:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197423744 00000100:00100000:2.0:1782760002.988588:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197423744 00000100:00100000:2.0:1782760002.988710:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2395 00000100:00100000:2.0:1782760002.988721:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+10:112868:x1869355197423744:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782760002.988742:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760002.988762:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6752b expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760002.989952:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782760002.990118:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6752b expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.990135:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9171908a1600) 00010000:00010000:2.0:1782760002.990137:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782760002.990142:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6752b expref: 12 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760002.990156:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90c00, rc 0) 00000100:00100000:2.0:1782760002.990236:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+11:112868:x1869355197423744:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1516us (2488us total) trans 4294968250 rc 301/301 00000100:00100000:2.0:1782760002.990245:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2395 00000100:00100000:1.0:1782760002.994869:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760002.995133:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197423872 00000100:00100000:3.0:1782760002.995147:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197423872 00000100:00100000:3.0:1782760002.995214:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2396 00000100:00100000:3.0:1782760002.995223:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+11:112868:x1869355197423872:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1782760002.995306:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995323:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995336:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995351:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995359:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995366:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995485:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/1,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995494:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995500:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760002.995538:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782760002.995555:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760002.995578:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995592:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995599:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995606:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995613:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.995618:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995626:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995638:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760002.995641:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.995647:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995653:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e17dd lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995666:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995671:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995686:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995691:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcfe00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.995693:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995700:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995707:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff9171908a1a00) 00010000:00010000:3.0:1782760002.995709:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.995712:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995717:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcfe00/0xdd99f5c4777e17e4 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995731:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995737:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995742:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995745:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcee00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760002.995748:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995761:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.995767:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff9171908a1500) 00010000:00010000:3.0:1782760002.995769:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760002.995771:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 2/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760002.996115:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e17eb lrc: 0/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782760002.996308:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+11:112868:x1869355197423872:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 1083us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760002.996317:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2396 00000100:00100000:0.0:1782760003.010592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.010707:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197424128 00000100:00100000:2.0:1782760003.010718:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197424128 00000100:00100000:2.0:1782760003.010787:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2397 00000100:00100000:2.0:1782760003.010798:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+11:112868:x1869355197424128:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782760003.010861:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760003.010997:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17f2 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67532 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011072:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011087:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011098:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011113:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011120:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011126:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011264:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1807 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011273:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1807 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011298:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1807 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760003.011309:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782760003.011414:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011423:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011430:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011437:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.011441:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011448:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011461:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760003.011465:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.011470:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011476:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91a00/0xdd99f5c4777e17f9 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011490:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011497:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011510:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011515:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.011518:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011524:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011532:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff917191f75400) 00010000:00010000:2.0:1782760003.011534:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.011537:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011542:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e1800 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011597:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e17f2 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67532 expref: 14 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011612:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91000/0xdd99f5c4777e1807 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67532 expref: 13 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.011620:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75600) 00010000:00010000:2.0:1782760003.011623:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782760003.011626:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91000, rc 0) 00000100:00100000:2.0:1782760003.011681:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+13:112868:x1869355197424128:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 885us (1103us total) trans 4294968251 rc 0/0 00000100:00100000:2.0:1782760003.011697:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2397 00000100:00100000:1.0:1782760003.019206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.019618:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197424256 00000100:00100000:3.0:1782760003.019629:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197424256 00000100:00100000:3.0:1782760003.019698:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2398 00000100:00100000:3.0:1782760003.019709:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+13:112868:x1869355197424256:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782760003.019735:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760003.019759:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e1815 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67539 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.019808:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e1815 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67539 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.019853:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcee00/0xdd99f5c4777e1815 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67539 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.019896:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760003.019899:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.019903:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcee00, rc 0) 00000100:00100000:3.0:1782760003.019977:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+14:112868:x1869355197424256:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 268us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760003.019984:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2398 00000100:00100000:1.0:1782760003.025405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.025593:0:154820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197424384 00000100:00100000:2.0:1782760003.025604:0:154820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197424384 00000100:00100000:2.0:1782760003.025667:0:154820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 426 00000100:00100000:2.0:1782760003.025677:0:154820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+14:112868:x1869355197424384:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:1.0:1782760003.035954:0:154820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+14:112868:x1869355197424384:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 10267us (10549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760003.035971:0:154820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 426 00000100:00100000:1.0:1782760003.041767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.042146:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197424512 00000100:00100000:3.0:1782760003.042156:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197424512 00000100:00100000:3.0:1782760003.042225:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1065 00000100:00100000:3.0:1782760003.042236:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:2362:x1869355197424512:12345-192.168.204.31@tcp:101:lfs.0 00000100:00080000:0.0:1782760003.042251:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782760003.042514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760003.042979:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197424640 00000100:00100000:0.0:1782760003.042985:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197424640 00000100:00100000:0.0:1782760003.043031:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:0.0:1782760003.043040:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+14:2361:x1869355197424640:12345-192.168.204.31@tcp:63:ll_sa.0 00010000:00010000:0.0:1782760003.043082:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782760003.043101:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e181c lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67547 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043151:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043166:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043177:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043192:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043199:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043206:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043437:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1831 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043445:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1831 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043466:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1831 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782760003.043488:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:0.0:1782760003.043492:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782760003.043528:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1831 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043540:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1831 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043549:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043555:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043573:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043580:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.043584:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043592:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043604:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:0.0:1782760003.043607:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.043611:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043627:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e1823 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043643:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043648:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043654:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043659:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.043663:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043668:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043675:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917182dd1d00) 00010000:00010000:0.0:1782760003.043677:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.043680:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043685:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e182a lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043711:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e181c lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67547 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043724:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74a00/0xdd99f5c4777e1831 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67547 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.043737:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:0.0:1782760003.043740:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782760003.043742:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171b7d74a00, rc 0) 00010000:00010000:3.0:1782760003.044009:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760003.044024:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aace8fd5/0xdd99f5c4777e1838 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67540 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782760003.044047:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x6a42c23e, atime: 0x6a42c23e, ctime: 0x6a42c23e, blocks: 0x1 00010000:00010000:3.0:1782760003.044060:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=4071s v=(0 0) 00010000:00010000:3.0:1782760003.044064:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782760003.044490:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aace8fd5/0xdd99f5c4777e1838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67540 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.044513:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aace8fd5/0xdd99f5c4777e1838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67540 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.044524:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcfe00, rc 0) 00000100:00100000:0.0:1782760003.044710:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+15:2361:x1869355197424640:12345-192.168.204.31@tcp:63:ll_sa.0 Request processed in 1670us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760003.044728:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:3.0:1782760003.045634:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:2362:x1869355197424512:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3395us (3871us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760003.045643:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1065 00000100:00100000:1.0:1782760003.050099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.050195:0:9120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197424768 00000100:00100000:2.0:1782760003.050205:0:9120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197424768 00000100:00080000:0.0:1782760003.050335:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782760003.050400:0:9120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1066 00000100:00100000:2.0:1782760003.050410:0:9120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+6:2361:x1869355197424768:12345-192.168.204.31@tcp:101:ll_agl.0 00010000:00010000:2.0:1782760003.050426:0:9120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760003.050447:0:9120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e183f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6754e expref: -99 pid: 9120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782760003.050474:0:9120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x6a42c23f, atime: 0x6a42c23f, ctime: 0x6a42c23f, blocks: 0x1 00010000:00010000:2.0:1782760003.050495:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=4071s v=(0 0) 00010000:00010000:2.0:1782760003.050500:0:9120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782760003.050510:0:9120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e183f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6754e expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.050528:0:9120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2be4dd1/0xdd99f5c4777e183f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6754e expref: 7 pid: 9120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.050541:0:9120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91a00, rc 0) 00000100:00100000:2.0:1782760003.050682:0:9120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+7:2361:x1869355197424768:12345-192.168.204.31@tcp:101:ll_agl.0 Request processed in 272us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760003.050707:0:9120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1066 00000100:00100000:2.0:1782760003.052696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.052803:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197425024 00000100:00100000:3.0:1782760003.052812:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197425024 00000100:00100000:3.0:1782760003.053202:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 427 00000100:00100000:3.0:1782760003.053214:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+15:112868:x1869355197425024:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782760003.053679:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+16:112868:x1869355197425024:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 466us (990us total) trans 4294968252 rc 0/0 00000100:00100000:3.0:1782760003.053687:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 427 00000100:00100000:0.0:1782760003.057658:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.057758:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197425280 00000100:00100000:3.0:1782760003.057769:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197425280 00000100:00100000:3.0:1782760003.057863:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 428 00000100:00100000:3.0:1782760003.057873:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+16:112868:x1869355197425280:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782760003.058150:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+17:112868:x1869355197425280:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 276us (511us total) trans 4294968253 rc 0/0 00000100:00100000:3.0:1782760003.058158:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 428 00000100:00100000:1.0:1782760003.085683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.086193:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197425536 00000100:00100000:2.0:1782760003.086204:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197425536 00000100:00100000:2.0:1782760003.086302:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2399 00000100:00100000:2.0:1782760003.086315:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+17:112876:x1869355197425536:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1782760003.086340:0:7487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760003.086360:0:7487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67555 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.086474:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e184d lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.086490:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e184d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.086500:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e184d lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760003.086511:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782760003.086643:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e1846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67555 expref: 20 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.086662:0:7487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90e00/0xdd99f5c4777e184d lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67555 expref: 19 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.086671:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760003.086675:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782760003.086690:0:7487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90e00, rc 0) 00000100:00100000:2.0:1782760003.086753:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+19:112876:x1869355197425536:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 440us (1078us total) trans 4294968254 rc 0/0 00000100:00100000:2.0:1782760003.086760:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2399 00000100:00100000:0.0:1782760003.098185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.105439:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197425664 00000100:00100000:3.0:1782760003.105457:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197425664 00000100:00100000:3.0:1782760003.105590:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2400 00000100:00100000:3.0:1782760003.105602:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+19:112876:x1869355197425664:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1782760003.105693:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105712:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105753:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105770:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105787:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105794:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105932:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105942:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.105949:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760003.105981:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782760003.105984:0:19544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760003.105996:0:19544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106008:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106014:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106032:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106038:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.106042:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106050:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106061:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760003.106064:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.106068:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106087:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e185b lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106101:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106107:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106114:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106118:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.106121:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106135:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106143:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff9171908a1b00) 00010000:00010000:3.0:1782760003.106146:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.106148:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106154:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1862 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106168:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106174:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106180:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106184:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.106187:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106192:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106199:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782760003.106201:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.106203:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.106216:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1869 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782760003.106307:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+19:112876:x1869355197425664:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 706us (8129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760003.106314:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2400 00000100:00100000:0.0:1782760003.112748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.112861:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197425920 00000100:00100000:3.0:1782760003.112871:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197425920 00000100:00100000:3.0:1782760003.112926:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2401 00000100:00100000:3.0:1782760003.112936:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+19:112876:x1869355197425920:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782760003.112960:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760003.112979:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1870 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6755c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.113067:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e1877 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.113082:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e1877 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.113094:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e1877 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760003.113105:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xb:0x0]: returning size 0 00010000:00010000:3.0:1782760003.113228:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1870 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6755c expref: 22 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.113248:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce600/0xdd99f5c4777e1877 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6755c expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.113270:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782760003.113273:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782760003.113276:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce600, rc 0) 00000100:00100000:3.0:1782760003.113342:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+21:112876:x1869355197425920:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 407us (605us total) trans 4294968255 rc 0/0 00000100:00100000:3.0:1782760003.113349:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2401 00000100:00100000:1.0:1782760003.117633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.117770:0:121722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197426048 00000100:00100000:3.0:1782760003.117994:0:121722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197426048 00000100:00100000:2.0:1782760003.118170:0:121722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 429 00000100:00100000:2.0:1782760003.118182:0:121722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+21:112876:x1869355197426048:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:0.0:1782760003.123226:0:121722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+21:112876:x1869355197426048:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 5032us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760003.123243:0:121722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 429 00000100:00100000:1.0:1782760003.160415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.160541:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197426176 00000100:00100000:3.0:1782760003.160552:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197426176 00000100:00100000:3.0:1782760003.160760:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2402 00000100:00100000:3.0:1782760003.160881:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+21:112882:x1869355197426176:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1782760003.160957:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.160978:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.160992:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161010:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161017:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161024:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161366:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161376:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161384:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760003.161427:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782760003.161432:0:146757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760003.161444:0:146757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161455:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161462:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161469:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161474:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.161479:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161485:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161496:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760003.161506:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.161511:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161517:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1885 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161532:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161538:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161545:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161549:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.161552:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161558:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161578:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff9171908a1b00) 00010000:00010000:3.0:1782760003.161580:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.161583:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161589:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e188c lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161604:0:146757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161616:0:146757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161622:0:146757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161628:0:146757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bce400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.161631:0:146757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161636:0:146757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161644:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75600) 00010000:00010000:3.0:1782760003.161646:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.161649:0:146757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.161654:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e1893 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782760003.161736:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+21:112882:x1869355197426176:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 964us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760003.161745:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2402 00000100:00100000:1.0:1782760003.169816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.170244:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197426304 00000100:00100000:2.0:1782760003.170256:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197426304 00000100:00100000:2.0:1782760003.170315:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:2.0:1782760003.170326:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+21:2361:x1869355197426304:12345-192.168.204.31@tcp:63:ll_sa.0 00010000:00010000:2.0:1782760003.170367:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782760003.170388:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e189a lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67563 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170438:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170452:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170462:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170476:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170482:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170488:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170751:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e18af lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170760:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e18af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170766:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e18af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760003.170786:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:2.0:1782760003.170790:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782760003.170810:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e18af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170820:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e18af lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170856:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170926:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.170932:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171042:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.171046:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171054:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171073:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760003.171076:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.171081:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171088:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18a1 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171101:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171106:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171112:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171116:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.171119:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171124:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171131:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917191f75900) 00010000:00010000:2.0:1782760003.171133:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.171136:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171142:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18a8 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171181:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e189a lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67563 expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171196:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90600/0xdd99f5c4777e18af lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67563 expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.171203:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:2.0:1782760003.171205:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782760003.171208:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b90600, rc 0) 00000100:00100000:2.0:1782760003.171277:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:2361:x1869355197426304:12345-192.168.204.31@tcp:63:ll_sa.0 Request processed in 952us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760003.171284:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:2.0:1782760003.193497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760003.193664:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197426432 00000100:00100000:0.0:1782760003.193674:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197426432 00000100:00100000:0.0:1782760003.193735:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2403 00000100:00100000:0.0:1782760003.193746:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112890:x1869355197426432:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:0.0:1782760003.193817:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194035:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194049:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194065:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194086:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194092:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194194:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194204:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194211:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782760003.194245:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782760003.194249:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782760003.194262:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194273:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194280:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194287:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194293:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.194296:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194310:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194321:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:0.0:1782760003.194324:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.194328:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194334:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74c00/0xdd99f5c4777e18b6 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194349:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194356:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194362:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194367:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75a00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.194369:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194375:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194381:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x8af34a25 (ffff917182dd1d00) 00010000:00010000:0.0:1782760003.194383:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.194386:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194399:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75a00/0xdd99f5c4777e18bd lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194413:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194418:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194424:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194429:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.194432:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194438:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194444:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xb:0x0].0x0 (ffff917191f75600) 00010000:00010000:0.0:1782760003.194446:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.194449:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.194454:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74200/0xdd99f5c4777e18c4 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782760003.194516:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112890:x1869355197426432:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 771us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760003.194524:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2403 00000100:00100000:1.0:1782760003.223371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.223532:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197426688 00000100:00100000:3.0:1782760003.223552:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197426688 00000100:00100000:3.0:1782760003.223685:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2404 00000100:00100000:3.0:1782760003.223696:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112894:x1869355197426688:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782760003.223719:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760003.223752:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e18cb lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf6756a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.223864:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.223880:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.223901:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.223916:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.223923:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.223929:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224031:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224038:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224043:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224050:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.224054:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224070:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224083:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760003.224086:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.224090:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224095:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e18d2 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224110:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224115:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224121:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224126:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.224128:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224133:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224140:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff9171908a1b00) 00010000:00010000:3.0:1782760003.224142:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.224145:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224161:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e18d9 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224193:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e18cb lrc: 1/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6756a expref: 23 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224204:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760003.224206:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782760003.224209:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e18cb lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf6756a expref: 23 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.224219:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bce400, rc 0) 00000100:00100000:3.0:1782760003.224284:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112894:x1869355197426688:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 590us (922us total) trans 0 rc 301/301 00000100:00100000:3.0:1782760003.224292:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2404 00000100:00100000:1.0:1782760003.232081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.232510:0:7487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197426816 00000100:00100000:2.0:1782760003.232521:0:7487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197426816 00000100:00100000:2.0:1782760003.232796:0:7487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2405 00000100:00100000:2.0:1782760003.232808:0:7487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112894:x1869355197426816:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:2.0:1782760003.233208:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.233227:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.233239:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.233255:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.233279:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.233286:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.233389:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234117:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234125:0:7487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760003.234163:0:7487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:2.0:1782760003.234168:0:7487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782760003.234182:0:7487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234194:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234202:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234210:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234215:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.234220:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234236:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234249:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760003.234252:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.234256:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234262:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90c00/0xdd99f5c4777e18e0 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234276:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234282:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234288:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234293:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91e00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.234295:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234301:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234309:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917191f75900) 00010000:00010000:2.0:1782760003.234311:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.234314:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234331:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91e00/0xdd99f5c4777e18e7 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234347:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234353:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234359:0:7487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234364:0:7487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.234367:0:7487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234374:0:7487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.234382:0:7487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:2.0:1782760003.234384:0:7487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.234387:0:7487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 2/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.235086:0:7487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e18ee lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782760003.235179:0:7487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170810e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112894:x1869355197426816:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 2370us (3104us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760003.235189:0:7487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2405 00000100:00100000:2.0:1782760003.244366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.244525:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197427072 00000100:00100000:3.0:1782760003.244536:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197427072 00000100:00100000:3.0:1782760003.244752:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2406 00000100:00100000:3.0:1782760003.244762:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917083249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+22:112894:x1869355197427072:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782760003.244787:0:19544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760003.244808:0:19544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e18f5 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67571 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.246693:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.246714:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.246727:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.246745:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.246752:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.246758:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247234:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e190a lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247244:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e190a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247251:0:19544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e190a lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760003.247262:0:19544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00010000:00010000:2.0:1782760003.247366:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247374:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247467:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247474:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.247478:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247485:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247498:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760003.247501:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.247505:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247512:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e18fc lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247525:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247532:0:19544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247538:0:19544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247622:0:19544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.247626:0:19544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247642:0:19544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247652:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917191f75500) 00010000:00010000:2.0:1782760003.247654:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.247657:0:19544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247663:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1903 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247716:0:19544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bce400/0xdd99f5c4777e18f5 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67571 expref: 25 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247732:0:19544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e190a lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67571 expref: 24 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.247740:0:19544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:2.0:1782760003.248324:0:19544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782760003.248329:0:19544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9171c0b91400, rc 0) 00000100:00100000:2.0:1782760003.248497:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917083249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+24:112894:x1869355197427072:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3733us (4139us total) trans 4294968256 rc 0/0 00000100:00100000:2.0:1782760003.248506:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2406 00000100:00100000:1.0:1782760003.251870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.252071:0:134476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197427200 00000100:00100000:3.0:1782760003.252083:0:134476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197427200 00000100:00100000:3.0:1782760003.252146:0:134476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 199 00000100:00100000:3.0:1782760003.252157:0:134476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+24:2363:x1869355197427200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782760003.252189:0:134476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782760003.252217:0:134476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91400/0xdd99f5c4777e190a lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67571 expref: 24 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.252236:0:134476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:3.0:1782760003.252240:0:134476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782760003.252292:0:134476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+23:2363:x1869355197427200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 137us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760003.252301:0:134476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 199 00000100:00100000:1.0:1782760003.257933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.258242:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197427456 00000100:00100000:3.0:1782760003.258253:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197427456 00000100:00100000:3.0:1782760003.258308:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 430 00000100:00100000:3.0:1782760003.258318:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+23:112894:x1869355197427456:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1782760003.260297:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+24:112894:x1869355197427456:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 1971us (2363us total) trans 4294968257 rc -1/-1 00000100:00100000:3.0:1782760003.260310:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 430 00000100:00100000:0.0:1782760003.326443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.329794:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197427584 00000100:00100000:2.0:1782760003.329809:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197427584 00000100:00100000:3.0:1782760003.334209:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2407 00000100:00100000:3.0:1782760003.334225:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+24:112900:x1869355197427584:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:3.0:1782760003.334324:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334342:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334354:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334389:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334397:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334404:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334509:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334518:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334524:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760003.334580:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:3.0:1782760003.334585:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782760003.334597:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334609:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334615:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334622:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334638:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf200 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.334642:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334650:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334663:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:3.0:1782760003.334666:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.334671:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334677:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf200/0xdd99f5c4777e1918 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334692:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334698:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334704:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334708:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.334711:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334716:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334735:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff9171908a1b00) 00010000:00010000:3.0:1782760003.334738:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.334741:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334746:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e191f lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334762:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334768:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334774:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334779:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff917082bcf000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:3.0:1782760003.334782:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334788:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334795:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:3.0:1782760003.334798:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782760003.334800:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.334806:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e1926 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782760003.337027:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+24:112900:x1869355197427584:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 2795us (10714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760003.337041:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2407 00000100:00100000:1.0:1782760003.346487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1782760003.348894:0:146757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197427840 00000100:00100000:3.0:1782760003.348913:0:146757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197427840 00000100:00100000:3.0:1782760003.348995:0:146757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2408 00000100:00100000:3.0:1782760003.349008:0:146757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+24:112900:x1869355197427840:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1782760003.349033:0:146757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782760003.349057:0:146757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e192d lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4b7c4d35ddf67578 expref: -99 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.349154:0:146757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1934 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.349169:0:146757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1934 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782760003.349180:0:146757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1934 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 146757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782760003.349191:0:146757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00010000:00010000:2.0:1782760003.351459:0:146757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf000/0xdd99f5c4777e192d lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67578 expref: 27 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.351510:0:146757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff917082bcf400/0xdd99f5c4777e1934 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x4b7c4d35ddf67578 expref: 26 pid: 146757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.351519:0:146757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:2.0:1782760003.351522:0:146757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782760003.351526:0:146757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff917082bcf400, rc 0) 00000100:00100000:2.0:1782760003.351723:0:146757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112900:x1869355197427840:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2717us (5243us total) trans 4294968258 rc 0/0 00000100:00100000:2.0:1782760003.351732:0:146757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2408 00000100:00100000:1.0:1782760003.359158:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760003.359264:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197427968 00000100:00100000:0.0:1782760003.359275:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197427968 00000100:00100000:0.0:1782760003.359421:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 431 00000100:00100000:0.0:1782760003.359432:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917187b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112900:x1869355197427968:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:1.0:1782760003.368230:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917187b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112900:x1869355197427968:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 8788us (9069us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760003.368255:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 431 00000100:00100000:1.0:1782760003.430486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1782760003.432097:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197428096 00000100:00100000:0.0:1782760003.432113:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197428096 00000100:00100000:0.0:1782760003.432206:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2409 00000100:00100000:0.0:1782760003.432217:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112904:x1869355197428096:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:0.0:1782760003.432302:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432320:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432332:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432347:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432354:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432361:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432473:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432481:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432502:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782760003.432535:0:5801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:0.0:1782760003.432549:0:5801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782760003.432570:0:5801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432581:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432587:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432593:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432598:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75800 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.432602:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432609:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432619:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:0.0:1782760003.432622:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.432627:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432633:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75800/0xdd99f5c4777e1942 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432658:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432664:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432670:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432674:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d74400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.432678:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432683:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432691:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917182dd1d00) 00010000:00010000:0.0:1782760003.432694:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.432697:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432702:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d74400/0xdd99f5c4777e1949 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.432716:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.433291:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.433298:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.433311:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171b7d75400 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:0.0:1782760003.433316:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.433322:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.433333:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:0.0:1782760003.433335:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782760003.433339:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782760003.433344:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171b7d75400/0xdd99f5c4777e1950 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782760003.433428:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91719fc15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112904:x1869355197428096:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 1210us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760003.433438:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2409 00000100:00100000:0.0:1782760003.476376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1782760003.476489:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355197428224 00000100:00100000:2.0:1782760003.476500:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355197428224 00000100:00100000:2.0:1782760003.476575:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2410 00000100:00100000:2.0:1782760003.476585:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112910:x1869355197428224:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:2.0:1782760003.476663:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 3/1,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.476682:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.476694:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.476707:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 3/1,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.476713:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.476753:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477156:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/1,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477167:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477175:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782760003.477211:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000419:0xc:0x0]: returning size 0 00000004:00200000:2.0:1782760003.477215:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782760003.477228:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477239:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 3/1,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477245:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 2/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477250:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477256:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91600 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.477260:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 3/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477266:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 4/0,0 mode: CR/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477286:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x0 (ffff9171908a1c00) 00010000:00010000:2.0:1782760003.477289:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.477293:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 2/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477299:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91600/0xdd99f5c4777e1957 lrc: 0/0,0 mode: --/CR res: [0x200000419:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477311:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477316:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477321:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477326:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b91c00 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.477329:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477335:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477342:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xa:0x0].0x21bc58c4 (ffff917191f75500) 00010000:00010000:2.0:1782760003.477344:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.477347:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 2/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477351:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b91c00/0xdd99f5c4777e195e lrc: 0/0,0 mode: --/PR res: [0x200000419:0xa:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477375:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/1,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477381:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 2/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477386:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477391:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9171c0b90000 already unused, calling callback (ffffffffc20e04f0) 00010000:00010000:2.0:1782760003.477394:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 3/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477399:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 4/0,0 mode: PR/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477407:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000419:0xc:0x0].0x0 (ffff917182dd1b00) 00010000:00010000:2.0:1782760003.477409:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782760003.477412:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 2/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782760003.477417:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9171c0b90000/0xdd99f5c4777e1965 lrc: 0/0,0 mode: --/PR res: [0x200000419:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782760003.477503:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917084d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c0ec5a4-d5fe-4115-a75b-183a59675c7a+26:112910:x1869355197428224:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 917us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760003.477512:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2410 00010000:00010000:3.0:1782760003.569012:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782760004.524786:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212125184:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.524874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782760004.524929:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212125696:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.524957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782760004.524980:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782760004.524986:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212125312:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.525006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782760004.525020:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212125824:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.525039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782760004.525070:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212125568:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.525095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782760004.525121:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125824 00000100:00100000:1.0:1782760004.525129:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125824 00000100:00100000:2.0:1782760004.525132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782760004.525137:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917083248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212125440:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.525159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782760004.525178:0:126932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125568 00000100:00100000:1.0:1782760004.525181:0:126932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125568 00000100:00100000:2.0:1782760004.525183:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125184 00000100:00100000:2.0:1782760004.525185:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125184 00000100:00100000:2.0:1782760004.525210:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00100000:1.0:1782760004.525213:0:126932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:1.0:1782760004.525222:0:126932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212125824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.525225:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212125184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782760004.525969:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:3.0:1782760004.525979:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782760004.526072:0:126932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1869355212125824:12345-0@lo:400:kworker.0 Request processed in 851us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782760004.526080:0:126932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00080000:1.0:1782760004.526108:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782760004.526112:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782760004.532490:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9171885a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfd399a3-a1a2-417f-89de-b443f9e395e0+19:3305:x1869355212125184:12345-0@lo:400:kworker.0 Request processed in 7253us (7605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760004.532506:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00100000:2.0:1782760004.532901:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125696 00000100:00100000:2.0:1782760004.532910:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125696 00000100:00100000:2.0:1782760004.532965:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125312 00000100:00100000:2.0:1782760004.532968:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125312 00000100:00100000:2.0:1782760004.532985:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125440 00000100:00100000:2.0:1782760004.532988:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125440 00000100:00100000:2.0:1782760004.533012:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:2.0:1782760004.533071:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212125696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.533260:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1782760004.533267:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.533337:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+8:3305:x1869355212125312:12345-0@lo:400:kworker.0 Request processed in 70us (8329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760004.533344:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1782760004.533359:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:2.0:1782760004.533366:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.533402:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3308:x1869355212125440:12345-0@lo:400:kworker.0 Request processed in 37us (8242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760004.533408:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:2.0:1782760004.533465:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869355212125440:0@lo:400:kworker.0 00000100:00100000:2.0:1782760004.533523:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3305:x1869355212125696:12345-0@lo:400:kworker.0 Request processed in 504us (8565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782760004.533529:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:3.0:1782760004.534363:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917081196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212125568:12345-0@lo:400:kworker.0 Request processed in 8382us (9262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782760004.534373:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00080000:3.0:1782760004.534448:0:5797:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782760004.534941:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212125568:0@lo:400:kworker.0 00000100:00100000:1.0:1782760004.536001:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869355212125824:0@lo:400:kworker.0 00000100:00100000:1.0:1782760004.536015:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91708324a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfd399a3-a1a2-417f-89de-b443f9e395e0:3305:1869355212125184:0@lo:400:kworker.0 00000100:00100000:1.0:1782760004.536026:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917081197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869355212125696:0@lo:400:kworker.0 00000100:00100000:1.0:1782760004.536048:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917083248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869355212125312:0@lo:400:kworker.0 00010000:00010000:1.0:1782760004.593631:0:5788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782760004.619191:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6c0ec5a4-d5fe-4115-a75b-183a59675c7a 00000001:00100000:1.0:1782760004.619216:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000001:00080000:1.0:1782760004.619226:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968248 is committed 00000001:00080000:1.0:1782760004.619256:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968256 is committed 00000001:00080000:1.0:1782760004.619272:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968258 is committed 00000020:00000080:1.0:1782760004.619287:0:5824:0:(genops.c:906:class_export_put()) final put ffff91708297c800/95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:3.0:1782760004.619409:0:155884:0:(genops.c:865:class_export_destroy()) destroying export ffff91708297c800/95d4477b-602f-4eb6-8798-a97fbce0e608 for lustre-MDT0000 00000020:00000080:3.0:1782760004.619471:0:155884:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91708297d800 for lustre-MDT0000 00000100:00100000:0.0:1782760005.035967:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782760005.035992:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212125952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782760005.036071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782760005.036145:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355212125952 00000100:00100000:0.0:1782760005.036153:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355212125952 00000100:00100000:0.0:1782760005.036205:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1782760005.036215:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212125952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782760005.036253:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1782760005.036981:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff917082d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869355212125952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 764us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1782760005.036996:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1782760005.037056:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff917084d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869355212125952:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782760005.095613:0:166049:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_65: @@@@@@ FAIL: /mnt/lustre/d65.sanity-sec/f65.sanity-sec.1 should be Encrypted, showed 00000001:00100000:1.0:1782760005.104912:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:1.0:1782760005.104925:0:7507:0:(genops.c:906:class_export_put()) final put ffff9170836ca000/95d4477b-602f-4eb6-8798-a97fbce0e608 00000001:00100000:1.0:1782760005.105098:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c0ec5a4-d5fe-4115-a75b-183a59675c7a 00000020:00000080:1.0:1782760005.105115:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff9170836ca000/95d4477b-602f-4eb6-8798-a97fbce0e608 for lustre-OST0001 00000020:00000080:1.0:1782760005.105169:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9170836cd000 for lustre-OST0001 00010000:00010000:1.0:1782760005.613719:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782760006.638733:0:7496:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782760006.644650:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c0ec5a4-d5fe-4115-a75b-183a59675c7a 00000001:00100000:2.0:1782760006.644671:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:2.0:1782760006.644675:0:6622:0:(genops.c:906:class_export_put()) final put ffff917082ef6000/95d4477b-602f-4eb6-8798-a97fbce0e608 00000020:00000080:0.0:1782760006.645004:0:113294:0:(genops.c:865:class_export_destroy()) destroying export ffff917082ef6000/95d4477b-602f-4eb6-8798-a97fbce0e608 for lustre-OST0000 00000020:00000080:0.0:1782760006.645236:0:113294:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff917082ef5000 for lustre-OST0000 Debug log: 56954 lines, 56954 kept, 0 dropped, 0 bad.